Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Integrated Replication Designs for ...
Home arrow_forward_ios ... arrow_forward_ios Integrated Replication Designs for ...
Information on IES-Funded Research
Grant Open

Integrated Replication Designs for Identifying Generalizability Boundaries of Causal Effects

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $899,115
Principal investigator: Vivian Wong
Awardee:
University of Virginia
Year: 2022
Project type:
Methodological Innovation
Award number: R305D220034

Purpose

The purpose of this grant is to develop an approach for identifying generalizability boundaries, which describe conditions under which effects are expected to replicate across variations in units, treatments, outcomes, settings, and times. The researchers will use principles of fractional and confounded factorial designs to plan integrated fractional replication designs and use subject-matter theory to specify causal estimands of interest, along with hypothesized moderators. The research will proceed in three phases, ultimately yielding user-friendly software for running the models, workshops and presentations at conferences, and papers in peer-reviewed journals.

Project Activities

First, the team will conduct Monte Carlo simulation studies to investigate the effects of different design facets on the results from integrated fractional factorial replication designs. The simulations will also be used to test the robustness of the results to deviations from design assumptions. Second, the researchers will demonstrate the use of the models using real data from special education and from teacher preparation settings.

People and institutions involved

IES program contact(s)

Charles Laurin

Education Research Analyst
NCER

Products and publications

Products: In the third phase, the research team will create a user-friendly version of the software in R, along with instructional materials for implementing and analyzing integrated fractional replication designs. The instructional materials will be used at conference workshops and will be available online.

Publications:

Steiner, P. M., Sheehan, P., & Wong, V. C. (2023). Correspondence Measures for Assessing Replication Success. PsyArXiv Preprints.

Related projects

Developing Methodological Foundations for Replication Sciences

R305D190043

Developing Infrastructure and Procedures for the Special Education Research Accelerator

R324U190001

Supplemental information

Co-Principal Investigator: Steiner, Peter M.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Mathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Blue 3 Placeholder Pattern 1
Statistical Analysis Report

2024 NAEP Mathematics Assessment: Results at Grade...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2024217
Read More
Zoomed in IES logo
Statistics in Brief

NAEP Mathematics 2024 State and District Snapshot ...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2024219
Read More
Zoomed in IES logo
First Look / ED TAB

TIMSS 2023 U.S. Highlights Web Report

Author(s): Catharine Warner-Griffin, Grace Handley, Benjamin Dalton, Debbie Herget
Publication number: NCES 2024184
Read More
icon-dot-govicon-https icon-quote