Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios Integrated Repl ...
Home arrow_forward_ios ... arrow_forward_ios Integrated Repl ...
Information on ...
Grant Open

Integrated Replication Designs for Identifying Generalizability Boundaries of Causal Effects

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $899,115
Principal investigator: Vivian Wong
Awardee:
University of Virginia
Year: 2022
Award period: 4 years (09/01/2022 - 08/31/2026)
Project type:
Methodological Innovation
Award number: R305D220034

Purpose

The purpose of this grant is to develop an approach for identifying generalizability boundaries, which describe conditions under which effects are expected to replicate across variations in units, treatments, outcomes, settings, and times. The researchers will use principles of fractional and confounded factorial designs to plan integrated fractional replication designs and use subject-matter theory to specify causal estimands of interest, along with hypothesized moderators. The research will proceed in three phases, ultimately yielding user-friendly software for running the models, workshops and presentations at conferences, and papers in peer-reviewed journals.

Project Activities

First, the team will conduct Monte Carlo simulation studies to investigate the effects of different design facets on the results from integrated fractional factorial replication designs. The simulations will also be used to test the robustness of the results to deviations from design assumptions. Second, the researchers will demonstrate the use of the models using real data from special education and from teacher preparation settings.

People and institutions involved

IES program contact(s)

Charles Laurin

Project contributors

Peter M. Steiner

Co-principal investigator

Products and publications

In the third phase, the research team will create a user-friendly version of the software in R, along with instructional materials for implementing and analyzing integrated fractional replication designs. The instructional materials will be used at conference workshops and will be available online.

Publications:

Cohen, J., Wong, V., Liu, Q., Wilson, K., Yonas, A., & Parten, H. (2025). Practice does not make perfect: Experimental evidence on the effectiveness of coaching beginning teachers. Journal of Educational Psychology.

Steiner, P. M., Sheehan, P., & Wong, V. C. (2023). Correspondence measures for assessing replication success. Psychological Methods.

Steiner, P. M., Sheehan, P., & Wong, V. C. (2023). Correspondence Measures for Assessing Replication Success. PsyArXiv Preprints.

Related projects

Developing Methodological Foundations for Replication Sciences

R305D190043

Developing Infrastructure and Procedures for the Special Education Research Accelerator

R324U190001

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Mathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Research insights

From Evidence to Classroom Practice: The Toolkit t...

February 02, 2026 by Riley Stone
Read More
Rectangle Blue 1 Pattern 1
Thought leadership

What's on the Horizon for the 2026 Nation's Report...

January 21, 2026 by Matthew Soldner
Read More
Zoomed in IES logo
Blog

Making Informed 9th Grade Math Placement Decisions

January 07, 2026 by Lilla Pivnick
Read More
icon-dot-govicon-https icon-quote