Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios Design Comparab ...
Home arrow_forward_ios ... arrow_forward_ios Design Comparab ...
Information on ...
Grant Open

Design Comparable Effect Sizes for Single Case Designs

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $899,721
Principal investigator: Larry Hedges
Awardee:
Northwestern University
Year: 2022
Award period: 4 years (09/01/2022 - 08/31/2026)
Project type:
Methodological Innovation
Award number: R305D220052

Purpose

An important function of effect size measures is to represent the results of studies in a manner that is as comparable as possible. Single-case designs are more difficult to compare across studies, given the typically low number of participants involved in such studies. The purpose of this project is to develop design comparable effect size measures for alternating treatments designs and for changing criterion designs.

Project Activities

The research team will first derive the approximate sampling distributions of the design comparable effect sizes. They will then evaluate the accuracy of the distributions using Monte Carlo simulations of three different estimators of the effect size each for alternating treatments designs and for changing criterion designs.

People and institutions involved

IES program contact(s)

Charles Laurin

Project contributors

Prathiba Natesan Batley

Co-principal investigator

Products and publications

After any necessary mathematical adjustments and reevaluation, the researchers will develop software for calculating the effect size estimates; the software will be available in R and as a Shiny app online. Other products include manuscripts in methodological journals to support additional development of design comparable effect sizes and manuscripts in applied journals to facilitate the use of the effect size estimates by applied researchers.

Publications:

Batley, P. (2024). Should we compromise on n-of-1 data analyses?. BJPsych Advances, 30(5), 322-325.

Batley, P., Thamaran, M., & Hedges, L. V. (2024). ABkPowerCalculator: an app to compute power for balanced (AB) k single case experimental designs. Multivariate Behavioral Research, 59(2), 406-410.

Hedges, L.V., Shadish, W.R. & Natesan Batley, P. (2023). Power analysis for single-case designs: Computations for (AB)k designs. Behavior Research Methods, 55, 3494-3503.

Morin, K. L., Lindström, E. R., Kratochwill, T. R., Levin, J. R., Blasko, A., Weir, A., ... & Hong, E. R. (2024). Nonconcurrent multiple-baseline and multiple-probe designs in special education: A systematic review of current practice and future directions. Exceptional Children, 90(2), 126-147.

Natesan Batley, P., McClure, E. B., Brewer, B., Contractor, A. A., Batley, N. J., Hedges, L. V., & Chin, S. (2023). Evidence and reporting standards in N-of-1 medical studies: a systematic review. Translational Psychiatry, 13(1), 263.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Mathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in Yellow IES Logo
Other Resource

REL Central Ask an Expert Handout: Summary of Key ...

Author(s): REL Central Staff
Read More
Zoomed in IES logo
Statistical Analysis Report

2025 NAEP Long-Term Trend Assessment Results in Re...

Author(s): National Center for Education Statistics (NCES)
Publication number: NCES 2026-021
Read More
Zoomed in IES logo
Descriptive Study

Factors Associated with Grade 9 Math Success in De...

Author(s): Sophia Seifert, Menbere Shiferaw, Riley Stone
Publication number: REL 2026–008
Read More
icon-dot-govicon-https icon-quote