Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios Improving the A ...
Home arrow_forward_ios ... arrow_forward_ios Improving the A ...
Information on ...
Grant Closed

Improving the Accessibility of Effect Size and Synthesis Methods for Single-Case Research

NCSER
Program: Unsolicited
Award amount: $600,000
Principal investigator: Wendy Machalicek
Awardee:
University of Oregon
Year: 2019
Award period: 4 years (01/01/2020 - 12/31/2023)
Project type:
Other
Award number: R324U190002

Purpose

In this project, researchers developed, refined, and disseminated guidance about the appropriate use of single-case design (SCD) effect size and synthesis (including meta-analysis) methods and best practices for summarizing results of individual studies and synthesizing findings across studies. This guidance is important given the expanded use of SCD research methods, the emergence of SCD effect size measures and synthesis methods, and the use of synthesis methods to identify and confirm evidence-based practices in education. 

Project Activities

To develop SCD guidance, the research team conducted a 3-year project. During the first year, they reviewed the literature to select representative data sets published within single-case studies to provide the basis for the illustrations used throughout the Methods Guide for Effect Estimation and Synthesis of Single-Case Studies.  They also developed, field tested, and iteratively revised a Suite of Software Tools (R package and web-based application) to calculate SCD effect sizes. Across all years of the project, the research team developed, refined, and finalized the Methods Guide and the Suite of Software Tools with input from their advisory panel of SCD experts to ensure best fit methods, conceptual clarity of the decision rules featured in the guide, and usability of both the Methods Guide and the Suite of Software Tools. The Methods Guide summarizes technical developments in the use of effect size measures and synthesis methods for SCD and provides guidance on the underlying assumptions, advantages and disadvantages, and strategies for selecting and using each of the three major approaches for estimation and synthesis of single-case studies: a) design-comparable effect sizes, b) case-specific effect sizes, and c) multilevel modeling of raw individual participant interrupted time-series data.  

Key outcomes

The main products of this project are as follows:  

  • A Methods Guide for Effect Estimation and Synthesis of Single-Case Studies with detailed illustrations of appropriate SCD effect size and synthesis methods for commonly encountered research synthesis contexts.
  • A Suite of Software tools (R package and web-based application) that SCD researchers or meta-analysts can use to calculate various effect sizes for SCD studies. 

People and institutions involved

IES program contact(s)

Katherine Taylor

Education Research Analyst
NCSER

Project contributors

John Ferron

Co-principal investigator

James Pustejovsky

Co-principal investigator

Products and publications

Software 

Pustejovsky, J. E., Chen, M., Hamilton, B., & Grekov, P. (2023). scdhlm: A web-based calculator for between-case standardized mean differences (Version 0.7.2) \[Web application\]. https://jepusto.shinyapps.io/scdhlm/ 

Pustejovsky, J. E., Chen, M., Grekov, P., & Swan, D. M. (2023). SingleCaseES: A calculator for single-case effect size indices (Version 0.7.2) [R package]. https://jepusto.github.io/SingleCaseES/  

Pustejovsky, J. E., Chen, M., Hamilton, B., & Grekov, P. (2023). scdhlm: A web-based calculator for between-case standardized mean differences (Version 0.7.2) \[Web application\]. https://jepusto.shinyapps.io/scdhlm  

Project website:

https://jepusto.github.io/SCD-Methods-Guide/

Publications:

ERIC Citations: Find available citations in ERIC for this award here.

Additional project information

This project was jointly funded by the National Center for Special Education Research and the National Center for Education Evaluation and Regional Assistance.

 

Related projects

Training Institute in Advanced Single-Case Research Design and Analysis

R324B200022

Single Case Design Research Training Institute

R324U140001

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

MathematicsDisabilities

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Teaching Fractions with Confidence: Strategies and...

May 12, 2026
Read More
Zoomed in IES logo
Publication/Product Release

Mathematics Intervention Toolkit: High-Quality Res...

April 29, 2026
Read More
Blue zoomed in IES logo
Research insights

The Hidden Gap: Students Have Tools—But Do They Kn...

April 13, 2026 by Sarah Brasiel
Read More
icon-dot-govicon-https icon-quote