Skip Navigation
Funding Opportunities | Search Funded Research Grants and Contracts

IES Grant

Title: Response Ratio Effect Sizes for Single-Case Designs with Behavioral Outcome Measures
Center: NCER Year: 2016
Principal Investigator: Pustejovsky, James Awardee: University of Texas, Austin
Program: Statistical and Research Methodology in Education–Early Career      [Program Details]
Award Period: 2 years (8/1/2016 7/31/2018) Award Amount: $199,690
Type: Methodological Innovation Award Number: R305D160002

The purpose of this project is to develop models and methods of estimating response ratio effect sizes in single-case designs. Current methods for response ratios make the assumption that outcomes are drawn independently from a process that is stationary in each phase, an assumption which is typically unrealistic when the observations are made repeatedly on the same individual. By elaborating an existing measurement model for behavioral observations, statistical models that can accommodate both serially-correlated observations and linear time trends will be developed. The PI will study the implications of using response ratios by comparing results of meta-analyses using the new approaches and common effect size metrics.

The PI will first program and conduct simulation studies using the R software package in order to compare multiple approaches to effect size estimation. He will then conduct the meta-analyses of real data to provide an applied comparison of the new approaches to current practices. By the end of the project, he expects to have given presentations at national conferences attended by applied researchers, prepared manuscripts for publication in both methodological and applied journals, and developed user-friendly software and documentation for conducting the proposed methods in multiple platforms, including R and Stata.


Journal article, monograph, or newsletter

Pustejovsky, J.E. (2018). Using Response Ratios for Meta-Analyzing Single-Case Designs With Behavioral Outcomes. Journal of School Psychology, 68, 99–112.

Zimmerman, K.N., Ledford, J.R., Severini, K.E., Pustejovsky, J.E., Barton, E.E., and Lloyd, B.P. (2018). Single-Case Synthesis Tools I: Comparing Tools to Evaluate SCD Quality and Rigor. Research in Developmental Disabilities.

Zimmerman, K.N., Pustejovsky, J.E., Ledford, J.R., Barton, E.E., Severini, K.E., and Lloyd, B.P. (2018). Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures. Research In Developmental Disabilities.