Project Activities
The project will develop a software program to calculate d and its standard error for CRTs. Five modules (each for a different type of CRT including two 2-level and three 3-level designs) will be developed and these will be united by a common interface for entering, saving, retrieving, and exporting data. Development will include different formulas for each design and for each d within each design. Simulated data, for which the actual d's and their standard errors are known, will be used to evaluate the validity of results produced by each module. The computer program will address four complications for the calculation of d and its standard error for CRTs that occur when: (1) defining the effect size; (2) computing d; (3) computing the standard error of d; and (4) working with published data for which inappropriate analysis was used. In defining the effect size, CRTs offer more than one population that can be used as the reference (e.g., for a student-in-school design the reference can be all students, all students within a single school, or all schools). The standard deviation used in calculating d will vary depending on the reference population. Complicated adjustments must be made when computing d and its standard error. When using data reported from incorrect analysis, complicated adjustments must be to done to impute the results that would have been reported if appropriate analysis had been performed.
People and institutions involved
IES program contact(s)
Supplemental information
FAST-TRACK AWARD:
Phase I Amount: $149,252
Phase I Period: 6 months
Phase II Amount: $899,622
Phase II Period: 2 years
Tool: The computer program will run on the PC using Windows. It will calculate correct effect sizes and standard errors for data collected under five different cluster randomized designs. The program is intended to make it easy for researchers to identify the design they are using, enter the data correctly, and provide annotation to help with choosing the appropriate reference group. It will carry out complex calculations without the user having to know the formulas being used but will allow the user to view the formulas. When data is not available researchers will have the option of performing sensitivity analyses. A user manual will accompany the program.
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.