Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios A General Framework for Statistical ...
Home arrow_forward_ios ... arrow_forward_ios A General Framework for Statistical ...
Information on IES-Funded Research
Grant Closed

A General Framework for Statistical Power Analysis with Non-normal and Missing Data through Monte Carlo Simulation

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $573,097
Principal investigator: Zhiyong Zhang
Awardee:
University of Notre Dame
Year: 2014
Project type:
Methodological Innovation
Award number: R305D140037

Purpose

The increasing complexity of education research poses great challenges on existing techniques used to estimate statistical power. For example, education research often involves longitudinal and multilevel designs as well as advanced techniques such as structural equation and multilevel models. Furthermore, practical data in education are often not normally distributed and are incomplete. Without careful consideration of the complexity of study designs and the impact of non-normal data and missing data on power estimation, the validity of education research can be weakened.

Project Activities

In this project, researchers will develop a general method to enable the specification of models including structural equation models and multilevel models as well missing data mechanisms and non-normality of data through drawing path diagrams. The researchers will then develop methods for simulating data based on those models and methods for calculating statistical power based on repeated simulations, with the resulting methods being robust to non-normal data and missing data. Researchers will also develop software called MCpower to conduct power analysis via the proposed framework. MCpower will run as a web application and can be used locally on a personal computer or remotely on a Web server within a web browser. The project is expected to offer the community of education researchers an easy-to-use and general-purpose tool to conduct sophisticated statistical power analysis for structural equation and multilevel models with non-normal and missing data.

People and institutions involved

IES program contact(s)

Allen Ruby

Associate Commissioner for Policy and Systems
NCER

Products and publications

ERIC Citations: Find available citations in ERIC for this award here.

Journal article, monograph, or newsletter:

Cain, M.K., Zhang, Z., and Yuan, K.H. (2017). Univariate and Multivariate Skewness and Kurtosis for Measuring Nonnormality: Prevalence, Influence and Estimation. Behavior Research Methods, 49(5), 1716-1735.

Liu, H., and Zhang, Z. (2017). Logistic Regression With Misclassification in Binary Outcome Variables: A Method and Software. Behaviormetrika, 44(2), 447-476.

Mai, Y., and Zhang, Z. (2018). Software Packages for Bayesian Multilevel Modeling. Structural Equation Modeling: A Multidisciplinary Journal, 1-9.

Mai, Y., Zhang, Z., and Wen, Z. (2018). Comparing Exploratory Structural Equation Modeling and Existing Approaches for Multiple Regression With Latent Variables. Structural Equation Modeling: A Multidisciplinary Journal, 1-13.

Yuan, K.H., Zhang, Z., and Zhao, Y. (2017). Reliable and More Powerful Methods for Power Analysis in Structural Equation Modeling. Structural Equation Modeling: A Multidisciplinary Journal, 24(3), 315-330.

Zhang, Z. (2016). Modeling Error Distributions of Growth Curve Models Through Bayesian Methods. Behavior Research Methods, 48(2), 427-444.

Zhang, Z., and Yuan, K. (2016). Robust Coefficients Alpha and Omega and Confidence Intervals with Outlying Observations and Missing Data: Methods and Software. Educational and Psychological Measurement, 76(3): 387-411.

Proceedings:

Mai, Y., and Zhang, Z. (2016, July). Statistical Power Analysis for Comparing Means with Binary or Count Data Based on Analogous ANOVA. In The Annual Meeting of the Psychometric Society (pp. 381-393). Springer, Cham.

Supplemental information

Co-Principal Investigator: Yuan, Ke-Hai

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Data and AssessmentsMathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Data Science Methods for Digital Learning Platform...

August 18, 2025
Read More
Zoomed in IES logo
Workshop/Training

Meta-Analysis Training Institute (MATI)

July 28, 2025
Read More
Zoomed in Yellow IES Logo
Workshop/Training

Bayesian Longitudinal Data Modeling in Education S...

July 21, 2025
Read More
icon-dot-govicon-https icon-quote