Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios A General Frame ...
Home arrow_forward_ios ... arrow_forward_ios A General Frame ...
Information on ...
Grant Closed

A General Framework for Statistical Power Analysis with Non-normal and Missing Data through Monte Carlo Simulation

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $573,097
Principal investigator: Zhiyong Zhang
Awardee:
University of Notre Dame
Year: 2014
Award period: 3 years (07/01/2014 - 06/30/2017)
Project type:
Methodological Innovation
Award number: R305D140037

Purpose

The increasing complexity of education research poses great challenges on existing techniques used to estimate statistical power. For example, education research often involves longitudinal and multilevel designs as well as advanced techniques such as structural equation and multilevel models. Furthermore, practical data in education are often not normally distributed and are incomplete. Without careful consideration of the complexity of study designs and the impact of non-normal data and missing data on power estimation, the validity of education research can be weakened.

Project Activities

In this project, researchers will develop a general method to enable the specification of models including structural equation models and multilevel models as well missing data mechanisms and non-normality of data through drawing path diagrams. The researchers will then develop methods for simulating data based on those models and methods for calculating statistical power based on repeated simulations, with the resulting methods being robust to non-normal data and missing data. Researchers will also develop software called MCpower to conduct power analysis via the proposed framework. MCpower will run as a web application and can be used locally on a personal computer or remotely on a Web server within a web browser. The project is expected to offer the community of education researchers an easy-to-use and general-purpose tool to conduct sophisticated statistical power analysis for structural equation and multilevel models with non-normal and missing data.

People and institutions involved

IES program contact(s)

Allen Ruby

Project contributors

Ke-Hai Yuan

Co-principal investigator

Products and publications

ERIC Citations: Find available citations in ERIC for this award here.

Journal article, monograph, or newsletter:

Cain, M.K., Zhang, Z., and Yuan, K.H. (2017). Univariate and Multivariate Skewness and Kurtosis for Measuring Nonnormality: Prevalence, Influence and Estimation. Behavior Research Methods, 49(5), 1716-1735.

Liu, H., and Zhang, Z. (2017). Logistic Regression With Misclassification in Binary Outcome Variables: A Method and Software. Behaviormetrika, 44(2), 447-476.

Mai, Y., and Zhang, Z. (2018). Software Packages for Bayesian Multilevel Modeling. Structural Equation Modeling: A Multidisciplinary Journal, 1-9.

Mai, Y., Zhang, Z., and Wen, Z. (2018). Comparing Exploratory Structural Equation Modeling and Existing Approaches for Multiple Regression With Latent Variables. Structural Equation Modeling: A Multidisciplinary Journal, 1-13.

Yuan, K.H., Zhang, Z., and Zhao, Y. (2017). Reliable and More Powerful Methods for Power Analysis in Structural Equation Modeling. Structural Equation Modeling: A Multidisciplinary Journal, 24(3), 315-330.

Zhang, Z. (2016). Modeling Error Distributions of Growth Curve Models Through Bayesian Methods. Behavior Research Methods, 48(2), 427-444.

Zhang, Z., and Yuan, K. (2016). Robust Coefficients Alpha and Omega and Confidence Intervals with Outlying Observations and Missing Data: Methods and Software. Educational and Psychological Measurement, 76(3): 387-411.

Proceedings:

Mai, Y., and Zhang, Z. (2016, July). Statistical Power Analysis for Comparing Means with Binary or Count Data Based on Analogous ANOVA. In The Annual Meeting of the Psychometric Society (pp. 381-393). Springer, Cham.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Data and AssessmentsMathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Summer Research Training Institute on Cluster-Rand...

July 06, 2026
Read More
Zoomed in IES logo
Tool/Toolkit

Resource to Support Selecting Effective Reading In...

Author(s): Megan Bogia, Kyla Brown, John Westall, Supriya Tamang, Allan Porowski
Read More
Zoomed in IES logo
Research insights

From Evidence to Classroom Practice: The Toolkit t...

February 02, 2026 by Riley Stone
Read More
icon-dot-govicon-https icon-quote