Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios Bayesian Dynami ...
Home arrow_forward_ios ... arrow_forward_ios Bayesian Dynami ...
Information on ...
Grant Closed

Bayesian Dynamic Borrowing: A Method for Utilizing Historical Data in Education Research

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $802,314
Principal investigator: David Kaplan
Awardee:
University of Wisconsin, Madison
Year: 2019
Award period: 3 years (07/01/2019 - 06/30/2022)
Project type:
Methodological Innovation
Award number: R305D190053

Purpose

In education research, long-standing, large-scale educational assessments, such as the National Assessment of Educational Progress (NAEP ), the Programme for International Student Assessment (PISA), and the Early Childhood Longitudinal Program (ECLS), provide historical data that can be used to inform policy-relevant research. However, statistical analyses of current large-scale assessment data may not make use of this historical information, and it may be difficult to do so when applying conventional statistical methods. This project developed and adapted the method of Bayesian dynamic borrowing (Viele et al., 2014) as a means of systematically incorporating prior historical data arising from large-scale education assessments into current analyses. Bayesian dynamic borrowing allows a researcher to account for the fact that not all historical data, even from the same survey program, are of equal quality. As such, prior information can be systematically adjusted to reflect the analyst’s degree-of-confidence in the importance and/or quality of sources of prior data.

Project Activities

The project team implemented Bayesian dynamic borrowing under both the single-level and multilevel settings characteristic of large-scale assessment data and extended Bayesian dynamic borrowing to longitudinal designs focusing on growth over time.

Structured Abstract

Statistical/Methodological Product: This project developed an application software program to conduct Bayesian dynamic borrowing for complex sampling designs for cross-sectional and longitudinal data found in education research.

Development/Refinement Process: Bayesian dynamic borrowing has been primarily developed in the clinical trials literature, where information is borrowed from control groups of previous studies in order to increase power. This project expanded Bayesian dynamic borrowing to complex sampling designs for cross-sectional and longitudinal data found in education research. The work required development of statistical models for the complexity of the data encountered in education and the use of new probabilistic modeling tools, such as the Stan programming environment, which underlies the application program.

Key outcomes

  • The researchers developed an application software program to conduct Bayesian dynamic borrowing called Shiny BHP App, which is available at https://github.com/Bayesian-Methods-for-Education-Research/ShinyBHB
  • Details about applying Bayesian dynamic borrowing to large scale and longitudinal assessment were released in peer reviewed publications (Kaplan et al., 2022; Kaplan et al., 2023)

People and institutions involved

IES program contact(s)

Allen Ruby

Project contributors

Jianshen Chen

Co-principal investigator

Products and publications

ERIC Citations:  Find available citations in ERIC for this award here.

Additional Online Resources and Information:

  • Shiny BHP App: https://github.com/Bayesian-Methods-for-Education-Research/ShinyBHB

Select Publications:

Journal articles

Kaplan, D. & Chen, J. & Yavuz, S. & Lyu, W. (2022). Bayesian dynamic borrowing of historical information with applications to the analysis of large-scale assessments. Psychometrika., 88(1)1-30. doi.org/10.1007/s11336-022-09869-3

Kaplan, D., Chen, J., Lyu, W. and Yavuz, S. (2023) Bayesian historical borrowing with longitudinal large-scale assessments Large-scale Assessments in Education, volume 11(1),2 doi.org/10.1186/s40536-022-00140-w

Viele, K., Berry, S., Neuenschwander, B., Amzal, B., Chen, F., Enas, N., ... & Thompson, L. (2014). Use of historical control data for assessing treatment effects in clinical trials. Pharmaceutical statistics, 13(1), 41-54.

Project website:

https://bise.wceruw.org/index.html

Related projects

Bayesian Inference for Experimental and Observational Studies in Education

R305D110001

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Data and AssessmentsMathematics

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Grant

Advancing Youth Academic Success through the Virgi...

Award number: R305S260009
Read More
Zoomed in IES logo
Workshop/Training

Summer Research Training Institute on Cluster-Rand...

July 06, 2026
Read More
Zoomed in Yellow IES Logo
Other Resource

REL Central Ask an Expert Handout: Summary of Key ...

Author(s): REL Central Staff
Read More
icon-dot-govicon-https icon-quote