Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Bayesian Dynamic Borrowing: A Metho ...
Home arrow_forward_ios ... arrow_forward_ios Bayesian Dynamic Borrowing: A Metho ...
Information on IES-Funded Research
Grant Closed

Bayesian Dynamic Borrowing: A Method for Utilizing Historical Data in Education Research

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $802,314
Principal investigator: David Kaplan
Awardee:
University of Wisconsin, Madison
Year: 2019
Project type:
Methodological Innovation
Award number: R305D190053

Purpose

In education research, long-standing, large-scale educational assessments, such as the National Assessment of Educational Progress (NAEP ), the Programme for International Student Assessment (PISA), and the Early Childhood Longitudinal Program (ECLS), provide historical data that can be used to inform policy-relevant research. However, statistical analyses of current large-scale assessment data may not make use of this historical information, and it may be difficult to do so when applying conventional statistical methods. This project developed and adapted the method of Bayesian dynamic borrowing (Viele et al., 2014) as a means of systematically incorporating prior historical data arising from large-scale education assessments into current analyses. Bayesian dynamic borrowing allows a researcher to account for the fact that not all historical data, even from the same survey program, are of equal quality. As such, prior information can be systematically adjusted to reflect the analyst’s degree-of-confidence in the importance and/or quality of sources of prior data.

Project Activities

The project team implemented Bayesian dynamic borrowing under both the single-level and multilevel settings characteristic of large-scale assessment data and extended Bayesian dynamic borrowing to longitudinal designs focusing on growth over time.

People and institutions involved

IES program contact(s)

Allen Ruby

Associate Commissioner for Policy and Systems
NCER

Products and publications

ERIC Citations:  Find available citations in ERIC for this award here.

Project Website: http://bise.wceruw.org/index.html

Additional Online Resources and Information:

  • Shiny BHP App: https://github.com/Bayesian-Methods-for-Education-Research/ShinyBHB

Select Publications:

Journal articles

Kaplan, D. & Chen, J. & Yavuz, S. & Lyu, W. (2022). Bayesian dynamic borrowing of historical information with applications to the analysis of large-scale assessments. Psychometrika., 88(1)1-30. doi.org/10.1007/s11336-022-09869-3

Kaplan, D., Chen, J., Lyu, W. and Yavuz, S. (2023) Bayesian historical borrowing with longitudinal large-scale assessments Large-scale Assessments in Education, volume 11(1),2 doi.org/10.1186/s40536-022-00140-w

Viele, K., Berry, S., Neuenschwander, B., Amzal, B., Chen, F., Enas, N., ... & Thompson, L. (2014). Use of historical control data for assessing treatment effects in clinical trials. Pharmaceutical statistics, 13(1), 41-54.

Project website:

https://bise.wceruw.org/index.html

Related projects

Bayesian Inference for Experimental and Observational Studies in Education

R305D110001

Supplemental information

Co-Principal Investigator: Chen, Jianshen

Key Outcomes

  • The researchers developed an application software program to conduct Bayesian dynamic borrowing called Shiny BHP App, which is available at https://github.com/Bayesian-Methods-for-Education-Research/ShinyBHB
  • Details about applying Bayesian dynamic borrowing to large scale and longitudinal assessment were released in peer reviewed publications (Kaplan et al., 2022; Kaplan et al., 2023)

Statistical/Methodological Product: This project developed an application software program to conduct Bayesian dynamic borrowing for complex sampling designs for cross-sectional and longitudinal data found in education research.

Development/Refinement Process: Bayesian dynamic borrowing has been primarily developed in the clinical trials literature, where information is borrowed from control groups of previous studies in order to increase power. This project expanded Bayesian dynamic borrowing to complex sampling designs for cross-sectional and longitudinal data found in education research. The work required development of statistical models for the complexity of the data encountered in education and the use of new probabilistic modeling tools, such as the Stan programming environment, which underlies the application program.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

MathematicsData and Assessments

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Data Science Methods for Digital Learning Platform...

August 18, 2025
Read More
Zoomed in IES logo
Workshop/Training

Meta-Analysis Training Institute (MATI)

July 28, 2025
Read More
Zoomed in Yellow IES Logo
Workshop/Training

Bayesian Longitudinal Data Modeling in Education S...

July 21, 2025
Read More
icon-dot-govicon-https icon-quote