Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios Developing Comp ...
Home arrow_forward_ios ... arrow_forward_ios Developing Comp ...
Information on ...
Grant Closed

Developing Computational Tools for Model-Based Oral Reading Fluency Assessments

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $899,901
Principal investigator: Akihito Kamata
Awardee:
Southern Methodist University
Year: 2020
Award period: 4 years 10 months (08/01/2020 - 05/31/2025)
Project type:
Methodological Innovation
Award number: R305D200038

Purpose

The purpose of this study is to expand the existing estimation model available in a computer-based oral reading fluency (ORF) assessment which was developed as part of a previous IES grant (R305A140203). The extensions of the previous model will include the development of a sentence-level model that takes into account between-sentence dependency and incomplete reading.

Project Activities

The model parameter estimation algorithms for these extensions will be developed by the method of moments, the Monte Carlo EM algorithm approach, and the Bayesian HMC approach used in the software package Stan.

Key outcomes

The primary product of this grant will be a Shiny app for rendering user-friendly the R code needed to estimate model parameters. The Shiny app will expand the capabilities of the previous software by providing better ORF score comparability both within and between students for better longitudinal and cross-sectional studies, as well as better estimates of measurement errors for ORF scores. The research team will also demonstrate the use of the new software on data collected for 150 passages as part of the work done for R305A140203 and develop web-based tutorials for supporting applied researchers who want to use the Shiny app.

People and institutions involved

IES program contact(s)

Charles Laurin

Project contributors

Cornelis Potgieter

Co-principal investigator

Joseph Nese

Co-principal investigator

Yusuf Kara

Co-principal investigator

Products and publications

  • R package bspam GitHub repository: 
    • https://github.com/kamataak/bspam 
  • Shiny App: 
    • https://shinyviz.smu.edu/shiny/public/bspam-main/ 
  • The project website has been designed for applied education researchers to use to navigate to install and use the R package bspam for our example data as well as for their own ORF assessment data.
    • https://kamataak.github.io/bspam/ 

Project website:

bspam

Publications:

Bui, M. T., Potgieter, C. J., & Kamata, A. (2022). Penalized likelihood methods for modeling count data. Journal of Applied Statistics, 1-20.

Kara, Y., Kamata, A., Ozkeskin, E. E., Qiao, X., & Nese, J. F. (2023). Predicting oral reading fluency scores by between-word silence times using natural language processing and random forest algorithm. Psychological Test and Assessment Modeling, 65(2), 36-54.

Kara, Y., Kamata, A., Qiao, X., Potgieter, C. J., & Nese, J. F. (2023). Equating Oral Reading Fluency Scores: A Model-Based Approach. Educational and Psychological Measurement, 00131644221148122.

Potgieter, C. J., Kamata, A., Kara, Y., & Qiao, X. (2025). Joint analysis of dispersed count-time data using a bivariate latent factor model. British Journal of Mathematical and Statistical Psychology.

Potgieter, C., Qiao, X., Kamata, A., & Kara, Y. (2024). Likelihood-based estimation of model-derived oral reading fluency. Journal of Educational Measurement. http://dx.doi.org/10.1111/jedm.12404 

Qiao, X., Kamata, A., Kara, Y., Potgieter, C., & Nese, J. (2025). Beta-binomial model for count data: An application in estimating model-based oral reading fluency. Educational and Psychological Measurement. http://dx.doi.org/10.1177/00131644251335914 

Qiao, X., Kamata, A., & Potgieter, N. (2023). Incorporating calibration errors in oral reading fluency scoring. British Journal of Mathematical and Statistical Psychology. http://doi.org/10.1111/bmsp.12348 

Related projects

Measuring Oral Reading Fluency: Computerized Oral Reading Evaluation (CORE)

R305A140203

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Data and AssessmentsReading

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Summer Research Training Institute on Cluster-Rand...

July 06, 2026
Read More
Zoomed in IES logo
Fact Sheet/Infographic/FAQ

Decoding Complex Multisyllabic Words: Two Instruct...

Author(s): Mary Jo Taylor
Read More
Zoomed in IES logo
Tool/Toolkit

Resource to Support Selecting Effective Reading In...

Author(s): Megan Bogia, Kyla Brown, John Westall, Supriya Tamang, Allan Porowski
Read More
icon-dot-govicon-https icon-quote