Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios A Comprehensive Online Literacy Ass ...
Home arrow_forward_ios ... arrow_forward_ios A Comprehensive Online Literacy Ass ...
Information on IES-Funded Research
Contract Open

A Comprehensive Online Literacy Assessment with Oral Assessment of Foundational Skills

NCER
Program: Small Business Innovation Research
Award amount: $1,000,000
Project director: Tyler Borek
Awardee:
Literably
Year: 2022
Project type:
Phase II Development
Contract number: 91990022C0045

Purpose

This project team will develop an oral reading fluency assessment for students in Kindergarten to Grade 5. Today, schools assess students across a range of critical literacy skills to identify instructional needs. Many of these skills are best assessed orally, but computers are still unable to process speech with human accuracy.

Project Activities

In the Phase I project in 2021, the research team developed a prototype to assess early grade school students' oral reading accuracy, including their rate and comprehension when reading aloud. The prototype prompted students to complete tasks by reading a word aloud into a device, and after the automatic speech recognition engine and a human rater scored students' oral responses.At the end of Phase I, the research team completed a pilot study with 22 educators and 450 students in Grades 1 to 3 that found that the prototype functioned as intended as students were able to self-administer the tasks and over 75% of teachers reported that the results of the assessment were accurate and helpful for informing instructional practice.

People and institutions involved

IES program contact(s)

Edward Metz

IES Research Scientist
NCER

Products and publications

Product: The project team will develop the Platform for Actionable Reading Assessment (PARA), a comprehensive oral literacy assessment to efficiently and accurately measure the components of reading, including rapid naming, phonological awareness, phonics, fluency, vocabulary, comprehension, and spelling. For oral tasks, PARA will prompt the student to complete the task aloud and will record their responses. A mixture of human transcription and automatic speech recognition will score the responses and, within 24 hours, post the scores to a teacher dashboard to inform instruction. The assessment will replace one or more existing assessments of oral reading fluency, and results will be shared with teachers so that they can integrate the assessment findings into formal in-class learning. Training resources will support teachers with implementation, including videos, slide decks, and help articles.

ERIC Citations: Find available citations in ERIC for this award here.

Company Website: www.literably.com

Video Demonstration of the Phase I Prototype:  https://www.youtube.com/watch?v=QOIWlPTFbNs

Project website:

https://www.literably.com

Supplemental information

During Phase II development, the team will focus on optimizing the back-end data infrastructure, expanding the assessment tasks, and finalizing the user interfaces for students and educators. After development is complete, researchers will conduct a pilot study with 48 Kindergarten to Grade 5 classrooms (eight per grade). Half of the classrooms will be assigned to use the treatment and half will follow the business-as-usual assessment of oral reading fluency. The study will examine the feasibility, usability, fidelity of implementation, and validity of the assessment, and its promise for improving oral reading outcomes from pre-test to post-test.  To measure the validity of the assessment, researchers will compare scores with validated measures of oral reading, such as the STAR Early Literacy, STAR Reading, and the mCLASS. Researchers will gather cost information using the "ingredients method" and will include all expenditures on items such as personnel, facilities, equipment, materials, and training.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Cognition

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Grant

Effects of Enhanced Representations in Digital Mat...

Award number: R305N240050
Read More
Zoomed in IES logo
Grant

A Multipronged Approach to Small-Teaching Interven...

Award number: R305N240063
Read More
Zoomed in IES logo
Grant

Additive and Multiplicative Learning Progressions:...

Award number: R305A240131
Read More
icon-dot-govicon-https icon-quote