Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Kasi Learning System: Accessible Sc ...
Home arrow_forward_ios ... arrow_forward_ios Kasi Learning System: Accessible Sc ...
Information on IES-Funded Research
Contract Open

Kasi Learning System: Accessible Science Diagrams through Multisensory Augmented Reality

NCSER
Program: Small Business Innovation Research
Award amount: $1,000,000
Project director: Julia Winter
Awardee:
Alchemie
Year: 2022
Project type:
Phase II Development
Contract number: 91990022C0044

Purpose

This project team will fully develop a product to support students who are blind or visually impaired as they are learning chemistry. The Kasi system provides audio generated information when scientific images and diagrams are presented during instruction. Diagrams and images are essential for practicing scientists and chemistry, in particular, is a visual science. In fact, visual model comprehension has been shown to predict exam scores in introductory chemistry courses. However, for students who are blind or visually impaired, many science materials are not accessible.

Project Activities

In the prior 2021 Phase I project, the team developed a prototype of an augmented reality system that provides audio generated information on scientific images and diagrams used for teaching and learning chemistry. The prototype, called Kasi, also included tactile physical manipulatives and software to provide students a more comparable experience of the visualization to that of their sighted peers. At the end of Phase I, a pilot study was conducted with three special education teachers and 10 high school students who are blind or visual impaired. Results demonstrated that the prototype functioned as planned, all students reported that they were engaged and learned chemistry concepts, and educators believed that the full product would be feasible to integrate into classroom practice.

People and institutions involved

IES program contact(s)

Edward Metz

IES Research Scientist
NCER

Products and publications

Product: The project team will fully develop Kasi, an augmented reality product that provides audio generated information on scientific images and diagrams used for teaching and learning chemistry. The product will include digital interactives with tactile pieces and computer vision algorithms to produce a multisensory augmented reality method for students who are blind or visually impaired to use as they learn chemistry diagrams and content. A suite of five digital interactives and their corresponding tactile pieces will be developed and combined with a pedagogical system of audio-based augmented reality learning prompts to teach concepts throughout the secondary chemistry curriculum.

Project website:

https://www.alchem.ie

Supplemental information

Video Demo: https://www.youtube.com/watch?v=K-3A9VP5CRw

To fully develop Kasi in Phase II, the team will add chemistry content, optimize the calibration system to accommodate differing camera angles and lighting conditions, and finalize the digital interactive pedagogy, tactile pieces, and algorithms that generate audio feedback. After development concludes, researchers will conduct a pilot study to assess the feasibility and usability, fidelity of implementation, and promise of the product to support high school students who are blind or visual impaired in learning chemistry. The project team will collect data from a new group of 10 high school students who are blind or visually impaired to examine whether they can use the product independently and their chemistry content knowledge is improved. Chemistry knowledge will be measured by items from the American Chemical Society (ACS) High School exam and state assessments. Researchers will also conduct a cost analysis using the CostOut tool to determine the cost per student needed to implement and use Kasi.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Science

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
First Look / ED TAB

TIMSS 2023 U.S. Highlights Web Report

Author(s): Catharine Warner-Griffin, Grace Handley, Benjamin Dalton, Debbie Herget
Publication number: NCES 2024184
Read More
Zoomed in IES logo
Grant

Center for Advancing Elementary Science through As...

Award number: R305C240014
Read More
Zoomed in IES logo
Grant

National Center on Generative AI for Uplifting STE...

Award number: R305C240010
Read More
icon-dot-govicon-https icon-quote