Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios AI-Driven Formative Assessments for ...
Home arrow_forward_ios ... arrow_forward_ios AI-Driven Formative Assessments for ...
Information on IES-Funded Research
Contract Closed

AI-Driven Formative Assessments for Hands-on Science

NCER
Program: Small Business Innovation Research
Award amount: $900,000
Project director: Clifton Roozeboom
Awardee:
Myriad Sensors, Inc.
Year: 2021
Project type:
Phase II Development
Contract number: 91990021C0035

Purpose

In this project, the team fully developed and tested TaylorAI, an artificial intelligence (AI) formative feedback and assessment system for hands-on science investigations. Research demonstrates that STEM interventions that provide formative results back to students can build competence as they engage in laboratory activities. However, educators and students often have difficulty measuring and applying data from inquiry activities to further ideas, skills, and knowledge of STEM.

Project Activities

During Phase I in 2020 the team developed a prototype of TaylorAI, including an AI algorithm and training data set, and a physical science activity for generating, analyzing, and interpreting graphs of motion to investigate relationships between variables, slope, and velocity. Researchers conducted a pilot study with six middle school science teachers and 120 students to assess the usability, feasibility, and promise of the prototype to offer feedback on the experiments to support student learning. Results demonstrated that the prototype AI mechanism generated results that students and educators were able to view, and student self-reported that the prototype increased their ability to correctly analyze graphs generated from their own experiments. Teachers reported that students were engaged by and used the formative results generated by the prototype.

People and institutions involved

IES program contact(s)

Edward Metz

IES Research Scientist
NCER

Products and publications

Product: TaylorAI is an AI-formative feedback and assessment system for hands-on laboratory science activities that provides information and scaffolded hints to students as they collect and analyze experimental data. TaylorAI will operates in the background of an existing cloud-based software platform, called PocketLab, which includes a small wireless device that transmits scientific data using Bluetooth, and a user-interface notebook for students to keep track of their work. TaylorAI will employs an AI algorithm that analyzes real-world experimental data that students collect using PocketLab. TaylorAI can be used by students in and out of classrooms to provide feedback and assist in the assessment of key science and engineering practices from the Next Generation Science Standards.

Project website: www.thepocketlab.com

Additional Resources: See a video demonstration of the Phase I prototype here: https://youtu.be/8RoAqYWtauA

Project website:

https://www.thepocketlab.com

Supplemental information

During Phase II, the team developed a prototype of TaylorAI to provide automated formative feedback to students for eight physical science activities covering middle school physical science NGSS performance expectations. Researchers conducted a study with 19 middle school science classrooms to assess the formative assessment features. Researchers developed a 19-question assessment that was administered both before and after their exposure to PocketLab TaylorAI. The content of the assessment comprised selected items adapted from standardized assessment released items and was specifically aligned with the NGSS waves, energy, and gravity content covered in the TaylorAI science investigations. Qualitative feedback from teachers and students showed promise for how active science investigations can increase student motivation. Teacher and student feedback and classroom observation data will be incorporated into the refinement of the overall platform and the specific TaylorAI features. Quantitative results were inconclusive due to the short study duration and the breadth of science content involved. The quasi-experimental impact analysis had limitations due to the small sample size.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Science

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
First Look / ED TAB

TIMSS 2023 U.S. Highlights Web Report

Author(s): Catharine Warner-Griffin, Grace Handley, Benjamin Dalton, Debbie Herget
Publication number: NCES 2024184
Read More
Zoomed in IES logo
Grant

Center for Advancing Elementary Science through As...

Award number: R305C240014
Read More
Zoomed in IES logo
Grant

National Center on Generative AI for Uplifting STE...

Award number: R305C240010
Read More
icon-dot-govicon-https icon-quote