Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Integrated Software for Artificial ...
Home arrow_forward_ios ... arrow_forward_ios Integrated Software for Artificial ...
Information on IES-Funded Research
Grant Closed

Integrated Software for Artificial Intelligence Tutoring and Assessment in Science

NCER
Program: Education Research Grants
Program topic(s): Science, Technology, Engineering, and Mathematics (STEM) Education
Award amount: $1,500,000
Principal investigator: Benny Johnson
Awardee:
Quantum Simulations, Inc.
Year: 2004
Project type:
Development and Innovation
Award number: R305K040008

Purpose

In the early 2000s, the capacity of computer-assisted instruction in science to strengthen student learning was quite limited. In this project, the researchers planned to complete the development of a computer-based tutoring and assessment system for a first-year high school chemistry course. Additionally, they hoped to accumulate evidence of the potential of the system to improve student learning and achievement. The proposed system would be for use by individual students on demand at school or at home.

Structured Abstract

Intervention
The system is being designed to provide helpful detailed comments to students if they make mistakes while trying to solve chemistry problems and to generate reports for teachers and students that analyze student learning as reflected by their performance on a given set of chemistry problems.

Research design and methods

The researchers are first developing the procedures for grading student work in an intelligent tutoring system that they have already created. Actual student work samples will be used to test and validate the system's procedures and to conduct an initial external review of the system with a small group of high school chemistry teachers. When the system is fully developed, it will be field tested with chemistry teachers in several high schools. In this quasi-experimental study, 10 to 12 teachers will implement the tutoring system with the assessment component in one chemistry class. In a second class, each teacher will continue normal instruction, not using any functions of the tutoring system. With a third class, each teacher will use the assessment system, but not the tutorial, and with a fourth class, each teacher will use only the tutoring program. Using a pre-post design, student achievement will be compared across the four groups. Because it is not possible to have a randomly selected group in this test, statistical analyses will be used to determine preexisting similarities and differences between the groups. The end result of this project will be a fully developed intelligent tutor and assessment system for high school chemistry with evidence of the potential of this system to improve high school students' chemistry achievement.

People and institutions involved

IES program contact(s)

Christina Chhin

Education Research Analyst
NCER

Products and publications

ERIC Citations: Find available citations in ERIC for this award here.

Select Publications:

Journal articles

Johnson, B.G., and Holder, D.A. (2010). A Model-Tracing Intelligent Tutoring System for Oxidation Number Assignment. The Chemical Educator, 15: 447-454.

Kuhel, J.J., Wheeler, M.C., Miele, P.E., Holder, D.A., Johnson, B.G., Paterno Parsi, A.A., and Madura, J.D. (2010). Quantitative Impact of an Artificial Intelligence Tutoring System on Student Performance in Assigning Oxidation Numbers in Chemical Formulas. The Chemical Educator, 15: 455-460.

Related projects

Integrated Software for Artificial Intelligence Tutoring and Assessment in Science

R305A070067

A Randomized Controlled Study of the Effects of Intelligent Online Chemistry Tutors in Urban California School Districts

R305A080063

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Data and AssessmentsPolicies and StandardsScienceCognitionEducation Technology

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Data Science Methods for Digital Learning Platform...

August 18, 2025
Read More
Zoomed in IES logo
Workshop/Training

Meta-Analysis Training Institute (MATI)

July 28, 2025
Read More
Zoomed in Yellow IES Logo
Workshop/Training

Bayesian Longitudinal Data Modeling in Education S...

July 21, 2025
Read More
icon-dot-govicon-https icon-quote