Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Testing the Effectiveness of CALM f ...
Home arrow_forward_ios ... arrow_forward_ios Testing the Effectiveness of CALM f ...
Information on IES-Funded Research
Grant Closed

Testing the Effectiveness of CALM for High School Chemistry Students

NCER
Program: Education Research Grants
Program topic(s): Science, Technology, Engineering, and Mathematics (STEM) Education
Award amount: $2,019,816
Principal investigator: Jonathan Plucker
Awardee:
Indiana University
Year: 2009
Award period: 2 years (02/29/2012 - 02/28/2014)
Project type:
Efficacy
Award number: R305A090195

Purpose

To address the poor science achievement of high school students and to help reduce the achievement gap, high school science teachers need interventions that improve student learning in science. Unfortunately, there are few science interventions currently available to high school science teachers that have rigorous, scientifically based evidence of their impact on student's science achievement. Therefore, this study seeks to assess the efficacy of the Computer Assisted Learning Method (CALM), a fully developed chemistry program widely used in the state of Indiana.

Project Activities

Teachers will be randomly assigned to implement CALM in their chemistry classes or to a business-as-usual condition. The researchers will compare the academic achievement of students in high school chemistry classrooms that used CALM to those classrooms that did not use CALM.

Structured Abstract

Setting

The settings for this study are urban, suburban, and rural school districts in Midwestern states.

Sample

The study sample will consist of 210 high school chemistry teachers and their students.

Intervention

The Computer Assisted Learning Method (CALM) intervention consists of two primary components: (1) the CALM online learning tool; and (2) the CALM teacher professional development workshop. The CALM online learning tool allows students to practice solving chemistry problems on topics such as balancing chemical reactions, kinetics, equilibrium, or thermodynamics. Unlike most other web-based chemistry tools, CALM uses a Socratic pedagogy to provide adaptive or directed learning for both struggling and advanced students. The CALM online learning tool also provides immediate performance feedback to students and teachers. Teachers receive a two-day professional development workshop to learn about the underlying philosophy of CALM as well as the mechanics of its use. Teacher then create their own CALM course based on their class syllabi. Teachers can assign the CALM courses as homework activities for students or integrate them into their classroom instruction.

Research design and methods

This study uses a cluster randomized control trial design with teachers as the unit of random assignment. Prior to randomization, teachers will be matched into pairs based on their years of experience and an index indicating size and resources of their chemistry departments. After teachers are matched on these characteristics, one teacher from each pair will be randomly assigned to the CALM intervention condition or the control condition. A cohort of 70 teachers (35 treatment and 35 control) will be recruited during each of the three years of the study, for a total of 210 teachers across the three years of implementation.

Control condition

Chemistry teachers in the control condition will teach their Introductory Chemistry students using the standard curriculum in place at the school without the Computer Assisted Learning Method.

Key measures

Students' mathematics scores on state standardized tests will be used to measure students' pre-existing levels of achievement. The American Chemical Society high school chemistry exam will serve as the primary outcome measure of student achievement.

Data analytic strategy

The primary analysis will be a two-level, random intercepts hierarchical linear model to account for the nested nature of the data. Both student and classroom/teacher variables will be entered.

People and institutions involved

IES program contact(s)

Elizabeth Albro

Elizabeth Albro

Commissioner of Education Research
NCER

Project contributors

Romualdo de Souza

Co-principal investigator

Products and publications

Products: The products of this project will be evidence of the efficacy of the Computer Assisted Learning Method program for high school chemistry and published reports.

ERIC Citations: Find available citations in ERIC for this award here.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

CognitionEducation TechnologyPolicies and StandardsScienceTeaching

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Data Science Methods for Digital Learning Platform...

August 18, 2025
Read More
Zoomed in IES logo
Evaluation Report

2024 National Board for Education Sciences Annual ...

Author(s): Carol D. Lee, Matthew Soldner
Publication number: NBES 2025-001
Read More
Zoomed in IES logo
News

REL Central provides evidence about the mentoring ...

June 24, 2025 by
Read More
icon-dot-govicon-https icon-quote