Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Evaluation of the Effectiveness of ...
Home arrow_forward_ios ... arrow_forward_ios Evaluation of the Effectiveness of ...
Evaluations
Contract Closed

Evaluation of the Effectiveness of Educational Technology Interventions

NCEE
Program: Elementary and Secondary Education Act
Award amount: $14,500,000
Awardee:
Mathematica, SRI International
Year: 2003
Duration: 5 years 5 months (09/01/2003 - 02/01/2009)
Project type:
Other
Contract number: ED-01-CO-0039/0007

Background

The Enhancing Education Through Technology program was authorized under Title II, Part D of the Elementary and Secondary Education Act, as amended by the No Child Left Behind Act and funded at $267.5 million in Fiscal Year 2008. The primary purpose of the program was to improve student achievement through the use of technology in elementary and secondary schools. Grants were awarded to states based on their proportionate share of Title I, Part A funds. This evaluation, mandated by Congress, focused on assessing the impacts of reading and math technology programs that were appropriate for funding under this program.

Project Activities

Research question

  • Did the use of educational technology improve student achievement in reading and/or mathematics?
  • Under what conditions and practices did the use of educational technology improve student achievement in reading and/or mathematics?

Structured Abstract

Design

Teachers who volunteered to participate in the study were randomly assigned to use a given educational technology product or to a business-as-usual control group. Sixteen educational technology products intended to improve student academic achievement in reading and/or mathematics were competitively selected for this study. These products targeted four combinations of subjects and grade levels: reading in 1st grade, reading in 4th grade, mathematics in 6th grade, and algebra in 9th grade. The products were implemented in schools during the 2004–05 school year. During the 2005–06 school year, the same teachers used 10 of the educational technology products with a second cohort of students. The impact of the educational technology products on reading or mathematics achievement was estimated through standard experimental methods in order to address the study's research questions.

Key findings

  • After one school year, there were no statistically significant impacts of the educational technology products on student achievement for each of the four groups: 1st grade reading, 4th grade reading, 6th grade mathematics, 9th grade algebra.
  • After two school years, the impacts for 1st and 4th grade reading products were no different from the impacts after one school year. For the 6th grade mathematics products, impacts worsened after the second year of implementation. For the 9th grade algebra products, impacts improved after the second year of implementation.
  • When examining the individual impacts of the 10 educational technology products that were implemented for two student cohorts, only one product (LeapTrack for 4th grade reading) had a statistically significant positive impact on student achievement.

People and institutions involved

IES program contact(s)

Thomas Wei

Associate Commissioner of Evaluation
Evaluation Division

Products and publications

The final report, titled Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts, was released in February 2009.

Other publications from this study are listed below.

  • Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort (March 2007)

A restricted-use file containing de-identified data is available for the purposes of replicating study findings and secondary analysis.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Education TechnologyMathematicsReading

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Data Science Methods for Digital Learning Platform...

August 18, 2025
Read More
Zoomed in IES logo
Workshop/Training

Data Science for Education (DS4EDU)

April 01, 2025
Read More
Zoomed in IES logo
Request for Applications

Education Research and Development Center Program ...

March 14, 2025
Read More
icon-dot-govicon-https icon-quote