This report describes results from the third and last field investigation in the NAEP Technology-Based Assessment Project, which explores the use of new technology in administering NAEP. (The first two focused on assessments of math and writing online.) In the TRE study, two extended scenarios within the domain of physical science were created for measuring students' ability to solve problems using technology. The TRE Search scenario required students to locate and synthesize information about scientific helium balloons from a simulated World Wide Web environment. The TRE Simulation scenario required students to conduct experiments of increasing complexity about relationships among buoyancy, mass and volume. These scenarios were delivered via school computers or on laptop computers taken into the schools. The sample was nationally representative, consisting of over 2,000 public school 8th grade students tested in 2003. Students were randomly assigned to the assessment scenarios. The TRE project was intended as an exploratory study of how NAEP can use technology to measure skills that cannot be easily measured by conventional paper-and-pencil means. TRE Search produced a total score and two subscores, scientific inquiry and computer skills. The TRE Simulation scenario produced a total score and three subscores: scientific exploration, scientific synthesis, and computer skills. The results indicate that the TRE scenarios functioned well as assessment devices.
Online Availability
