Project Activities
The researchers will enhance a computer-based testing platform called NimbleTools. During the first two years, enhancements will be developed and revisions will be made to the NimbleTools platform based on alpha and beta testing. This will provide information on its usability. During the final project year, a pilot test will be completed to determine the extent to which use of the updated platform improves test performance for students who read Braille. The psychometric characteristics of the reading assessment for these students will also be investigated.
Structured Abstract
Setting
The development and testing of the platform will take place in a variety of settings, including schools for the blind and public schools.
Sample
This project focuses on students who are blind or have low vision and are in middle and high school. The students will be Braille readers and deemed by their teachers to be proficient users of assistive technology to access text.
Intervention
Due to the nature of the research design, there is no intervention.
Research design and methods
The researchers will enhance a computer-based testing platform called NimbleTools. During the first two years, enhancements will be developed and revisions will be made to the NimbleTools platform based on alpha and beta testing. This will provide information on its usability. During the final project year, a pilot test will be completed to determine the extent to which use of the updated platform improves test performance for students who read Braille. The psychometric characteristics of the reading assessment for these students will also be investigated. For the pilot test, students will be randomly assigned to one of four groups. The groups will vary by equated forms of a reading assessment and by the format of the assessment (i.e., paper or computer). The paper format will include hard copy Braille with a human reader and scribe (as needed), an approach consistent with most state assessments. The computer format will be administered using the complete NimbleTools platform.
Control condition
The paper format of the assessment will serve as a control condition in the pilot study.
Key measures
In addition to student performance on the assessments, data will be collected on student demographic information, instructional and assessment accommodations typically received by participating students, and teacher ratings of student performance.
Data analytic strategy
A repeated-measures analysis of variance will be used to compare test scores from the NimbleTools administration with those from the paper format. In addition, a series of correlational analyses will be used to examine the reliability and predictive validity of the reading measure using NimbleTools and the paper format.
People and institutions involved
IES program contact(s)
Products and publications
Products: The products include an updated NimbleTools platform, presentations, and published reports.
Nongovernment report, issue brief, or practice guide
Laitusis, C.C., Stone, E., Steinberg, J., and Cook, L.L. (2014). Designing Accessible Reading Assessments: Field Test Analyses Final Report, ETS Research Report RM-14-07.
Stone, E., Cook, L.L., and Laitusis, C.C. (2013). Evaluation of a Condition-Adaptive Test of Reading Comprehension for Students With Reading-Based Learning Disabilities, ETS Research Report RR-13-20. Princeton, NJ: Educational Testing Service. doi:10.1002/j.2333-8504.2013.tb02327.x
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
