An Agenda for NAEP Validity Research

Title:	An Agenda for NAEP Validity Research
Description:	This report resulted from the systematic analysis undertaken by the NAEP Validity Studies Panel to consider the domain of validity threats to NAEP and to identify the most urgent validity research priorities. A framework of 6 broad categories was devised: 1) the constructs measured within each of NAEP’s subject domains; 2) the manner in which these constructs are measure; 3) the representation of the population; 4) the analysis of data; 5) the reporting and use of NAEP results; and 6) the assessment of trends. Panel subcommittees prepared papers laying out the critical validity issues in each area, and these papers are presented in chapters 2 through 7 of this report. The panel reviewed papers in each area and set priorities of each area of validity research by a consensus process. Sixteen suggested studies or areas of study were rated by the full panel. Four studies stood out as essential and 2 others were rated between highly important and essential. The panel indicated unanimously that studies are “Essential” to evaluate the validity aspects of NAEP’s new role under the No Child Left Behind legislation, however that role is operationalized.
Online Availability:	Download, view and print the report as a pdf file. (598KB) Need Help Viewing PDF files?
Cover Date:	April 2003
Web Release:	May 19, 2003
Print Release:	This Publication will only be available online.
Publication #:	NCES 200307 General Ordering Information
Center/Program:	NCES
Authors:	Frances B. Stancavage, American Institutes for Research; et al.
Type of Product:	Working Paper
	Working Papers provide preliminary analysis of substantive, technical, and methodological issues. They are works in progress that are presented to promote the sharing of valuable work experience and knowledge. These papers have not undergone a rigorous review for consistency with NCES standards.
Survey/Program Areas:	National Assessment of Educational Progress (NAEP)
Questions:	For questions about the content of this Working Paper, please contact: NCES WebMaster.