Grant Closed

Psychometric Models for In-Classroom Observational Measures of Teaching with Applications to Value-Added Modeling

NCER

Program: Statistical and Research Methodology in Education

Program topic(s): Early Career

Award amount: $199,918

Principal investigator: Peter Halpin

Awardee:

New York University

Year: 2014

Award period: 1 year 6 months (09/01/2014 - 02/29/2016)

Project type:

Methodological Innovation

Award number: R305D140035

Purpose

Value-added modeling is an approach to teacher evaluation that yields information about teacher performance as a function of student scores on standardized tests. While value-added modeling is based on student outcomes, this technique does not allow evaluators to focus on what teachers are doing or should be doing in their classrooms to influence those outcomes. Observational instruments offer the possibility of identifying in-classroom practices that are associated with student achievement. Recent research has found, however, that many of the instruments commonly used for in-classroom observation have poor reliability, and consequently they have also demonstrated poor validity against teachers’ value-added estimates. The latter problem is aggravated by the fact that the value-added estimates also contain a substantial degree of sampling error. In this study, researchers applied latent class analysis to improve how the in-classroom observational instruments are scored and how they are incorporated into the value-added framework.

Project Activities

First, researchers applied psychometric methods to attempt to improve the reliability and validity of in-classroom observational measures of teaching, using academic and non-academic outcomes to gauge and to compare concurrent and predictive validity of the resulting models. Secondly, researchers determined whether the improvements yield advances in current research on teaching effectiveness, especially value-added modeling, by incorporating latent class assignment into prediction equations of teacher performance. Researchers used data from two frequently used teacher and classroom observation instruments, Danielson’s Framework for Teachers and the Classroom Assessment Scoring SystemTM (CLASSTM), in the development and testing of psychometric approaches that incorporate latent class analysis into value-added modeling.