Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios The Item Respon ...
Home arrow_forward_ios ... arrow_forward_ios The Item Respon ...
Information on ...
Grant Open

The Item Response Warehouse: Empowering Data-Driven Psychometrics Research

NCER
Program: Statistical and Research Methodology in Education
Program topic(s): Core
Award amount: $900,000
Principal investigator: Benjamin Domingue
Awardee:
Stanford University
Year: 2024
Award period: 3 years (09/01/2024 - 08/31/2027)
Project type:
Methodological Innovation
Award number: R305D240025

Purpose

The techniques of educational measurement and psychometrics are critical for a range of problems in education, both in research and applied settings. Conventional psychometrics research has used relatively scant data resources. The project team argues that research related to innovation in psychometric methods and to development of techniques for solving current problems in educational measurement could be improved if this was changed. The project team thus aims to furnish a large warehouse of datasets, the Item Response Warehouse (IRW), that can be used in future psychometrics research.

Project Activities

This project has three core aims. First, the project team will collect and harmonize a large volume of psychometrics data resources with an emphasis on data that speak to pressing problems in educational measurement such as item response data collected longitudinally, and data collected in experimental settings.  Second, the project team will build and test a website to share the data. The website will make it easy for a user to identify and download large quantities of data that allow for subsequent research in educational measurement. Third, the project team will conduct a variety of activities to publicize this resource.

User Testing: The project team will conduct user testing as a part of the construction of the IRW. In a design stage, the project team will conduct interviews to assess the needs of targeted users; the IRW will then be designed with these requirements in mind. User testing will then be conducted to assess how well early versions of the IRW meet user needs; the project team will subsequently iterate based on this early feedback.

Use in Applied Education Research: Future education research will be able to take advantage of the rich data resources of the IRW. This will help to foster development of a more data-rich psychometrics. For example, methodological papers will be able to rapidly demonstrate the performance of a given method in a much broader range of datasets. The IRW will also extend the capacity to do cutting-edge psychometrics research to a broader research community by allowing interested researchers easy access to substantial quantities of harmonized data, something that has been heretofore unavailable.

People and institutions involved

IES program contact(s)

Elizabeth Albro

Elizabeth Albro

Commissioner of Education Research
NCER

Project contributors

Michael Frank

Co-principal investigator

Products and publications

The project will lead to the construction of a repository of harmonized item response datasets, the Item Response Warehouse (IRW). This repository will contain data of pressing interest to contemporary problems in psychometrics and education research and will be publicly available via a website that offers both the opportunity for users to identify data of interest and the capacity to then download such data. Alongside the back-end database and the front-end website, this project will also allow for completion of relevant APIs and associated documentation to ensure that data from the IRW can be readily used in standard psychometric software packages. The project team will also disseminate information about this project via various webinars and begin to write research papers demonstrating how large volumes of data can be used to improve methodological research in educational measurement. The project team will endeavor to ensure that the members of relevant professional organizations are aware of the IRW via trainings and presentation at annual meetings. Finally, the project team will host a paper competition meant to spur use of the IRW's data resources.

Project website:

Item Response Warehouse

Publications:

ERIC Citations: Find available citations in ERIC for this award here.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Data and Assessments

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Summer Research Training Institute on Cluster-Rand...

July 06, 2026
Read More
Zoomed in IES logo
Tool/Toolkit

Resource to Support Selecting Effective Reading In...

Author(s): Megan Bogia, Kyla Brown, John Westall, Supriya Tamang, Allan Porowski
Read More
Rectangle Blue 1 Pattern 1
Thought leadership

What's on the Horizon for the 2026 Nation's Report...

January 21, 2026 by Matthew Soldner
Read More
icon-dot-govicon-https icon-quote