Skip to main content

Breadcrumb

Home arrow_forward_ios Information on ... arrow_forward_ios National Resear ...
Home arrow_forward_ios ... arrow_forward_ios National Resear ...
Information on ...
Grant Closed

National Research & Development Center on Instructional Technology: Center for Advanced Technology in Schools

NCER
Program: Education Research and Development Centers
Program topic(s): Improving Low Achieving Schools , Innovation in Education Reform
Award amount: $9,833,451
Principal investigator: Eva Baker
Awardee:
University of California, Los Angeles
Year: 2008
Award period: 5 years (07/01/2008 - 06/30/2013)
Project type:
Other
Award number: R305C080015

Purpose

The purpose of the National Center for Advanced Technology in Schools (NCATS) was to create materials that were to lead to improved learning of critically important math concepts such as pre-algebra and algebra, commonly referred to as "gateway" concepts, because they are necessary for successfully performing higher-level math. The team leveraged advances in instructional technology (e.g., "serious games") in order to challenge and motivate 9th grade students, particularly underperforming ones, to participate and succeed in math competence. 

Established through a five-year, $9.8 million grant from the Institute of Education Sciences (IES) of the U.S. Department of Education, the NCATS was staffed by nationally-recognized experts in cognitive psychology, education, instruction, assessment, and advanced technologies.

Project Activities

Focused program of research

The initial intervention to be developed was a 2-dimentional (2D) game so researchers can better understand how variables such as reasoning, practice, and feedback affect outcomes. A commercial game design partner, Tabula Digita, then created a 3-dimensional (3D) game based on the 2D efficacy findings. To succeed in the game, students used math skills to maneuver through various levels, whose difficulty varied online via an embedded self-assessment component.

In addition to designing "serious games" for student use, the Center team also examined the teachers' views of the games and their content strengths and gaps, and then provided the teachers with professional development and other supports to increase their knowledge and receptivity to games, which will be studied experimentally. The Center team conducted an in-depth investigation of students' interests, knowledge, and expectations through focus groups, cognitive task analyses, and other qualitative protocols and tests of their background knowledge. The Center team also produced guidelines for researchers and practitioners at key points in the program of research, culminating in a set of comprehensive guidelines.

Structured Abstract

Research design and methods

The efficacy study included 45 classrooms from 15 schools, whereby classrooms were randomly assigned to one of three groups: (1) students used the game in the classroom; (2) students used the game in the classroom and practice homework using the game at home; and (3) students received the standard curriculum (control group). A variety of standardized measures assessed the impact of the intervention on students' math learning. Supplemental measures assessed students' self-concept and teachers' attitudes. Hierarchical linear models were employed to examine the effect of the intervention on students' achievement.

People and institutions involved

IES program contact(s)

Erin Higgins

Project contributors

James Stigler

Key Personnel

Gregory Chung

Key Personnel
University of California, Los Angeles

Keith Holyoak

Key Personnel

Robert Bjork

Key Personnel

Dennis Cheek

Key Personnel

Eva Baker

Key Personnel

Richard Wainess

Key Personnel

Noelle Griffin

Key Personnel

Harry O'Neil

Key Personnel

Tracy Fullerton

Key Personnel

Merrilea Mayo

Key Personnel

Robert Mislevy

Key Personnel

Ronald Dietel

Key Personnel

Ntiedo Etuk

Key Personnel

Alan Koenig

Key Personnel

Taehoon Kang

Key Personnel

Products and publications

ERIC Citations: Find available citations in ERIC for this award here.

Book chapter

Baker, E.L. (2014). Learning and Assessment: Twenty-First Century Skills and Cognitive Readiness. In H.F. O'Neil, and R.S. Perez (Eds.), Teaching and Measuring Cognitive Readiness(pp. 53-70). New York: Springer.

Chung, G.K., and Delacruz, G.C. (2014). Cognitive Readiness for Solving Equations. In H.F. O'Neil, and R.S. Perez (Eds.), Teaching and Measuring Cognitive Readiness(pp. 135-148). New York: Springer.

Holyoak, K.J. (2012). Analogy and Relational Reasoning. The Oxford Handbook of Thinking and Reasoning (pp. 234-259). New York: Oxford Press.

Mislevy, R.J., Behrens, J.T., Dicerbo, K.E., Frezzo, D.C., and West, P. (2012). Three Things Game Designers Need to Know About Assessment. Assessment in Game-Based Learning (pp. 59-81). New York: Springer.

Stripling, R., and Chang, G. (2013). Brain Activity Based Assessment (BABA). Foundations of Augmented Cognition, Volume 8027 (pp. 390-398). Berlin Heidelberg: Springer.

Journal article, monograph, or newsletter

Kerr, D., and Chung, G.K. (2012). Identifying Key Features of Student Performance in Educational Video Games and Simulations Through Cluster Analysis. Journal of Educational Data Mining, 4(1): 144-182.

Mislevy, R., Behrens, J.T., Dicerbo, K.E., and Levy, R. (2012). Design and Discovery in Educational Assessment: Evidence-Centred Design, Psychometrics, and Educational Data Mining. Journal of Educational Data Mining, 4(1): 11-48.

O'Neil, H.F., Chung, G.K., Kerr, D., Vendlinski, T.P., Buschang, R. E., and Mayer, R.E. (2014). Adding Self-Explanation Prompts to an Educational Computer Game. Computers in Human Behavior, 30: 23-28. doi:10.1016/j.chb.2013.07.025

Richland, L.E., Stigler, J.W., and Holyoak, K.J. (2012). Teaching the Conceptual Structure of Mathematics. Educational Psychologist, 47(3): 189-203.

Rupp, A.A., Levy, R., DiCerbo, K., Sweet, S., Crawford, A.V., Calico, T., Benson, Martin; Fay, D., Kunze, K.L., Mislevy, R.J., and Behrens, J.T. (2012). Putting ECD Into Practice: The Interplay of Theory and Data in Evidence Models Within a Digital Learning Environment. Journal of Educational Data Mining, 4(1): 49-110.

Proceeding

Kerr, D., and Chung, G.K. (2013). Identifying Learning Trajectories in an Educational Video Game. In Proceedings of the 2013 Uncertainty in Artificial Intelligence Application Workshops, Volume 1024 (pp. 20-28). Seattle, WA: UAI.

Lee, H.S., Thompson, B.J., Holyoak, K.J., and Stigler, J.W. (2010). Learning Inter-Related Concepts in Mathematics From Videogames. In Proceedings of the 9th International Conference of the Learning Sciences, Volume 2 (pp. 445-446). online: International Society of the Learning Sciences.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

CognitionEducation TechnologyMathematicsPolicies and StandardsTeaching

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Innovation Science for Education Analytics (ISEA)

January 01, 2026
Read More
Zoomed in IES logo
Fact Sheet/Infographic/FAQ

Implementing Stay Interviews as a Teacher Retentio...

Author(s): U.S. Department of Education
Read More
Rectangle Blue 1 Pattern 1
Blog

Helping Educators Address Chronic Absence Through ...

October 27, 2025 by Rebecca Lindgren
Read More
icon-dot-govicon-https icon-quote