Project Activities
Implemented across the 7th and 8th grades in four diverse Utah school districts, this project consists of three major components of research activity. First, the researchers will implement a cognitive lab study to gauge the cognitive strategies invoked by CT assessment items. Second, the team will collect individual testing data on CT, spatial and fluid reasoning, working memory span, executive function, algebraic aptitude, and scientific reasoning. Third, the researchers will collect data from middle school classrooms that are intentionally integrating CT into the curriculum to assess opportunity-to-learn and malleability related to CT during classroom instruction. Data analyses will likewise occur in several phases.
Structured Abstract
Setting
The project will take place in four school districts in Utah that reflect a range of contexts from urban to rural. All districts have a substantial percentage of students who qualify for free- and reduced-lunch (23%-59%), notable levels of English Language Learners (4%-33%), and racial/ethnic diversity reflecting students of multiple backgrounds, including high proportions of Latinx and Native Americans (17%-62%).
Sample
The sample will consist of primarily of 7th and 8th grade students. The ethnicity of these students will reflect the school populations of each location.
The team will assess a range of factors in relation to students' CT abilities and gains including individual characteristics (i.e., spatial and fluid reasoning, working memory span, executive function, algebraic aptitude, scientific reasoning) and features of instruction (i.e., opportunity to learn).
Research design and methods
Researchers will collect data via 1) a cognitive lab study to gauge the cognitive strategies invoked by CT assessment items; 2) a descriptive study gathering individual testing data on CT to assess relevant cognitive factors; and 3) an observational study of middle school classrooms that integrate CT into the curriculum to assess opportunities to learn and malleability related to classroom instruction.
Control condition
Due to the study design, there is no control condition.
Key measures
The research team will examine computational thinking using the Computational Thinking test and items from the Bebras International Challenge on Informatics and Computational Thinking. Two components of executive function, cognitive flexibility and inhibitory control will be assessed using the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB)—Dimensional Change Card Sort and the Flanker Inhibitory Control and Attention. Working memory capacity will be assessed using the List Sorting Working Memory Test (LSWMT) of the NIHTB-CB. Spatial ability will be assessed using the Spatial Reasoning Instrument. Two measures of NIHTB-CB, the Oral Reading Recognition Test (ORR) and the Picture Vocabulary Test (PV), will be used to assess participants' language ability. Two tasks will be used to assess fluid ability, the Maze task and the BackSpan. Two measures will be used to assess scientific reasoning, the Lawson's Test for Scientific Reasoning and the Scientific Reasoning Scale. Algebraic reasoning will be measured with the Iowa Algebra Aptitude Test and the Pre-Algebraic Number Skills and Concepts (PANSC) and Representing Relationships (RR).
Data analytic strategy
First, researchers will analyze all individual testing and situated CT proficiency data at the instrument level within a multitrait-multimethod (MTMM) framework to identify and eliminate sources of overlapping or measurement error variance that could hinder subsequent analyses. Second, the team will analyze all CT test data at the item level using multidimensional item response theory (MIRT) and diagnostic classification modeling (DCM) to evaluate the extent to which potential facets underlying CT item performance operate independently or in conjunction to influence the probability of correct responses. Third, they will assess students' responsiveness to instruction through analysis of pre-post gains on CT assessments, based on the premise that increased OTL will lead to greater performance gains.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
The research team will use findings to develop pedagogical strategies and tasks that can target malleable CT facets across the curriculum and inform the development of assessments that are designed to measure malleable facets of CT independent of the courses in which they are targeted. The researchers will also produce peer-reviewed publications and a final publicly accessible dataset.
Supplemental information
Co-Principal Investigators: Tofel-Grehl, Colby; Grover, Shuchi; Chung, Gregory; Cai, Li
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
