Project Activities
This project will tie together the laboratory-based research on retrieval practice with research on essay writing in education to explore the malleable factors that determine when essay testing will provide significant learning benefits. First, in a laboratory setting, the research team will compare the benefits of essay writing to those observed following standard practice, including both standard study activities (e.g., note-taking) and standard tests (e.g., short answer). Next, in a laboratory setting, the research team will identify the key parameters that will optimize the benefits of essay testing for memory and learning. Finally, the research team will conduct a classroom study, using the practices that promoted the most learning in the laboratory studies, to provide important data about feasibility that will be useful for the future development of an intervention.
Structured Abstract
Setting
Research will be conducted in laboratories at Duke University as well as in classrooms in urban and suburban schools in North Carolina.
Sample
Approximately 240 Duke University undergraduates (aged 18-24 years), 410 Washington University in St. Louis undergraduates (aged 18-24 years), and 300 high school juniors and seniors will participate in the laboratory studies. Approximately 150 high school juniors and seniors will participate in the classroom study. All high school students will be from urban and suburban counties in North Carolina.
The goal of this grant is to understand which aspects of essay writing instructional tasks yield the most benefits for learning outcomes. The components that will be addressed are whether essay testing should be open or closed book, the contribution of essay-writing training, the effect of different essay-writing instructions, and the effect of different types of feedback. The findings from this grant can be used to inform the development of an essay-writing intervention.
Research design and methods
The researchers' plan includes a total of six laboratory studies and one classroom study, organized into three steps. For all experiments, students will study textbook excerpts in different ways depending on the experiment and condition and then will be tested on their memory for the text later. In the first step of the research plan, the research team will use laboratory experiments to explore the claim that essays promote long-term retention and transfer relative to typical study activities and test-for-learning formats. In the second step, the team will use laboratory studies to identify the particular malleable factors that yield the most benefits for essay writing by manipulating particular components of essay writing. In the third step, the team will conduct the classroom study, where the most powerful essay activity (as identified in the laboratory studies) will be compared to standard practice in a high school classroom setting. Of the experiments proposed, some will use a between-subjects design, where participants are randomly assigned to only one condition, and others will use a within-subjects design, where each participant experiences each condition in the experiment.
Control condition
For the laboratory studies, the control or comparison condition being used will vary depending on what is being tested. In some experiments, the control conditions are typical study habits (e.g. note-taking) or other testing techniques (e.g. short answer questions). In other experiments, there is no standard control condition, but rather a comparison condition such as a different variation of essay writing (e.g. open-book versus closed-book). For the classroom study, the control condition will be business as usual.
Key measures
The key measures that will be used to assess performance are memory tests designed by the researchers. The tests will be free recall, multiple choice, and problem solving and will be designed to assess students' memory for the texts that they had studied earlier. In addition to these measures, the research team plans to collect individual differences data such as performance on the multi-media comprehension battery (MCCB), to assess individual differences in structure building, as well as (when available) American College Testing (ACT) and Scholastic Aptitude Test (SAT) Writing Section scores, to assess individual differences in writing ability.
Data analytic strategy
The researchers plan to use a General Linear Model (GLM) approach, including ANOVA and regression models. The research team plans to include contrasts for learning condition, school level, individual difference variables, and interactions between these variables.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
The products of this project will be preliminary evidence of potentially promising essay-writing and essay-testing strategies and peer reviewed publications.
Publications:
Journal article, monograph, or newsletter
Arnold, K.M., Daniel, D.B., Jensen, J., McDaniel, M., and Marsh, E.J. (2016). Structure Building Predicts Grades in College Psychology and Biology. Applied Cognitive Psychology, 30(3): 454-459.
Arnold, K. M., Eliseev, E. D., Stone, A. R., McDaniel, M. A., & Marsh, E. J. (2021). Two routes to the same place: Learning from quick closed-book essays versus open-book essays. Journal of Cognitive Psychology, 33(3), 229-246.
Arnold, K. M., Umanath, S., Thio, K., Reilly, W. B., McDaniel, M. A., & Marsh, E. J. (2017). Understanding the cognitive processes involved in writing to learn. Journal of Experimental Psychology: Applied, 23(2), 115.
McDaniel, M. A., Bugg, J. M., Liu, Y., & Brick, J. (2015). When does the test-study-test sequence optimize learning and retention?. Journal of Experimental Psychology: Applied, 21(4), 370.
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
