Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Exploring and Assessing the Develop ...
Home arrow_forward_ios ... arrow_forward_ios Exploring and Assessing the Develop ...
Information on IES-Funded Research
Grant Closed

Exploring and Assessing the Development of Students' Argumentation Skills

NCER
Program: Education Research Grants
Program topic(s): Literacy
Award amount: $1,399,578
Principal investigator: Yi Song
Awardee:
Educational Testing Service (ETS)
Year: 2019
Award period: 5 years (08/01/2019 - 07/31/2024)
Project type:
Exploration
Award number: R305A190242

Purpose

This project will identify the malleable factors that predict the development of middle-school students' argumentative writing skills by exploring the students' abilities to generate oral and written arguments. Understanding and writing arguments is an important but difficult skill to acquire. However, research suggests that well-structured interactions, such as guided critical discussions, can help middle-grade students develop these skills, but it is not clear which student and instructional factors are most predictive of strong oral and written argument skills. This study will identify these malleable factors to help refine a theory of change that can lead to the development of better interventions.

Project Activities

The researchers will conduct a series of lab-based and classroom-based studies to see how different approaches interact with students' oral and written arguments. They will use an online, collaborative environment to present students with different discussion formats and different approaches to bridging from oral to written arguments. Results from these studies will lead to an improved model of argumentation and instruction.

Structured Abstract

Setting

The research will take place in a large school district in Delaware.

Sample

Approximately 1000 sixth- to eighth-grade students from diverse schools will participate in the studies. The sample may include mainstreamed English learners or special needs students. The researchers will also collect data from about 40 to 45 middle school teachers.

Factors

By middle school, most students can identify different opinions and predict others' positions. However, they may struggle with choosing the most relevant evidence or explaining how it supports their position. By fostering critical discussions, teachers can help students practice these skills. Critical discussions are a particular form of argumentation that encourage students to use and explain their reasoning through guided conversations with same-side and opposing-side peers. In these conversations, students aim to resolve differences of opinion. This focus may help students develop more complex communication and reasoning skills that integrate social, conceptual, and discourse skills.

Research design and methods

In the first round of studies, the researchers will conduct a series of cognitive lab studies. These iterative studies will use technology-facilitated, small group critical discussions to identify logistical issues that may impact feasibility and practicality of the overall approach in more natural settings. The researchers will also use the results of these studies to identify the discourse features of students' oral and written arguments that are aligned with effective argumentative writing skills. In the second round of studies, they will explore how different critical discussion and discourse manipulations impact malleable factors of both oral and written argumentation skills. In the third and final round of studies, they will focus on whether different manipulations help students transition from quality discussions to improved written arguments. These studies will help identify how different sets of scaffolds support different students. In addition to gathering data from students, the researchers will collect information from teachers regarding the challenges and benefits of administering critical discussions and of other strategies that may help improve students' argumentative oral and written skills.

Control condition

The researchers will use various control and comparison groups when testing their manipulations depending on the study. For example, one group may get a goal manipulation, and another may get no manipulation (control) or a contrasting manipulation (such as focusing on wining the debate vs. resolving differences of opinions).

Key measures

Key measures include critical discussion transcripts, LP tasks, culminating essay from the critical discussion, and scenario-based assessments (including multiple-choice items, short responses, and essays).

Data analytic strategy

The researchers will use various analytic approaches including descriptive statistics of transcribed discussions and written documents and repeated measure, between factors Analysis of Variance models, to compare different manipulations.

People and institutions involved

IES program contact(s)

Vinita Chhabra

Project contributors

John Sabatini

Co-principal investigator

Ralph Ferretti

Co-principal investigator

Products and publications

The products include peer-reviewed publications, an improved theoretical model of the malleable factors that influence argumentative writing skills, and workshops and presentations for practitioner audiences.

Publications:

Song, Y., Ferretti, R. P., Sabatini, J., & Cui, W. (2024). Insights Into Critical Discussion: Designing a Computer‐Supported Collaborative Space for Middle Schoolers. ETS Research Report Series, 2024(1), 1-20.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

CognitionWriting

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Grant

CoGrader 2.0: Accelerating Student Writing Profici...

Award number: R305J250071
Read More
Zoomed in IES logo
Contract

TrueMark: Developing a Teacher-Controlled AI Writi...

Contract number: 91990025C0079
Read More
Zoomed in IES logo
Grant

Now I See It: Supporting Flexible Problem Solving ...

Award number: R305N230034
Read More
icon-dot-govicon-https icon-quote