Agents of Influence

During Phase I in 2023, the team developed a novel prototype of Agents of Influence, including a student interface presenting game-based modules to identify disinformation and misinformation. At the end of Phase I, a pilot test with 98 middle school students demonstrated usability as the prototype game functioned and feasibility as the digital and in-class activities were integrated into classroom practice. Results from a pre- to post-test demonstrated that on average students increased in their digital media skills for using fact checks, for identifying the markers of accurate information, and for detection of headline and website accuracy.

In Phase II of the project, the team will fully develop the product, including: addressing technology issues by improving loading times and making the game compatible across devices; adding episodes to the content library on topics including artificial intelligence, algorithms, privacy, scams, cyberbullying, and the digital self; creating a field guide for educators with searchable content including curricula and toolkits for delivering the game in classes; and adding accessibility features such as voice-over, color, and keyboards. After development concludes, the project team will complete a pilot study  to assess the feasibility and usability, fidelity of implementation, and the promise of the product for improving student's ability to identify misinformation and disinformation. The team will collect data from 40 middle school classes with 20 students per class for a total of approximately 800 students. Half of the classes will be randomly assigned to use the product and the other half to use business-as-usual activities. Researchers will compare pre-and-post scores using the Misinformation Susceptibility Test, the Civics Online Reasoning Assessment, the Digital Literacy Self-Efficacy Scale, and the Digital Communication Empathy Scale. Researchers will gather cost information using the "ingredients method" and will include all expenditures on things such as personnel, facilities, equipment, materials, and training.