Skip Navigation
Funding Opportunities | Search Funded Research Grants and Contracts

IES Grant

Title: Developing a 3D-based Virtual Learning Environment for Use in Schools to Enhance the Social Competence of Youth with Autism Spectrum Disorder
Center: NCSER Year: 2009
Principal Investigator: Laffey, James Awardee: University of Missouri, Columbia
Program: Social, Emotional, and Behavioral Competence      [Program Details]
Award Period: 7/1/2009 through 9/30/2012 Award Amount: $1,491,075
Type: Development and Innovation Award Number: R324A090197

Purpose: Children identified with high functioning autism or Asperger syndrome have deficits in social competence that can lead to problematic social behavior and social isolation. Lack of appropriate social skills interferes not only with their ability to succeed in school, but with successful transition to adulthood (e.g., employment). A promising social skills program, Social Competence Intervention based on a framework of Cognitive Behavioral Intervention: SCI-CBI, has shown promise for improving social behavior of youth with autism. This face-to-face program occurs in a limited number of clinic settings however, and access to this program is restricted for some students who do not live close to a clinic setting, cannot meet during the available clinic hours, or have problems securing transportation to such settings.

This project will adapt the SCI-CBI curriculum into a cost-effective school-based model, iSocial, that can be delivered via networked, 3D-based virtual learning environments (3D VLE). The goal is to develop and then test the feasibility and promise of using 3D VLE to make the SCI-CBI program available in schools to youth with autism who have no or limited access to high quality face-to-face programs.

Project Activities: The development of software code and visual representation to create a 3D VLE includes usability testing, usage testing and field tests to assure a product that accurately delivers the SCI-CBI curriculum. Data collected through focus groups of educators and through field tests with youth in their school settings will be used to inform the development process and to determine whether the intervention shows promise for improving the social competence of students.

Products: This project will result in a fully developed virtual form of the SCI-CBI intervention, called iSocial, and published reports, and presentations describing the promise of this program to improve social outcomes for students with high functioning autism or Asperger syndrome.

Structured Abstract

Setting: Public middle and junior high schools in Missouri.

Population: Students aged 11 to 14 with a diagnosis of autism spectrum disorder or Asperger syndrome, and an IQ of 75 or above. The software usability and usage studies will each include three youth, and the field test will include 15 youth. Sixteen school personnel will participate in focus groups.

Intervention: The intervention addresses deficits in three areas that comprise social competence: emotion recognition, theory of mind (i.e. the ability understand the thoughts, intentions, and feelings of others), and executive functioning. The ten-week curriculum addresses (a) recognizing facial expressions, (b) sharing ideas, (c) turn taking in conversations, (d) recognizing feelings and emotions of self and others, and (e) problem solving. In each unit, the lesson plan follows a consistent structure of (a) either introducing a new skill or reviewing a previously learned skill, (b) skill modeling, (c) verbal rehearsal of the skill, (d) opportunities to practice the skill, and (e) some type of closing activity or review. The new iSocial program provides a virtual and social experience through an internet-connected computer. In iSocial, students work online with a trained guide and other online students. A local educator-facilitator is nearby, but allows the student to work with minimal supervision. The role of the educator-facilitator is to manage the youth's local experience, from coordinating times to access the technology, orienting the youth to the software, troubleshooting technical or behavioral problems, and to helping extend the lessons learned in iSocial to the local school context.

Research Design and Methods: The development process will include one usability test, five usage tests, focus group sessions with school personnel, and two field tests. In the usability test, students will interact with prototype features of the technology. Usage tests for each unit will begin with keystroke testing, which ensures that space and objects look and act as they are supposed to and that all features have been tested. In the final stage of the usage tests, three youth and an online guide pilot the unit over a two-week period. Morae recording software (an automated data capture system) and eye tracking will monitor student behavior. The focus groups provide feedback on the feasibility of this program in school settings for students with autism. Finally, a pretest posttest design for the field tests will occur, first with five students, then with ten students.

Control Condition: N/A

Key Measures: Measures of student outcomes will include the Social Responsiveness Scales, the Behavior Rating Inventory of Executive Function, and researcher-developed curriculum-based measures that assess student knowledge and proficiency in the skills taught in the curriculum. Measures of intervention fidelity and social validity will also be collected.

Data Analytic Strategy: Data analysis in the usability phase includes examination of errors and compares actual performance with expected performance to determine if there are problems with the technology system. In the usage studies, feedback from students via "think aloud" data, observations of use, and interviews with program users are examined qualitatively to understand themes and perspectives on the usability of the program. Focus group transcripts are also analyzed qualitatively for emergent themes.

To analyze student outcomes, researchers will conduct mean-level comparisons of pre and post assessment scores (i.e., paired t-tests to partial out baseline scores when examining change in post intervention scores). Researchers will also examine the associations (using correlational techniques) between global assessments and students' CBM scores, and will fit a regression line to students' CBM scores to explore students' progression in learning. Various measures of student activity drawn from Morae logs will also be correlated with levels of achievement to identify key components of the program that appear to be related to positive student outcomes (e.g., the most active students were not the one who gained the most on social skills, but particular types of activities may indicate how students are gaining from the virtual experience).

Related IES Projects: Developing a School-based Social Competence Intervention (SCI) (R324A090060)


Book chapter

Laffey, J., Stichter, J., and Schmidt, M. (2010). Social Orthotics for Youth with ASD to Learn in a Collaborative 3D VLE. In S. Seok, B. Dacosta, and E.L.Meyen (Eds.), Handbook of Research on Human Cognition and Assistive Technology: Design, Accessibility and Transdisciplinary Perspectives (pp. 76–95). New York: Idea Group.

Journal article, monograph, or newsletter

Laffey, J., Galyen, K & Babiuch, R. (2012). Guidance in Game-Based Virtual Learning: Lessons from Developing iSocial. Journal of Immersive Education. Vol 1(1).

Laffey, J., Schmidt, M. and Amelung, C. (2010). Open for Social: How Open Source Software for E-Learning Can Take a Turn to the Social. International Journal of Open Source Software and Processes: 49–64. Full text

Laffey, J., Schmidt, M., Galyen, K., and Stichter, J. (2012). Smart 3D Collaborative Virtual Learning Environments: A Preliminary Framework. Journal of Ambient Intelligence and Smart Environments, 4(1): 49–66. doi:10.3233/AIS-2011–0128

Laffey, J.M., Stichter, J.P., and Galyen, K. (2014). Distance Learning for Students With Special Needs Through 3D Virtual Learning. International Journal of Virtual and Personal Learning Environments, 5(2): 15–27. doi:10.4018/ijvple.2014040102

Lierheimer, K., and Stichter, J.P. (2011). Teaching Facial Expressions of Emotion. Beyond Behavior, 21(1): 20–27.

Schmidt, C., Stichter, J.P., Lierheimer, K., McGhee, S., and O'Connor, K.V. (2011). An Initial Investigation of the Generalization of a School-Based Social Competence Intervention (SCI-S) for Youth With High-Functioning Autism. Autism Research and Treatment, 2011: 1–11. doi:10.1155/2011/589539 Full text

Schmidt, M. Galyen, K., Laffey, J., Babiuch, R., and Schmidt, C. (2014). Open Source Software and Design-Based Research Symbiosis in Developing 3D Virtual Learning Environments: Examples From the iSocial Project. Journal of Interactive Learning Research, 25(1): 65–99.

Schmidt, M., Laffey, J., Schmidt, C., Wang, X., and Stichter, J. (2012). Developing Methods for Understanding Social Behavior in a 3D Virtual Learning Environment. Computers in Human Behavior, 28(2): 405–413. doi:10.1016/j.chb.2011.10.011

Schultz, T.R., Stichter, J.P., Herzog, M.J., McGhee, S.D., and Lierheimer, K. (2012). Social Competence Intervention for Parents (SCI-P): Comparing Outcomes for a Parent Education Program Targeting Adolescents With ASD. Autism Research and Treatment, 2012: 1–10. doi:10.1155/2012/681465

Stichter, J., Laffey, J., Galyen, K., and Herzog, M. (2014). iSocial: Delivering the Social Competence Intervention for Adolescents (SCI-A) in a 3D Virtual Learning Environment for Youth With High Functioning Autism. Journal of Autism and Developmental Disorders, 44(2): 417–430. doi:10.1007/s10803–013–1881–0

Stichter, J.P., Herzog, M.J., O'Connor, K.V., and Schmidt, C. (2012). A Preliminary Examination of a General Social Outcome Measure. Assessment for Effective Intervention, 38(1): 40–52. doi:10.1177/1534508412455213