Project Activities
The project team will further develop develop and refine Beacon through a collaborative process with stakeholders and other experts. Once complete, they will test the fully functional system in a pilot study to gather data on the feasibility, usability, and impact of the system on the behavior of school professionals and student outcomes.
Structured Abstract
Setting
The project activities will take place in rural and suburban schools.
Sample
Participants will include between 12 and 15 educators, administrators, and school mental health professionals at each of 11 schools (5 elementary, 3 middle, and 3 high schools). The researchers will also collect data about students referred to the child study teams (with or without disabilities) for concerns related to emotional and behavioral problems at participating schools.
Beacon is a web-based system that helps educators make informed decisions about their choice of services and measures to help students with emotional and behavioral problems. The system provides educators with information based on students' presenting problems and age. Users are informed about the levels of evidence supporting each of the potential services under consideration for a referred student. Materials are included to help staff learn how to implement services, assessment data are collected through text messages and emails, and data are available in figures to inform decisions about how to proceed with each student. Data are stored and tracked over time to facilitate decision making about services.
Research design and methods
After completing the development and refinement work through a collaborative process with stakeholders and other experts, the project team will test the fully functional system in a pilot study to gather data on the feasibility, usability, and impact of the system on the behavior of school professionals and student outcomes.
The research team will conduct the pilot study using multiple-baseline single-case design studies across 8 schools in a manner consistent with What Works Clearinghouse (WWC) standards. Analyses will address the proximal outcome of educators' choices of evidence-based practices and the distal measures of changes in student outcomes. Research staff will attend child study team meetings at these 8 schools during the pilot study to collect data about feasibility, usage, student outcomes, and decisions pertaining to referred students.
Control condition
The control condition for the pilot study are data from school child study team meetings when not using Beacon.
Key measures
The researchers will measure feasibility and usability through established rating scales as well as observation and Beacon usage data. They will measure adherence to the child study team process with observation and usage data along with informal inquiries to school staff about their decisions to adhere or not adhere to specific elements of the process. They will measure student outcomes with two teacher ratings and the progress monitoring measures that are part of the Beacon system.
Data analytic strategy
The analysis of the single-case design research will be consistent with the recommended practices of visual analysis of graphed data. Specifically, the researchers will analyze (1) trends and levels among research conditions, (2) the amount of variability and overlap between conditions, (3) the immediacy with which treatment effects are observed, and (4) the consistency of data within similar conditions of different schools in each study. In addition, they will use multilevel modeling to explore predictors associated with students' outcomes.
Cost analysis strategy
The cost analysis will examine the costs to provide the Beacon system to a school including training, support, and use and maintenance of the software.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Products include a new component of the Beacon system (services and assessments for alternative classrooms) that will result in a fully functional and effective Beacon system with sections for general and alternative classroom education teachers and school mental health professionals from K to 12.
Publications:
Evans, S. W., Brockstein, H., Allan, D. M., Girton, S. L., Owens, J. S., & Everly, E. L. (2022, September). Developing a web-based system for coordinating school-based care for students with social, emotional, and behavioral problems. In Frontiers in Education (Vol. 7, p. 983392). Frontiers Media SA.
Additional project information
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
