Project Activities
Researchers evaluated the impacts of the TPP program through a randomized controlled trial in which students enrolled in ABS programs at community colleges were randomly assigned to receive either the support of ABS advising staff (the control group) or the support of ABS advising staff who also used text messaging (TPP facilitators) to enhance their advising activities (the treatment group). Researchers compared treatment and control student success in GED® test taking, earning a GED® credential, and enrollment in a postsecondary course.
Structured Abstract
Setting
The project took place in Oregon.
Sample
The sample was drawn from adult learners at the adult secondary education (ASE) level who enrolled in ABS programs located at one of Oregon's 17 community colleges. Six programs were selected from those volunteering to take part in the study. Of these, three were large programs, two medium, and one small. Eligible students were identified in the spring and fall quarters of the 2017-18 academic year and in the winter quarter of the 2018-2019 academic year. Eligibility criteria included scoring at the sixth-grade level or higher in reading or math and lacking a high school diploma or equivalent time of enrollment.
The Oregon ABS Transition Planning Process (TPP) was a text-messaging enhancement to the activities provided by ABS advisors. ABS advisors’ main responsibility was to provide guidance, information, and other supports to ABS learners who were preparing to take the GED® subject tests. Through the TPP study, ABS programs expanded ABS advisors’ (referred to as TPP facilitators) activities to include a text messaging component for learners in the study’s treatment group to further motivate ABS learners to pursue the GED® and enroll in postsecondary education. TPP facilitators were provided with a list of text messages that addressed program attendance, learner goal setting, GED® test participation, and postsecondary enrollment, but had flexibility in customizing their text messages to learners’ specific situations. The TPP facilitators provided advice, coaching, and information through face-to-face and bimonthly text and email contacts with adult learners in ABS courses. The TPP facilitators supported adult learners through four steps for completing a GED® and six steps for enrolling in postsecondary courses. Each step had associated materials, a timeline, and text messages to be sent by the facilitator to the student to offer advice and encourage students to complete the step. In addition, the TPP contains a checklist and documentation of support that are used to track whether the facilitator carried out the support for each step.
Research design and methods
A randomized controlled trial was used. During enrollment for the spring and fall quarters of the 2017-18 academic year and the winter quarter of the 2018- 2019 academic year, students entering ABS programs at the six selected ABS programs in five community colleges took the Comprehensive Adult Student Assessment System (CASAS) reading and math tests and completed the intake forms. The researchers randomly assigned 244 eligible students to the TPP or to a business-as-usual control group. The student outcome measures were gathered over multiple quarters (including the intervention quarter) for each of the three cohorts through the 2020-2021 academic year.
Control condition
Control students attended the same ABS programs as treatment students and received the same access to ABS advising staff but did not have access to the text messages sent by TPP facilitators.
Key measures
The key outcome measures were GED® test taking, GED® attainment, and enrollment in postsecondary courses. Baseline measures used to identify subgroups included math and reading levels derived from the CASAS reading and math tests, and goals of learners (e.g., GED® attainment, entering college, or training). Fidelity of implementation measures include the types of text messages that were sent by the TPP facilitators.
Data analytic strategy
The research team carried out an intent-to-treat analysis using linear or logistic probability models, depending on the outcome measure, to examine success or failure in GED® test taking, earning a GED® credential, and enrollment in a postsecondary course for the full sample and for particular subgroups of interest to the partners. A treatment-on-the-treated analysis was conducted to explore outcomes in case a significant proportion of learners did not take up the treatment.
Key outcomes
Key outcomes will be shared once publications are available.
People and institutions involved
IES program contact(s)
Products and publications
ERIC Citations: Find available citations in ERIC for this award here.
Select Publications:
Inside IES Research Blog
Related projects
Supplemental information
Co-Principal Investigator: Fish, Susan
Partners: Abt Associates and Oregon Higher Education Coordinating Commission, Office of Community Colleges and Workforce Development
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
