Project Activities
This project consisted of three studies. Study 1 was conducted in 4- and 2-year institutions of higher education. It involved administering the assessments associated with the PAR model and conducted analyses to understand their relationships. Study 2 was conducted at a 4-year institution in the context of a class intended to support under prepared college students. This study was conducted to assess what factors are predictive of success in this course. Study 3 involved using data from Studies 1 and 2 to assess what factors predict early college success and measured by the cumulative GPA for 3 consecutive semesters within the first 2 years of college. The data from studies 1 and 2 allowed the research team to conduct additional studies to learn about specific populations of college students in the sample, such second language learners.
Structured Abstract
Setting
The study took place 4-year university located in Illinois and community colleges located in the Southwest and Northeastern United States.
Sample
Data from 1072 participants was collected over the courses of this project at 4-year (n=682) and 2-year (n=390) institutions. There were 610 participants that completed the demographic survey, which indicated a highly diverse sample of participants (53% female; 46% Black/African American, 26% White, 10% Asian, 17% Hispanic/Latino, and 2% Other).
Research design and methods
Study 1 explored the correlation between the various components of the PAR model and student academic outcomes, in particular academic literacy, retention, and GPA. Researchers collected on students' pre-existing basic and academic literacy, their motivation and metacognitive skills, and background characteristics (working memory, demographics, etc.) during the first weeks of the semester. These data were collected from a diverse sample of college students, including from students enrolled in developmental education programs at a university and community college. The researchers collected students' end-of-semester data including retention, course grades, and overall GPA over the subsequent three semesters. Study 2 explored the factors specified in PAR and the extent that they were correlated with performance in a reading study and strategy course. The same assessments used in Study 1 were used in Study 2. Study 3 used a longitudinal design to follow the students for an additional 2 years subsequent to the developmental reading course.
Control condition
Due to the nature of the design, there is no control condition.
Key measures
Basic literacy measures include the Study Aid and Reading Assessment (SARA) (for basic literacy, e.g., decoding, vocabulary, and basic comprehension) and the Reading Strategy Assessment Tool (RSAT) (for comprehension, inferencing, and paraphrasing). Academic literacy measures included two different assessments that reflected different types of literacy tasks that can happen in academic settings. One assessment evaluated proficiency in basic comprehension (understanding what a text is about) and was the comprehension subtest in the SARA. The other assessment, the Global, Integrated Scenario-Based Assessment (GISA) evaluated proficiency in complex problem solving with texts. Metacognition measures include Metacognitive Awareness Inventory, and the Metacognitive Awareness of Reading Strategies Inventory. Motivation measures include the Adaptive Reading Motivation Measures and the Experience Sampling Method. Academic measures include retention rates, credit hours completed, and grade point average.
Data analytic strategy
The researchers used confirmatory factor analyses, structural equation modeling, hierarchical regression, path analysis, and latent profile analysis to examine the relationships among the PAR components and students' performance.
Key outcomes
The main findings of this exploratory study are as follows:
- Students who are underprepared vary in their strengths and challenges, and as such may need different types of support (Feller et al., 2020; Magliano, Lampi, et al., 2020, Magliano, Higgs, et al., 2020).
- There are complex relationships between basic literacy skills (reading, inference), motivation, and metacognition (Kopatich et al. 2019; Magliano, Higgs, et al., 2020).
- The nature of literacy tasks matters and affects how students leverage strategies that they use (Feller et al., 2020; Magliano, Higgs, et al., 2020).
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Products
Publicly available data: The data for this project is available on Open Science Framework (Link: https://osf.io/5pgrc/)
Book chapters
Magliano, J. P., McCrudden, M. T., Rouet, J. F., & Sabbatini, J. (2018). The Modern Reader: Should Changes to How We Read Affect Research and Theory? in M. F. Schober, M. A. Britt, & D. N. Rapp (Eds) (2018). Handbook of Discourse Processes (2nd addition), (pp. 343-361) New York: Taylor & Francis.
Magliano, J. P., Higgs, K., & Clinton, J. A. (2019). Sources of Complexity in Comprehension Across Modalities of Narrative Experience. In M. Grishokova & M. Poulaki (Eds.) Cognition and Narrative Complexity. Lincoln, NE: University of Nebraska Press.
Magliano, J. P., Hastings, P., Kopp, K., Blaum, D., and Hughes, S. (2018) Computer-based Assessment of Essays Based on Multiple Documents: Evaluating the Use of Sources. In J. L. G. Braasch, I. Bråten, & M. T. McCrudden (Eds.) Handbook of Multiple Source Use. New York, NY: Routledge.
Wigfield, A., Tonks, S. M., and Eccles, J. S. (2018). Expectancy-Value Theory in Cross-Cultural Perspective: What Have We Learned in the Last 15 Years? In D. M. McInerney & G. A. D. Liem (Eds.), Research on Sociocultural Influences on Motivation and Learning Volume 4: Big Theories Revisited (2nd Edition). Greenwich, CT: Information Age Press.
Journal articles
Feller, D. P., Kopatich, R. D., Lech, I., & Higgs, K. (2020). Exploring Reading Strategy use in Native and L2 Readers. Discourse Processes, 57(7), 590-608.
Feller, D. P., Magliano, J., Sabatini, J., O'Reilly, T., & Kopatich, R. D. (2020). Relations Between Component Reading Skills, Inferences, and Comprehension Performance in Community College Readers. Discourse Processes, 57(5-6), 473-490.
Kopatich, R. D., Magliano, J. P., Millis, K. K., Parker, C. P., & Ray, M. (2019). Understanding how Language-specific and Domain-general Resources Support Comprehension. Discourse Processes. 56, 530-552.
Magliano, J. P., Higgs, K., Santuzzi, A., Tonks, S. M., O'Reilly, T., Sabatini, J., ... & Parker, C. (2020). Testing the Inference Mediation Hypothesis in a Post-Secondary Context. Contemporary Educational Psychology, 61 101867.
Magliano, J. P., Lampi, J. P., Ray, M., & Chan, G. (2020). Revealing the Comprehension Processes of Underprepared College Students: An Evaluation of the Reading Strategies Assessment. Journal of College Literacy and Learning, 46. 104-122.
In addition to disseminating study findings to educational scientists via published manuscripts in peer reviewed journals and presentations at professional conferences, this research was disseminated to the general public in the context of blog articles posted to the Wide Wide World of Psychology, hosted on www.psychologytoday.com. A web-based version of the Reading Strategy Assessment Tool was created that can be made available to the research community.
Project website:
Additional project information
Malleable Factor: The PAR model features several components, including basic literacy (such as vocabulary, syntactic processing skills, and basic comprehension), text modeling (such as the ability to generate inferences while reading), metacognition (students' ability to consciously choose cognitive strategies), and motivation (students' ability to put forth the appropriate amount of energy to complete a task). The current development reading curriculum at the university uses an approach that aligns with the PAR model. This reading course also teaches students how to apply various literacy practices and strategies across disciplines (such as psychology and history) to accomplish authentic academic tasks (such as preparing for tests, writing papers).
Related projects
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
