Inside IES Research

Identifying young children with language delays can improve later outcomes

Language is a core ability that children must master for success both in and out of the classroom. Extensive studies have shown that many tasks, including math, depend on linguistic skill, and that early language skills are predictive of school readiness and academic success. Being able to quickly identify children at early ages with language delays is crucial for targeting effective interventions.

Enter the QUILS.

In 2011, the National Center for Education Research (NCER) at IES funded a 4-year grant to Dr. Roberta Golinkoff (University of Delaware) and Drs. Kathy Hirsh-Pasek (Temple University) and Jill de Villiers (Smith College) to develop a valid and reliable computer-based language assessment for preschoolers aged 3-5 years old. The resulting product was the Quick Interactive Language Screener (QUILS), a computerized tool to measure vocabulary, syntax, and language acquisition skills. The assessment ultimately measures what a child knows about language and how a child learns, and automatically provides results and reports to the teacher.

The preschool version of QUILS is now being used by early childhood educators, administrators, reading specialists, speech-language pathologists, and other early childhood professionals working with young children to identify language delays. The QUILS is also being utilized in other learning domains. For example, a new study relied on the QUILS, among other measures, to examine links between approaches to learning and science readiness in over 300 Head Start students aged 3 to 5 years.

QUILS is now being revised for use with toddlers. In 2016, the National Center for Special Education Research (NCSER) funded a 3-year study to revise the QUILS for use with children aged 24-36 months. The researchers have been testing the tool in both laboratory and natural (child care centers, homes, and Early Head Start programs) settings to determine which assessment items to use in the toddler version of QUILS. Ultimately, these researchers aim to develop a valid and reliable assessment to identify children with language delays so that appropriate interventions can begin early.

By Amanda M. Dettmer, AAAS Science & Technology Policy Fellow Sponsored by the American Psychological Association Executive Branch Science Fellowship

As part of our series recognizing the IES investment in Career and Technical Education (CTE) research, we interviewed Esther Prins, Professor at Pennsylvania State University, about her NCER-funded project, Career Pathways Programming for Lower-Skilled Adults and Immigrants: A Comparative Analysis of Adult Education Providers in High-Need Cities.  This Researcher-Practitioner Partnership involves researchers at Pennsylvania State University working in collaboration with adult education providers in Chicago, Houston, and Miami to better understand how adult education programs are incorporating career pathways into their delivery models.

What is the education issue you and your partners trying to address?

Millions of U.S. adults have been left behind by the economy and rising education requirements for even minimum-wage jobs. Career pathway (CP) programs help adults prepare for employment and postsecondary education. Although recent federal policy (e.g., WIOA) has encouraged CP programming among adult education providers, there is little research to help guide practice and few opportunities for providers to learn about how their peers organize CP programs, who they serve, what outcomes they measure, and other program features.

What are career pathway programs in adult education?

CP programs develop adults’ basic math, reading, and English language skills, while concurrently preparing them to enter postsecondary education or jobs in specific fields like healthcare or manufacturing. These programs can be run through many kinds of institutions, including community colleges, workforce development organizations, and community-based organizations. The adults seeking CP classes may vary in their skill levels, but our project focused on the adults with greatest barriers to education and employment: those who did not graduate from high school or who have low math, reading, or English language scores.

What are some of the specific concerns your practitioner partners have?

Some practitioners are concerned that requirements programs must meet may unintentionally reward programs for enrolling higher-level students—the ones who are most likely to find a job or enroll in college—rather than serving students with the greatest need. They also want to know about what non-academic supports programs may need to provide, so we are exploring the role of wraparound support services. These are important because many adult learners experience poverty and related challenges such as transportation, childcare, housing, and financial instability.

What are some of the major findings thus far?

First, CP programming is widespread: more than 90% of the surveyed organizations offered or were developing CP classes in 2015. However, there are no shared program outcome measures, and this hinders comparison and documentation of programs’ collective impact. Coordination within cities primarily occurs on a small scale between a subset of organizations; citywide coordination across organizations and funding streams is less common.

Second, the majority of CP classes require students to meet minimum entry requirements such as passing a reading, math, or language test and/or possessing a high school degree. These requirements limit access for adults with the greatest barriers. To address these issues, programs are trying different options. For example, some programs offered multiple entry points (e.g., bridge classes) to enable adults with skills gaps to advance from lower-level to higher-level CP classes.

Third, agencies offer a variety of wraparound support services to meet students’ non-academic needs. Some programs bundle support services, meaning they require participation in at least two support services. These include screening for income supports and access to financial services, financial coaching and literacy, and job coaching.

The report on the survey is available online.

How are the findings being used?

Building on the findings from this study, the Chicago Citywide Literacy Coalition formed a group of 13 adult education providers to staff a Career Navigator at their local American Jobs Center to address issues such as forming shared program metrics, helping adults with lower skills, and connecting adults to support services available at the American Jobs Center. 

What other issues need to be studied?

Practitioners are interested in better understanding the long-term effects and trajectories of students in CP programs. For example, they’d like to know more about postsecondary and employment outcomes and whether certain individual characteristics, program supports, or instructional approaches lead to better outcomes. Additional research could help shed light on these issues.

Meredith Larson, NCER Program Officer, interviewed Esther Prins 

The figures above are from an infographic prepared by the research team and summarize the data gathered by the team.

Happy Read Across America Day! This year is the 10-year anniversary of this national pep rally for reading, and IES has supported the development of a number of tools to promote reading and literacy.

Did you know that many of the curricula and materials developed by IES researchers are available for free? These materials include reading on topics interesting to students, as well as guidance for teachers on how to engage and motivate students in discussions about what they read. For example, as part of the Reading for Understanding Initiative, IES invested in multiple curricula that are designed to help improve students’ reading comprehension and are available at no charge.

For students in preschool through grade 3, the Let’s Know! curriculum supplement uses easily-accessible books to help teach children about vocabulary, making inferences, and text structures like cause and effect. There’s also a Spanish version of this curriculum (¡Vamos Aprender!). You can gain access to the curriculum through the Language and Reading Research Consortium webpage.

Word Generation is a group of curricula developed for students in grades four through eight with a focus on teaching students to understand multiple perspectives, reason, and learn academic vocabulary, all through high-interest topics in science and social studies.

Example topic questions from units include:

• When is a crime not a crime?

• The Legacy of Alexander the Great: Great Leader or Power-Hungry Tyrant? and

• Thinking About Natural Selection.

You can find more information on WordGen and download materials on their website.

Finally, for high school students, Promoting Adolescents’ Comprehension of Text (PACT) is an intervention aimed at motivating and engaging students to read and understand informational texts in social studies. Students learn vocabulary words and make connections between social studies topics and their own lives. For example, in a unit about the 1920s, students learn about economy and prosperity and complete activities such as listing three items they have purchased and determining whether they are “needs” or “wants,” and how this relates to a consumer economy. Sample materials are available for download on the PACT website.

Have fun celebrating Read Across America Day, and enjoy a book with the students in your lives!

By Becky McGill-Wilkinson, NCER Program Officer

For U.S. adults with low skills or low academic attainment, finding the time or resources to go back to school can be difficult because of family and work obligations. Recently released NCES tables from the Programme for the International Assessment of Adult Competencies (PIAAC) give us a clearer sense of how many adults face this challenge. With this information, policymakers, practitioners, and researchers can better understand and meet the education and training needs of working adults and parents.

How large is the concern?

Previous PIAAC analyses found that nearly 20 percent of U.S. adults score at the lowest levels of literacy, nearly 30 percent score at the lowest levels of numeracy, 14 percent of U.S. adults have less than a high school diploma, and 27 percent have no more than a high school diploma or equivalent. But how many of these adults have family or work responsibilities that may complicate their participation in education?

According to the new NCES tables, millions of adults have low skills or low attainment and family or work obligations that may complicate participation in education or training.

• Of the over 40 million adults at the lowest levels of literacy, nearly 56 percent are employed, 77 percent have children, and 44 percent are both employed and have children.
• Of the nearly 63 million adults at the lowest levels of numeracy, nearly 56 percent are employed, 74 percent have children, and 42 percent are both employed and have children.
• Of the nearly 31 million adults with less than a high school diploma or equivalent, nearly 49 percent are employed, 58 percent have children, and 32 percent are both employed and have children.
• Of the nearly 58 million adults with no more than a high school diploma or equivalent, approximately 64 percent are employed, 71 percent have children, and 45 percent are both employed and have children.

What do we know about how to serve adults with family or work obligations?

Currently, the research on improving outcomes for adults with low skills or low attainment is limited, and less is known on how to help such adults who have family or work obligations.

Examples of questions facing policymakers, practitioners, and researchers include:

• How do current education and training programs benefit working adults or parents?
• Are work or family obligations barriers, motivational factors, or both?
• Are multi-generational approaches (e.g., those that combine postsecondary or adult education services with Head Start or early childhood education) able to improve the academic outcomes of adults and the children they care for?
• Are the assessments used appropriate for adults?

IES offers opportunities for researchers to conduct this sort of work through its Postsecondary and Adult Education topic and disseminate information about promising practices. For more information about funding opportunities for such research, contact Dr. Meredith Larson.

About the PIAAC

The PIAAC is an international assessment for adults that assesses cognitive skills (literacy, numeracy, and problem solving) and contains data on educational background, workplace experiences and skills, and other items. For the purposes of this blog, the category of lowest levels is defined as Below Level 1 and Level 1.

By Meredith Larson, NCER Program Officer

As part of our series recognizing Career and Technical Education (CTE) month, we interviewed Mary Visher, Senior Associate at MDRC, about her recently funded study, Teaching and Learning 21st Century Skills in Community Colleges: A Study of the New World of Work Program (NWoW). This project is developing and testing an innovative program aimed at teaching 21^st century skills to community college students in CTE courses. Researchers, policymakers, and practitioners are working closely together to improve upon NWoW, which is already in use in several community colleges in California.