IES Blog

Institute of Education Sciences

Teaching Organizational Skills to Adolescents: Bringing Clinical Practices into Schools

Organizing, planning, and managing time influence student achievement and become increasingly important as adolescents enter middle school. Clinical research offers promising practices for improving these skills in students with attention-deficit/hyperactivity disorder (ADHD), but the key is getting these practices into schools. That’s where IES-funded researchers come in.

In 2009, researchers from Virginia Commonwealth University used an IES grant to develop Homework, Organization, and Planning Skills (HOPS)—a program that teaches middle school students with ADHD to use checklists to organize, plan, and manage their schoolwork.

In 2013, IES funded an initial efficacy study to test HOPS in public middle schools, comparing HOPS with more traditional homework support. Researchers found that parents of students using HOPS and traditional homework support reported fewer homework problems and better organizational skills at home. In contrast, teachers reported improved organization and management skills in the classroom only for their students who used HOPS, not the homework support. HOPS also provided greater benefits overall for students with higher levels of hyperactivity and oppositional behavior and greater deficits in organizational skills.

In June, IES awarded a grant to Children’s Hospital of Philadelphia to conduct a five-year effectiveness study that will test whether HOPS is beneficial for all students who have organizational skill deficits, rather than just students with a formal ADHD diagnosis. This is important because organizational deficits affect student achievement regardless of whether a student has been diagnosed with a learning disorder. This study will determine whether schools can implement HOPS effectively and inexpensively in a school environment.

Written by Greg Shanahan, IES Presidential Management Fellow, and Emily Doolittle, NCER Team Lead for Social Behavioral Research

Career Pathways Research at HHS: Lessons and Opportunities for Education Research

Over the past few years, staff from IES and the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF), U.S. Department of Health and Human Services (HHS), have been learning from and supporting one another’s work. Our offices have a shared interest in understanding and improving outcome for adults in postsecondary career pathway programs and for creating a strong evidence base.

We have even funded projects that dovetail nicely. For example, IES funded a development project focusing on Year Up, and OPRE included Year Up programs in their Pathways for Advancing Careers and Education (PACE) Study.

For IES researchers not already aware of OPRE’s research, we would like to highlight three things that may be particularly relevant to the work IES hopes to support.

A Growing Portfolio of Career Pathway Research: For over a decade, OPRE has created a robust research portfolio longitudinal, rigorous experimental career pathways program research.  These career pathway programs provide postsecondary education and training through a series of manageable steps leading to successively higher credentials and employment opportunities. In particular, OPRE has supported the Pathways for Advancing Careers and Education (PACE) Study and the rigorous evaluation of the Health Profession Opportunity Grants (HPOG) Program. You can find reports from these and other self-sufficiency, welfare, and employment activities in the OPRE Resource Library.

Available Data and Funding Opportunity: Later this summer, OPRE will be archiving data from PACE and HPOG at the University of Michigan’s Inter-University Consortium on Political and Social Research (ICPSR) at the Institute for Social Research. These data will be available as restricted-use files for secondary data analysis. To encourage research, OPRE announced a funding opportunity Career Pathways Secondary Data Analysis Grants to support secondary analysis these data. Applications are due August 16, 2019.

Understanding Programs’ Motivations for Participating in Research: Getting education programs (schools, universities, etc.) to join multi-year, randomized controlled trials is difficult. Programs are wary of random assignment or finding null or negative effects. Yet, the programs that participated in the PACE Study were overall quite supportive. A recent report “We Get a Chance to Show Impact”, Program Staff Reflect on Participating in a Rigorous, Multi-site Evaluation documents the hurdles and benefits of participation from a program’s point of view. These programs’ insights are particularly useful for any researcher hoping to form partnerships with education settings.

To learn more about the ongoing career pathways research at OPRE and their findings, please visit https://www.acf.hhs.gov/opre/research/project/career-pathways-research-portfolio.

IES Makes Two New Awards for the Development of Web-based Tools to Inform Decision Making by Postsecondary Students

In June, the Institute of Education Sciences (IES) announced two new awards to technology firms to develop web-based tools that inform student decision making in postsecondary education. The projects will focus on generating a measure of the return of investment (ROI) for different educational training programs and careers so that high school and college students have access to data-driven information to guide their decisions.

The awards were made through a special topic offered by the IES Small Business Innovation Research (known as ED/IES SBIR) program, which funds the research and development of commercially viable education technology. (For information on the 21 awards made through the IES 2019 standard solicitation, read here.)

Background and Awards

While websites like College Scorecard and CareerOneStop provide information to explore training programs in colleges and occupations of interest, there is no tool that helps students understand the costs and benefits of individual postsecondary programs in an integrated, customizable, and user-friendly manner.  

The special topic SBIR solicitation requested proposals from small businesses to develop new ROI tools that would combine information on fees, time to complete, and projected earnings so that students can easily compare college and career pathways. The IES-funded ROI tools aim to improve student program completion rates, with higher employment and earnings, less education-related debt, and more satisfaction with their selected paths. The special topic SBIR solicitation offered up to $200,000 for firms to develop and evaluate a prototype of their ROI tool. 

Two awards were made through this special topic:

  • Illinois-based BrightHive, Inc. is developing a prototype of the Training, Education, and Apprenticeship Program Outcomes Toolkit (TEAPOT). Designed to inform student training and educational decision making over a variety of potential pathways, TEAPOT will improve the flow and accuracy of data resulting in improved estimates of the ROI for different postsecondary education pathways.  The team will develop a data interoperability system and simplified toolkit for states and local postsecondary and workforce development organizations. The toolkit will provide more high quality, consistent, and granular information on postsecondary outcomes. The prototype will calculate ROI using student information, programmatic information (with an emphasis on net program costs to allow for variations by program type at the same institution), and access to wage and employment data sets.
  • Virginia-based Vantage Point Consultants is developing a prototype of a user-contextualized ROI tool that prospective students will use to make meaning of lifetime costs and opportunity tradeoffs associated with different degree programs offered by postsecondary institutions. The ROI tool will incorporate information on student goals and academic, professional, and personal characteristics.  The prototype will include an interface to present information to guide decision making based on an ROI calculation that discounts earning cash-flows under current and future state career and education assumptions, while subtracting college cost. In the first phase of work, the project will use information from data partners including Burning Glass Technologies and from public sources at the Department of Labor and Department of Education.

After developing prototypes, researchers will analyze whether the tools function as intended and are feasible for students to use. Research will also test if the tool shows promise for producing a meaningful and accurate measure of ROI.  Both firms are eligible to apply for additional funding to complete the full-scale development of the ROI tool, including developing an interface to improve user experience and conducting additional validation research.

Stay tuned for updates on Twitter (@IESResearch) as IES projects drive innovative forms of technology.

Written by Edward Metz, program manager, ED/IES SBIR

Investing in the Next Generation of Education Technology

Millions of students in thousands of schools around the country have used technologies developed through the Small Business Innovation Research program (ED/IES SBIR) at the IES. The program emphasizes rapid research and development (R&D), with rigorous research informing iterative development and evaluating the promise of products for improving the intended outcomes. The program also focuses on the commercialization after development is complete so that products can reach schools and be sustainable over time.

At the end of June, ED/IES SBIR announced 21 new awards for technology products for students, teachers, or administrators in education and special education. (IES also announced two additional awards through a special topic solicitation in postsecondary education. Read about these awards here.) Of the 21 awards, 13 are for prototype development and 8 for full scale development (a YouTube playlist of the full scale development projects is available here). 

Many of the new 2019 projects continue education and technology trends that have emerged in recent years. These include the three trends below.

Trend 1: Bringing Next Generation Technologies for Classrooms
For educators, it can be challenging to integrate next generation technologies into classroom practice to improve teaching and learning. In the current group of awardees, many developers are seeking to make this happen. Schell Games is developing a content creation tool for students to create artistic performances in Virtual Reality (VR) and Gigantic Mechanic is designing a class-wide role-playing game facilitated by a tablet-based app. codeSpark is building a game for children to learn to code by creating story based narratives. Killer Snails, Lighthaus, and AP Ventures are all creating educational content for VR headsets and Parametric Studios, Innovation Design Labs, and LightUp are employing Augmented Reality (AR) to support learning STEM concepts. Aufero is bringing modern design principles to develop a traditional board game for students to gain foundational computer science and coding skills.

Trend 2: Personalized Learning

Several 2019 awards are building technologies to provide immediate feedback to personalize student learning. Graspable, Inc. and Apprendis are developing adaptive engines that formatively assess performance as students do activities in algebra and physical science, and Sirius Thinking is building a multimedia platform to guide and support pairs of students as they read passages. Charmtech is developing a prototype to support English learners in reading, Cognitive Toybox is creating a game-based school readiness assessment, Hats & Ladders is developing a social skills game, and IQ Sonics is refining a music-based app for children with or at risk for disabilities to practice speaking.

Trend 3: Platforms that Host and Present Data
School administrators and teachers are always seeking useful information and data to guide decision making and inform instruction. Education Modified is developing a platform for special education teachers to implement effective Individual Education Programs (IEPs) for students with or at risk for disabilities, and VidCode is developing a dashboard to offer teachers real-time performance metrics on coding activities to teachers. LearnPlatform is developing a prototype platform that generates reports to guide teachers in implementing new education technology interventions in classrooms, and Liminal eSports is developing a platform administrators and teachers can use to organize eSports activities where students participate in group game activities to learn.

Stay tuned for updates on Twitter and Facebook as IES continues to support innovative forms of technology.

Written by Edward Metz, Program Manager, ED/IES SBIR

Fieldnotes: Reflections from an Adult Education Instructor on Research and Practice

Approximately 18 percent of US adults are at the lowest levels of literacy and nearly 30 percent are at the lowest levels of numeracy. The adult education system serves adults with low skills, but many education researchers know little about the students or the setting.  Recently, NCER convened a working group of adult education instructors, administrators, and researchers to discuss adult education’s research and dissemination needs.

Mr. Marcus Hall, an adult education instructor at the Community Learning Center and JEVS Human Services in Philadelphia, participated in this working group. He spoke with Meredith Larson, NCER program officer for adult education, about his experiences and interests in research. A copy of the working group meeting summary is available here.

Please describe your adult education classroom.

I once taught a 7-week course with students ranging from 18 to over 60 years old who had low literacy or math scores. I tried to contextualize instruction around their career interests and differentiate it to their learning needs. For example, some students were proficient readers but needed comprehension and math practice while others struggled with one or more of the basic components of reading. Somehow, I needed to help those learning phonics and those struggling with fluency while also challenging those ready for comprehension work. It’s hard to meet student needs in such a short time without teacher aides or adaptive technologies.

Why is research particularly important for adult education?

The challenges we face are monumental. Despite the large number of adults in need, adult education feels under-funded, under-staffed, and under-appreciated. Our students need complex, comprehensive, and well-rounded intervention, but we often have to make the most out of slightly targeted, inexpensive, and difficult-to-implement solutions. We need researchers to provide practical information and recommendations that we can use today to help adults learn and retain information.

Have you used research into your teaching?

Specifically, for reading instruction, I use techniques and activities built on evidence-based reading interventions. I start with tested diagnostic assessments to determine the needs of my students followed by strategies such as Collaborative Oral Reading or Repeated Reading exercises to support my students.

What topic during the meeting stood out to you?

The discussion about the workforce and professional development resonated with me. Many of our educators are part-time, come out of K-12, close to retirement, and may not have specific training for working with adults. They are asked to teach subjects they may not have any certification in, and their programs may not be able to provide the professional development they need. Just as we need supports for our learners, we need research to develop supports for us educators.

What additional research would you like to see?

Many of my students have had traumatic experiences that, when relived in the classroom, can cause them to disengage or struggle. I feel that understanding triggers and signs of discomfort has greatly enhanced my ability to help my students. Many educators want to leverage mental health approaches, like trauma-informed care, but we could use help learning how to integrate these strategies into instruction.

What do you hope researchers and educators keep in mind regarding one another?

It seems that researchers publish and promote their work to other researchers and then move to the next topic. This may be due to time constraints, publishing demands, or institutional requirements. I hope researchers take the time to come into our settings and observe us in action. I want researchers to work with us to help us understand and accept what is and isn’t working.

As for educators, we need to not try things and then stop using them when something unexpected occurs. At times, we revert back to what we know and are most comfortable with in the classroom. We educators can and must think critically about our norms and be ready and willing to enhance our practice with new information.