IES Blog

Institute of Education Sciences

Building a Better RFA

The Institute of Education Sciences (IES) is committed to continuous improvement and that includes the process by which people apply for and access grants.

Since its authorization in 2002, IES’ research centers—the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER)—have  been making efforts to improve the Requests for Applications (RFAs) we put out each year. In this spirit, we have conducted surveys of applicants the past few years and used that feedback to improve the current RFAs.

In Fiscal Years (FY) 2014 and 2015, all Principal Investigators (PIs) who submitted an application to the Education Research Grants Program RFA (CFDA # 84.305A) or the Partnerships and Collaborations Focused on Problems of Practice or Policy Program RFA (CFDA # 84.305H) were contacted via e-mail and asked to participate in the web-based survey. In FY 2015, applicants to the Special Education Research Grants Program (CFDA #324A) were included in the survey request.  The response rates were good for all surveys:

Grant Program FY 2014 FY 2015
Education Research Grants Program 62% 66%
Partnerships and Collaborations Program 59% 73%
Special Education Research Grants n/a 55%

 

Survey respondents generally provided positive feedback in both years. Most respondents indicated they felt the RFAs were clear and helpful, though there were some areas that generated some confusion and criticism.  For example, in FY 2014:

  • Applicants to the Education Research Grants program thought it was inconvenient to have to refer to two separate documents, the RFA and the Application Submission Guide, in order to complete their application.
  • Applicants to the Partnerships and Collaborations program reported some confusion about the distinction between partnership activities and research activities.

In response to the FY 2014 RFA survey results, the Institute made a number of changes. For the FY 2015 Education Research Grants and Special Education Research Grants, changes included combining the RFA and the Application Submission Guide into one document to provide all the necessary information in one place. According to responses from the FY 2015 RFA survey, this change was positively received. The majority of the respondents to the Education Research Grants and Special Education Research Grants surveys (n=398; 83%) reported that combining the RFA and Application Submission Guide was much better or somewhat better than having two separate documents. Overall, a majority of respondents (n = 161, 56%) felt the FY 2015 RFA was much better or somewhat better than in previous years, while another 43 percent felt that it was not better or worse.

For the Partnerships and Collaborations RFA, a number of changes were made to the FY 2015 RFA in response to the surveys. For example, the requirements for the research activities were disentangled from the requirements for the partnership in order to reduce redundancy within the application. Most respondents to the FY 2015 RFA survey (n = 53; 73%) felt this change made the RFA much better or somewhat better.

Respondents to the FY 2015 RFA survey also had some criticisms, and the Institute addressed those concerns in the FY 2016 RFAs. Specifically, in the Education Research Grants and Special Education Research Grants RFAs, more detail was added to the requirements for the dissemination plan and for the cost analysis plan.  For the Education Research Grants RFA, the language around research gaps was expanded to clarify that these are not priorities. Changes made in the Special Education Research Grant RFA in response to the feedback from the survey included streamlining application requirements related to student disability, age range or grade level, outcomes, and settings across its 11 research topics.  More details were added about the partnership tracking strategy (an area of confusion for many applicants) in the Partnerships and Collaborations FY 2016 RFA.

IES continues to strive toward improving RFAs and welcomes comments and suggestions for improvement. More information on the RFA results is available here: https://ies.ed.gov/ncer/projects/.

New FY 2017 RFAs are being posted on the IES Funding Opportunities page. If you have comments, please write to us at IESresearch@ed.gov.

By Christina Chhin (NCER), Rebecca McGill-Wilkinson (NCER), Phill Gagné (NCER) and Kristen Rhoads (NCSER)*

* Since this blog post was written, Dr. Rhoads has taken a position with the U.S. Department of Education's Office of Special Education and Rehabilitative Services. 

Improving Transitions: How NCSER-supported Work is Helping Prepare Students for Success

Talk of “transition” on Capitol Hill frequently focuses on political issues, such as the transition from one administration to the next. But on March 4, the conversation was about a very different type of transition—promoting positive outcomes for students with disabilities after high school.

For students with disabilities, post-high school goals are often similar to their non-disabled peers, but preparing them for success requires planning, support, and targeted interventions.

Over the past several years, the National Center for Special Education Research (NCSER) in the Institute of Education Sciences (IES) has funded research to innovate and develop as well as rigorously assess interventions that help students make successful transitions after high school.

A briefing on Capitol Hill was held this month to share recent research on transition for these students conducted by experts in the field. These experts have all received funding support from NCSER to help us better understand the transition challenges facing students with disabilities and to develop research-based programs and supports to increase the chances of success for students with disabilities.

"Young people with disabilities want the very same things as anyone else. A satisfying job, close relationships, a comfortable and safe place to live, a college degree, involvement in their community, friends they can count on, a chance to give something back, and an opportunity to be part of caring communities."

– Dr. Erik Carter, Vanderbilt University

Mary Wagner, of SRI International, began the briefing by talking about the National Longitudinal Transition Study-2 (known as the NLTS2), the more recent longitudinal study of the experiences of youth with disabilities as they transitioned from secondary school into postsecondary life over a 10-year period. Dr. Wagner presented findings that show that there has been progress in preparing students for, and engaging them in, postsecondary education. Additional academic courses, a paid job, and participation in transition planning and goal setting in high school were associated with increases in postsecondary education enrollment for these students after high school. However, the improvements have been uneven for some groups of students with disabilities and many challenges remain. For example, the rates of employment over time have not increased. 

David W. Test, of University of North Carolina-Charlotte, presented information about the innovative program “Communicating Interagency Relationships and Collaborative Linkages for Exceptional Students” or CIRCLES. This program involves three levels of interagency collaboration to promote positive outcomes for students with disabilities in secondary schools. The program connects students to more information and resources as well as provides mentoring support and partnerships. Ongoing research indicates the CIRCLES program is having a positive impact on student outcomes as compared to students receiving school services typically provided to support transition. In addition, participating students overwhelmingly agreed with the statement that they were “prepared for life after school” and their parents strongly agreed that they had “a better understanding of their child’s needs” and reported playing an active role in transition preparation.

The final two speakers discussed programs aimed at helping with transitions for students who face some of the greatest challenges.

Laurie E. Powers, of Portland State University, presented a research-based intervention program, “My Life,” for youth in foster care who also have disabilities. This program combines youth-directed coaching, workshops, and partnerships and mentoring to assist students in identifying goals and provide information and guidance they need to help them to experience success and to understand that they can achieve their goals. Many youth in foster care face extreme challenges in general: higher levels of unemployment, poverty, homelessness, abuse, and other mental health issues, and face incarceration rates of 10 times more than the general population. In addition, about 6 in 10 receive special education services and many also have developmental disabilities.

Research results have been positive. Students in the My Life program were found to be better prepared for postsecondary education and careers, and more were graduating from high school and fewer were homeless. After one year, postsecondary employment rates were up and rates of incarceration were down compared to the students who received services as usual.

Lastly, Erik Carter, of Vanderbilt University, presented research on improving workplace transitions for youth with intellectual disabilities (ID) in high school through a summer job support program. Although a disability does not predict aspirations, it does often predict post-high school experiences. Based on an analysis of data from the NLTS2, most youth with ID have a goal of employment, but only about 15 percent of all adults with ID are employed. A factor positively predicting outcomes for these students were the high expectations of those teaching them.

Project Summer embodies high expectations for these students and involves individual summer-focused transition planning, identification of community resources, and opportunities for youth to connect to community support and employment opportunities. Research indicates that the youth involved in Project Summer were much more likely to obtain employment or volunteer experiences in their community (66%) than their peers (19%) and all were paid above the minimum wage. This research also demonstrated that schools and communities have the capacity to support and promote the employment of youth with severe disabilities.

The briefing was sponsored by Senator Lamar Alexander, of Tennessee, Representative Suzanna Bonamici, of Oregon, and Representative Michael Honda, of California and was arranged by the Friends of IES, a group that advocates for education research. Certainly, there is much more work to be done to help students with disabilities successfully transition from high school and help them achieve their goals. But this month’s briefing demonstrated that progress is being made.

By Kimberley Sprague, Senior Research Scientist/Education Analyst, NCSER, and Dana Tofig, Communications Director, IES

 

New Release: Forum Guide to Elementary/Secondary Virtual Education Data

By The National Forum on Education Statistics Virtual Education Working Group

Rapid advancements and innovations in virtual education are providing education agencies, educators, and students with new opportunities for teaching and learning. That growth increases the need for accurate, high-quality data about virtual education that provides a full picture of successes and challenges. A new resource released earlier this month can help with this important work.

In recent years, virtual education has become an integral part of K-12 education and nearly every student is exposed to virtual learning in some context—whether as a single aspect of a traditional course or program, in an entirely virtual program, or in any combination of traditional and virtual learning.

Virtual education is often a core aspect of curricula and class instruction, and students and teachers are increasingly adept at integrating lectures, lessons, and group work delivered via computers, tablets, and other devices into day-to-day teaching and learning. Moreover, many students and teachers no longer distinguish between virtual and traditional learning—the technology and tools used in virtual education are familiar to them and are no more novel than a pencil.

Despite widespread interest in enhancing and expanding virtual teaching and learning, many state education agencies and school districts do not yet have the ability to collect accurate, high-quality virtual education data. Some organizations have not yet specified the data they want to collect, while others have not developed reliable processes for gathering and managing data. The prevalence of virtual education, the increasing diversity in virtual education opportunities, and the rapid pace of technological change require new ways of thinking about how to modify data elements and systems to effectively identify, collect, and use virtual education data to inform and improve education.

Local and state members of the National Forum on Education Statistics (the Forum) identified this problem and established a Virtual Education Working Group, tasked with developing a resource to assist education agencies as they: 1) consider the impact of virtual education on established data elements and methods of data collection, and 2) address the scope of changes, the rapid pace of new technology development, and the proliferation of resources in virtual education. On February 4th, 2016, the Forum Guide to Elementary/Secondary Virtual Education Data was released.

In the document, the Forum Working Group members identify supports to virtual education data such as the organizational structure of virtual education, user experiences, challenges in collecting virtual education data, policy implications, as well as privacy and confidentiality protections. The document also includes common data elements for K12 virtual and blended data, such as

The working group also identifies elements that exist for traditional schools that are useful for virtual education. Finally, the Guide provides real-world examples and common practices implemented by state departments, local districts, and schools to modify their data systems and add elements that better reflect the needs unique to virtual education. 

As virtual education continues to expand in elementary/secondary school systems, education data collection and reporting systems need to evolve as well. It is important for all virtual education stakeholders – teachers, parents, education administrators, data systems administrators, and policymakers – to come together and creatively address the challenges of building a sound data infrastructure that considers the unique aspects of virtual education.

It is our hope that the Forum’s new guide can be a helpful tool in that process.

 

About the National Forum on Education Statistics

The work of the National Forum on Education Statistics is a key aspect of the National Cooperative Education Statistics System. The Cooperative System was established to produce and maintain, with the cooperation of the states, comparable and uniform education information and data that are useful for policymaking at the federal, state, and local levels. To assist in meeting this goal, the National Center for Education Statistics (NCES), within the Institute of Education Sciences (IES) of the U.S. Department of Education, established the Forum to improve the collection, reporting, and use of elementary and secondary education statistics. The Forum addresses issues in education data policy, sponsors innovations in data collection and reporting, and provides technical assistance to improve state and local data systems.

Members of the Forum establish working groups to develop best practice guides in data-related areas of interest to federal, state, and local education agencies. They are assisted in this work by NCES, but the content comes from the collective experience of working group members who review all products iteratively throughout the development process. After the working group completes the content and reviews a document a final time, publications are subject to examination by members of the Forum standing committee that sponsors the project. Finally, Forum members (approximately 120 people) review and formally vote to approve all documents prior to publication. NCES provides final review and approval prior to online publication.

The information and opinions published in Forum products do not necessarily represent the policies or views of the U.S. Department of Education, IES, or NCES. For more information about the Forum, please visit http://www.nces.ed.gov/forum and/or contact Ghedam Bairu at Ghedam.bairu@ed.gov

 

Coming Soon to a Research Center Near You!

The summer movie season is still a couple of months away, but the trailers are already popping up on social media and in movie theaters, building anticipation and excitement. The Institute of Education Sciences (IES) has released its own preview, of sorts, this week.

One of the most important roles IES serves is as the engine for rigorous education research across a wide array of important areas. In the spring, IES will put out its Requests for Applications (RFA) for research grants and will begin accepting proposals from researchers and research organizations.

But an entry on the Federal Register, which went live this week, is sort of a preview for the competition. For instance, it includes the competition areas for each IES research center:

  • National Center for Education Research (NCER): Education research, education research training, statistical and research methodology in education, partnerships and collaboration focused on problems of practice or policy, low-cost, short-duration evaluations, and research networks.
  • National Center for Special Education Research (NCSER): Special education research, special education research training, and low-cost, short-duration evaluations.

The Federal Register entry also includes specific topic areas where NCER and NCSER will be accepting applications in each competition area. It’s a long list and some of it will look familiar to the research world. But there are some new areas of focus. For instance, NCER has introduced three special topics in the education research competition – arts in education, career and technical education, and systemic approaches to educating highly mobile students. And NCER will be accepting applications for a new network to that will study science teaching in elementary school classrooms in an effort to improve practices and student outcomes. This is similar in structure to the Early Learning Network that was announced earlier this year.  

NCSER applicants should note that in FY 2017, only applications that focus on teachers and other instructional personnel will be considered in the special education research competition.

Other information available on Federal Register includes the approximate range of funding in each competition area, information about the process, and the expected timeline for submitting applications. In the coming weeks, IES will be updating its funding opportunities website with the full RFA information and the research centers will be hosting webinars on a variety of topics related to RFAs. You can view previous webinars on the IES website.

To be notified of important dates in the RFA process and new webinars, sign up to receive IES newsflashes or follow IES on Twitter.

This grant competition may not be as funny as the Ghostbusters reboot, as exciting as the next Captain America movie, or as thrilling as latest chapter in the Jason Bourne series. But in the research world, it’s going to be a blockbuster! 

By Dana Tofig, Communications Director, IES

Examining the workforce skills of U.S. unemployed, young, and older adults: Updated data from the PIAAC

By Stephen Provasnik and Holly Xie

Educational attainment is one of the most common measures of workforce preparation and is certainly an important indicator of whether someone is job-ready. But this one metric does not fully capture the variety of skills that can be important to potential employers. One way that NCES measures the basic workplace skills and abilities of U.S. adults is through the Program for the International Assessment of Adult Competencies (PIAAC).[1] 

PIAAC includes a number of assessments designed to evaluate real-world skills in three important areas:

  • Literacy: The literacy assessment measures the extent to which respondents can understand, evaluate, use, and engage with written text in different contexts, such as home, work, and community;
  • Numeracy: The numeracy assessment evaluates respondents’ ability to access, use, interpret and communicate mathematical information that is deemed to be important in the workplace; and
  • Problem solving in technology-rich environments: This skill area assesses respondents’ use of digital technology, communication tools, and networks to gather and evaluate information, communicate with others, and perform practical tasks.

The newly released Skills of U.S. Unemployed, Young, and Older Adults in Sharper Focus: Results from the Program for the International Assessment of Adult Competencies (PIAAC) 2012/2014 describes the workforce skill levels of unemployed adults (age 16-65), young adults (age 16-34), and older adults (age 66-74). The report, along with additional data on the NCES website, includes results from the assessments described above, as well as information about respondents’ educational background, work history, the skills they use on the job and at home, their civic engagement, and their health and well-being.

The PIAAC results show a connection between skills and employment. For instance, more than 75 percent of unemployed adults (age 16-65) had attained a high school credential or less. Roughly one-third of these adults (with a high school credential or less) scored at the lowest levels in literacy and about half scored at the lowest levels in numeracy. Overall, adults who were unemployed or out of the labor force performed worse than their employed peers in all areas of the PIAAC.


Percentage of adults age 16 to 65 at each level of proficiency on the PIAAC numeracy scale, by employment status: 2012 and 20141

1United States data are the U.S. PIAAC 2012/2014 data. PIAAC international average is calculated from the U.S. PIAAC 2012/2014 data and international data from 2012 for all other countries shown in this report. Country- and region-specific results are available at http://nces.ed.gov/surveys/piaac/results/makeselections.aspx.
SOURCE: U.S. Department of Education, National Center for Education Statistics, Program for the International Assessment of Adult Competencies (PIAAC), Skills of U.S. Unemployed, Young, and Older Adults in Sharper Focus: Results from the Program for the International Assessment of Adult Competencies (PIAAC) 2012/2014: First Look


Among young adults age 16-34, the higher the level of education completed, the larger the percentages of young adults at the highest proficiency levels in all three skill areas, and the smaller the percentages at the lowest levels. This pattern was not seen among older U.S. adults (age 66-74). Among older U.S. adults, there was no measurable difference in the percentage performing at the highest levels in literacy or numeracy between those who had a bachelor’s degree and those who had a graduate or professional degree.


Percentage of adults age 66 to 74 at each level of proficiency on the PIAAC literacy scale, by highest level of educational attainment: 2014

# Rounds to zero.
‡ Reporting standards not met. Sample size insufficient to permit a reliable estimate.
SOURCE: U.S. Department of Education, National Center for Education Statistics, Program for the International Assessment of Adult Competencies (PIAAC), Skills of U.S. Unemployed, Young, and Older Adults in Sharper Focus: Results from the Program for the International Assessment of Adult Competencies (PIAAC) 2012/2014: First Look.


Much more data can be read in the full report. Additional PIAAC data will be released later this year, including information about adults who were incarcerated.

For more information, check out this video:

 


[1] The PIAAC survey is coordinated internationally by the OECD. NCES implements PIAAC in the United States. PIAAC is a household survey administered by trained data collectors to a nationally-representative sample of adults, ages 16 through 65, in each country, in the official language(s), and in most cases, in respondents’ homes on a laptop computer. PIAAC was first conducted in 2011-2012 and results were released in October 2013 with data from 23 countries, including the United States.

The findings reported here are based on data from the first round of PIAAC and a second round conducted in 2013-2014 in the United States to collect additional data on key subgroups of the adult population. To learn more about the U.S. administration and reporting of PIAAC, as well as related data tools, see https://nces.ed.gov/surveys/piaac/.