Skip Navigation
IES
REL
Regional Educational
Laboratory Program
Publications
Publications & Products Search
Labs
Appalachia
Central
Mid-Atlantic
Midwest
Northeast & Islands
Northwest
Pacific
Southeast
Southwest
West
REL Lookup
REL Work in Progress
News & Events
What's New
NewsFlash
Conferences/Training
Bridge Events
Early Warning Systems Learning Series
RSS Feed
About Us
About Us
Staff
Help
Contact Us
Contact
Tools
ED.gov
Newsflash
NCEE Blog
Twitter
Facebook
Search box
REL Central
Home
About
Work
Blog
Contact
Program Evaluation Modules Toolkit
Quick Start Guide
Introduction
Module 1: Logic Models
Module 2: Evaluation Questions
Module 3: Evaluation Design
Module 4: Evaluation Samples
Module 5: Data Quality
Module 6: Data Collection
Module 7: Data Analysis
Module 8: Dissemination Approaches
Resources
Program Evaluation Toolkit
A Module Based Toolkit for Professional Development and Program Evaluation
Quick Start Guide
Introduction
1. Logic Models
Chapter 1:
What Is a Logic Model?
Chapter 2:
The Problem Statement
Chapter 3:
Resources, Activities, and Outputs
Chapter 4:
Outcomes
2. Evaluation Questions
Chapter 1: How Evaluation Questions Relate to the Logic Model
Chapter 2: How to Write Quality Evaluation Questions
Chapter 3: How to Prioritize Evaluation Questions
3. Evaluation Design
Chapter 1: Evaluation Design Options and Considerations
Chapter 2: Threats to Validity
Chapter 3: Requirements for Evidence of Effectiveness and Design Standards
4. Evaluation Samples
Chapter 1: An Introduction to Sampling
Chapter 2: Sampling Techniques
Chapter 3: Sampling Plan
5. Data Quality
Chapter 1: Data Types
Chapter 2: Data Quality Considerations
Chapter 3: Data and Evaluation Questions
6. Data Collection
Chapter 1: Interviews and Focus Groups
Chapter 2: Observations
Chapter 3: Surveys
7. Data Analysis
Chapter 1: Approaches to Data Preparation and Analysis
Chapter 2: Data Analysis Examples
Chapter 3: From Results to Interpretation to Recommendations
8. Dissemination Approaches
Chapter 1: Disseminating Your Findings
Chapter 2: Visualizing Your Data
Resources
Resources
Table of Resources
Module
Chapter Slide Decks
Handouts/Resources
1. Logic Models
Logic Models
Problem Statement
Resources, Activities, and Outputs
Outcomes
AMMP! Logic Model
Definitions of Logic Model Components
Logic Model Template
2. Evaluation Questions
Evaluation Questions
Systematic Framework
Prioritization
AMMP! Logic Model
Identifying Evaluation Questions Worksheet
Assessing Evaluation Questions
Prioritizing Evaluation Questions Worksheet
3. Evaluation Design
Evaluation Design Categories
Threats to Validity
Evidence Guidelines
AMMP! Logic Model
Evaluation Design: Matching Activity
Guiding Questions: Evidence and Standards
Evaluation Design Selection Worksheet
Non-Regulatory Guidance: Using Evidence to Strengthen Education Investments
4. Evaluation Samples
Sampling Purpose
Sampling Techniques
Sampling Plan
AMMP! Logic Model
Representative Sample Activity
The Generalizer
Summary of Sampling Types
Extra Practice with Sampling Types
Sample Size Workbook
Sample Size Workbook User’s Guide
Sampling Plan for Evaluation Questions
5. Data Quality
Data Types
Data Quality
Evaluation Questions
AMMP! Logic Model
Data Sources: Advantages and Disadvantages
Data Quality Dimensions
Data Quality Checklist
Evaluation Matrix
A Guide to Using State Longitudinal Data for Applied Research
6. Data Collection
Interviews and Focus Groups
Observations
Survey Design
AMMP! Logic Model
AMMP! Interview Protocol
AMMP! Focus Group Protocol
AMMP! Observation Protocol
AMMP! Caregiver Perception Survey
An Educator’s Guide to Questionnaire Development
Guidelines for Interviews and Focus Groups
Guide to Conducting a Needs Assessment for American Indian Students
Guidelines for Observations
Existing Observation and Survey Instruments
Ordered Response Options for Rating Scales
Interview, Focus Group, Observation, or Survey?
Data Collection Instrument Draft
7. Data Analysis
Data Preparation
Basic Analysis
Understanding Findings
AMMP! Logic Model
Guidelines for a Codebook
Common Sources of Data Errors and Error-Checking Techniques
Microsoft Excel Functions for Data Cleaning
Survey Methods for Educators: Analysis and Reporting of Survey Data/a>
Qualitative Research Methods: A Data Collector’s Field Guide
Qualitative Research
Cost Analysis: A Starter Kit
Descriptive Statistics Activity
Program Evaluation Toolkit Calculator
Program Evaluation Toolkit Calculator: User’s Guide
Inferential Statistics Activity
Qualitative Analysis Activity
Statistical Theory for the RCT-YES Software: Design-Based Causal Inference for RCTs
Evidence to Insights (e2i) Coach
Evaluation Matrix
8. Dissemination Approaches
Dissemination Plan
Data Visualization
Dissemination Plan Template
Determining the Audience
Dissemination Approaches: Pros and Cons
Media Release Template
Summary Template
Infographic Considerations
Infographic Example
Federal Plain Language Guidelines and Checking Recommendations for Plain Language
Key Considerations for Accessibility
Forum Guide to Data Visualization: A Resource for Education Agencies
Data Visualization Checklist
Last Section