Summer Program Support Tool Kit: Volume 2

This volume of the Evaluation Support Toolkit was developed by Anita Baker Ed.D. of Evaluation Services, with input from service providers and Foundation staff. This new volume provides additional resources that can help staff structure appropriate outcomes, and many data collection tools (e.g., more surveys, field-tested observation and interview questions, record review strategies for tracking program attendance) that can be easily adapted for summer program evaluations. This second volume of the Toolkit complements Volume 1, to help program staff as they collect data to evaluate academic outcomes, especially for short-term programs where some skills can be difficult to measure.

We have updated and expanded the resources on preventing summer learning loss with the most up-to-date thinking on that topic. There are also new resources to help program staff consider more fully the data they collect, whether they seek feedback from participants, from stakeholders, or from families.

We invite you to review this addition to the Tool Kit and to use it as you develop evaluation plans to improve programs. 


*Topics Key

1 Assessing Academic Support
2 Preventing Summer Learning Loss
3 Evaluation Techniques for Short-Term Programs
4 Hard to Measure Skills
5 Parent Feedback
6 Analyzing Written Journal Content
7 Staff Observations
8 Focus Groups
9 Clarifying Outcomes
10 Analyzing Data
11 Identifying Indicators
12 Setting Targets
13 Getting Help with Evaluation
14 Miscellaneous


 TitleContent Topics* 
Strategic Data Use for Afterschool and Summer Programs (PDF 179KB)
  • Basic data definitions (qualitative/quantitative)
  • Sources of data (school, survey, program)
  • Planning for strategic data use
  • Tips for analyzing data (terminology)
  • Examples of analyzed data
 1, 10
Outcomes Based Planning and Evaluation Data Collection (PDF 222KB)
  • Logical thinking
  • Outcomes, indicators, targets
  • Collection of data (basics on surveys, interviews, observation,
    record reviews)
 4, 10, 11, 12
Commissioning Evaluation, NPO Tips (PDF 722KB)
  • What to look for in evaluators
  • Questions to ask evaluators
  • Resources for finding evaluators
  • Differences between a RFP and a RFQ
 IMPORTANT LINKS  1, 4, 5, 7, 9, 10, 11, 12, 13
Updated Research on Summer Learning (PDF 169KB) Brief literature review on the newest and seminal research on summer learning with links to specific publications  2
Participatory Evaluation Essentials: An Updated Guide for Nonprofit Organizations and Their Evaluation Partners (PDF 2.2MB) Evaluation design, evaluation questions, collecting evaluation data, evaluation data analysis, budgeting for evaluation, predicting timelines, evaluation reporting  13
After School Evaluation 101 (PDF 907KB) Evaluation Purpose, Logic Models, Assessing Capacity for Evaluation, Choosing Evaluation Focuses, Selecting Designs, Collecting Data, Analyzing Data, Presenting Results, Using Data, APPENDIX A – Resources, links to tools and other reports  1, 13
ASI Tool Kit for Evaluating Positive Youth Development (PDF 2.3MB) Academic Success, Arts and Recreation, Community Involvement, Cultural Competency, Life Skills, Positive Core Values, Positive Life Choices, Sense of Self.  1, 4
Out of School Time Program Evaluation: Tools for Action (PDF 871KB) Excellent collection of tools and examples of use and analysis, very straightforward presentation. Students, parents, staff, classroom teachers 5, 7, 8, 10, 13
Afterschool Youth Outcomes Inventory (PDF 933KB) Identifies a full realm of outcomes for youth and presents them in clear accessible language. Presents outcomes, indicators, tools and links. Includes: Social and Emotional; Academic Outcomes; College and Work Readiness, Health and Wellness  1, 4, 5, 9
Summer Learning Guide (PDF 5.9MB) Summer learning loss, quality summer programs, different models, attending to learning, supporting literacy, math and science, field trips, learning, staff, assessments, connections to school year. Resources including quick math and literacy activities, reproducible sheets.  1, 2, 3, 5, 7
Documenting Service Delivery (PDF 60KB) Protocol and advice to collect data about implementation 14
Evaluation Bibliography (PDF 50KB) List of references and websites with accessible information about evaluation 13
Focus Groups (PDF 139KB) General directions for conducting focus groups 8, 13
Getting Info from Parents (PDF 154KB) Suggestions for how and when to survey parents, also important reminders to increase usefulness 5
Making Data Collection Decisions (PDF 161KB) Distinguishes between surveys, interviews, observations and record reviews in terms of reliability, cost, benefits, challenges, cultural appropriateness, etc. 13
Outcomes, Indicators and Targets (PDF 111KB) Definitions and cautions 9, 11, 13
Sample Size (PDF 149KB) Explanation of how to draw a sample for SURVEY DATA, with statistical chart 1, 3, 4, 5, 13
Anything where surveys are used
Suggestions for Effective Interviewing (PDF 110KB) List of strategies to improve interviewing for evaluation 13
Survey Administration Plan (PDF 8KB) Things to think about before administering a survey 1, 3, 4, 5, 13
Anything where surveys are used
Survey Questionnaire Development and Assessment (PDF 124KB) Tips for developing good surveys 1, 3, 4, 5, 13
Anything where surveys are used
Useful Evaluation Terms (PDF 86KB) Glossary of important terms 3, 5, 8, 9, 11, 12, 13
Where Does the Money Come From? (PDF 20KB) How to get funding for evaluation, explanation of evaluation cost items 13
Back to Top