Outcomes & Indicators:
Some Helpful Tips
Evanston Community Foundation
Grantee Orientation
June 3, 2015 | 11:00am
Susie Quern Pratt & Jenny Ellis Richards
© 2015 Pratt Richards Group
Basic Evaluation Concepts
& Terminology
© 2015 Pratt Richards Group
Basic definition
Evaluation is the systematic process of
asking questions, and then collecting and
using data to help answer those questions
in order to improve your work and tell your
story of change.
© 2015 Pratt Richards Group
Shift your thinking from…
Improving
Proving
Learning from Your Work
Grading and Scoring
Test that Follows the Work
Measures You Put in Place
Beforehand
© 2015 Pratt Richards Group
Process vs. Outcome
Process Evaluation
Outcome Evaluation
• Guiding questions
focus on the quality
and efficiency of your
programs and
initiatives
• Guiding questions focus
on the extent to which
your programs are
achieving desired
outcomes/impacts
• Focus is on the work
that you do within your
organizations (internal)
• Focus is on how your work
leads to results in the field
- with program
participants, constituents,
etc. (external)
© 2015 Pratt Richards Group
Terminology
Impact – the long-term or aggregate changes that the program
aims to produce; the desired end result.
Outcomes – the short or medium-term changes that an initiative or
program produces. Achievement of outcomes contributes to longterm impact.
Indicators - measurable approximations of what a program is trying
to achieve; quantitative data that will demonstrate progress towards
an outcome.
Strategies - the specific activities, interventions, services and/or
programs that serve a particular target audience.
© 2015 Pratt Richards Group
Evaluation Steps
1.Planning
Articulating your
intended impact
and building a
theory of change
2.Asking
Identifying key
questions about
your ToC and
designing
indicators
Planning
Learning
Asking
Tracking
© 2015 Pratt Richards Group
3.Tracking
Developing
tools (survey,
focus group,
interviews,
etc.), collecting
and
aggregating
information
4.Learning
Considering
how to use the
new insights to
learn and
improve
programs,
and tell your
story of change
Articulating Outcomes…
What are you hoping to achieve
through your program?
© 2015 Pratt Richards Group
What’s an outcome?
The short or medium-term changes that an
initiative or program produces. Achievement of
outcomes contributes to long-term impact.
© 2015 Pratt Richards Group
Where to Start
Ground your thinking about outcomes in a
larger evaluation framework,
or Theory of Change.
What is your Roadmap to Impact?
© 2015 Pratt Richards Group
Creating Your Theory of Change
Back-It-In
‣ Start with your Impact
(what you hope to see change as a result of your giving
‣ Ask…”What needs to happen before that can happen?”
(Your Outcomes)
‣ Then ask…”What needs to happen before those outcomes
can be realized?” (Your Strategies and Activities)
© 2015 Pratt Richards Group
Theory of Change Process
If we…
Then…
Which will
lead to…
Community
or social
change
If we…
Strategies
& Activities
Immediate
Outcomes
Intermediate
Outcomes
Intended
Impact
Planning:
Focus is Here
Engagement
Behavior
Attitude
Skills
Knowledge
Vision
of Success
© 2015 Pratt Richards Group
Domestic Violence Program Example
Theory of Change
If we…
Then…
Which will
lead to…
Community
or social
change
If we…
Strategies
& Activities
Immediate
Outcomes
Intermediate
Outcomes
Intended
Impact
We provide
Individual case
management,
group sessions,
etc.
Women are
engaged in our
DV programming
while at shelter
Women increase
their knowledge
about DV &
available
community
resources
Women are safe
from domestic
violence
© 2015 Pratt Richards Group
From Outcomes to Indicators…
What will you measure?
© 2015 Pratt Richards Group
What is an Indicator?
It’s the information (data) that tells you if
you are making progress toward your
desired outcomes
© 2015 Pratt Richards Group
Indicators: Key Ingredients
* Tied to Measurable Outcomes from the ToC
OUTCOME
Students will increase their
commitment to
volunteering in the
community
INDICATORS
•% of students who increase their
number of volunteer hours
•% of students who find a new
organization to volunteer with
•# of compelling stories of
effective connection to the
community
© 2015 Pratt Richards Group
Best Place to Focus Measurement:
Green Box Outcomes
The Road Map to Impact
If we….
Strategies &
Activities
Then…
Immediate
Outcomes
Which will
lead to…
Intermediate
Outcomes
Pratt Richards Group
Theory of Change Process
© 2015 Pratt Richards Group
Community
or Social
Change
Intended Impact
Indicators: Key Ingredients
* Less is more
* Make them SMART
* Measure what is within your realm of control
* Focus on both narratives &numbers
© 2015 Pratt Richards Group
More Indicator Tips...
• Staff “gut” reaction – strong emotional
response to a piece of data
• Board requests for a piece of data
• Relative consistency within a finding over 1-2
years
• Ability to benchmark against a larger
population
© 2015 Pratt Richards Group
Let’s try it!
Outcomes & Indicators Exercise
© 2015 Pratt Richards Group