UNITED WAY OF CASS COUNTY
June 8, 2012
Lisa Freeman



The importance of clarifying your “program
theory” and developing a written “logic model”
for your program(s)
How to establish a timeline and criteria for
choosing a program for outcome measurement
Ways to use the logic model in planning and
evaluating the program’s inputs and activities


The process from planning to full-scale
implementation of outcome measurement for
one program can take a full year.
Even if you are not ready to report on
outcomes, the fact that you are implementing a
measurement plan will strengthen the program.
INPUTS
ACTIVITIES
OUTPUTS
Resources
dedicated
to or
consumed
by the
program
What the
program
does with
the inputs to
fulfill its
mission
The direct
products of
program
activities
OUTCOMES
The results ,
benefits, or
changes for
program
participants
INPUTS
S
I
T
U
A
T
I
O
N
OUTPUTS
OUTCOMES-IMPACT
Activities Participation
Short
What we invest
What we do Who we reach
What the
What the
What the
short term medium term ultimate
results are results are
impact(s) is
Staff
Volunteers
Time
Money
Materials
Equipment
Technology
Partners
Workshops
Meetings
Counseling
Facilitation
Assessments
Product dev.
Media work
Recruitment
Training
Learning
Action
Conditions
Awareness
Knowledge
Attitudes
Skills
Opinions
Aspirations
Motivations
Behavior
Practice
Decisions
Policies
Social action
Social
Economic
Civic
Environmental
Participants
Customers
Citizens
Reactions
Medium
ENVIRONMENT
Influential factors
Long-term
INPUTS
Staff
OUTPUTS
Design
parent ed
curriculum
Money
Partners
Provide 6
training
sessions
Targeted
parents
attend
OUTCOMES
Parents
increase
knowledge
of child dev
Parents
learn new
ways to
discipline
Parents
use
improved
parenting
skills
Reduced
rates of
child
abuse &
neglect
Reporting progress = indicators


Indicators are data that show the degree to
which a stated outcome was achieved. They
help us to describe what success on a given
outcome would “look like.”
Indicators may be measured and reported as
lists, tables, graphs, charts, etc. This evidence
may be gathered from records, interviews,
surveys, questionnaires, instruments, observer
data, or actual measurements of some type.
Outcome: the
intended
change/action
Students gain new
skills …
Indicator: the
numerical
representation of
the outcome
% of students who
gained new skills …
Evaluation
 Increase in knowledge/skill
(post session survey)
Indicators




Actual use (follow-up
phone interview)
Decrease in rates (agency
records)


#, % parents who
increased knowledge
#, % parents who learned
new ways to discipline
#, % parents using
improved skills (specify
skills)
Decrease in rates of abuse
& neglect among families


60 percent of participants will stop smoking
while involved in the program
50 percent of participants will not return to
smoking for at least six months after the
program ends

Outcomes should be measured by as many
indicators as feasible
Source of information




Participants
Parents
Teachers
Key informants
Method of collecting the
information






Survey
Interview
Observation
End-of-program questionnaire
Focus group
Records
What is the outcome
and indicator? See
UWCC Investment
Framework
What methods will
you use to collect
data? What are the
sources?
How will data be
analyzed and
interpreted? Does
the data match
outcome?
How will results be
shared; to whom,
when, where? Who
will be responsible?
People gain the skills
necessary to increase
their financial wellbeing (outcome)
•Percentage of
people who
demonstrate an
increase in financial
management skills
•Percentage of
people increase
income/savings
•Percentage of
people who reduce
their debt by 50%
1. Use Survey
Monkey after the
program to gauge
satisfaction
Program staff will
maintain files with
financial records
Survey results will be
used in grants and
annual report to show
effectiveness of
Money Wise
Workshop
2. Get financial
records, bank
statement, etc.
3. Use a pre- and
post- test to see
gained knowledge
and understanding of
financial mgt.
Track client progress
to measure financial
well-being

Logic of the “logic model”
Outcomes vs. Indicators
Methods for measuring success
Reporting process

Help is available!


