Program Outcomes &
Logic Models
United Way of Blair County
February 6, 2013
Presented by: Robin Beck, CPO, United Way of Blair County
What is Outcome Measurement?
Outcome measurement is a process
for the ongoing monitoring of the
results of an organization or program
against agreed upon goals and
objectives
Community Impact Training
2
Why Measure Outcomes?
•To see if programs really make a difference in the
lives of people.
•To help programs improve services.
•To provide a clear definition of the programs
work.
•To improve effectiveness in helping clients.
•Target services for growth and expansion.
Community Impact Training
3
Program Outcome Model
A flow chart which depicts the logical
relationship between program activities
and the changes expected to occur as a
result of these activities.
IF—THEN, IF—THEN, IF—THEN
Community Impact Conference
4
Key Terms
Input:
A resource dedicated to or consumed by a program
Activity:
Type of service the program provides to fulfill its mission.
What the program does with the inputs—how it goes about
transforming them into products.
Output:
The direct product of program operation.
Outcome:
Benefit to participants during or after participating in the
program.
Indicator:
Identifies what is being measured to track the program’s
success on an outcome. Indicators are specific and measureable
pieces of information that show the outcome is occurring. They will
be shown as aggregate data gathered on a group of individuals.
Target:
The desired level of achievement of a program on its indicators
Community Impact Conference
5
Program Outcome Model
INPUTS
ACTIVITES
OUTPUTS
OUTCOMES
Resources
Services
Products
Benefits for People
money
shelter
classes taught
New knowledge
staff
training
volunteers
Increased skills
education
counseling sessions
conducted
equipment & supplies
counseling
Constraints
mentoring
educational materials
distributed
laws
hours of service
delivered
regulations
participants served
funder requirements
Community Impact Training
Changed attitudes
or values
Modified behavior
Improved
condition
Altered status
6
Levels of Outcomes
Immediate Outcomes
First benefits or changes
participants experience
Intermediate Outcomes
Link initial changes to longerterm outcomes
Long-Term Outcomes
Ultimate outcome a program
desires for participants
Community Impact Training
7
Keep Expectations Modest
Outcome findings will not tell you:
1. Whether the program caused the
outcome
2. Why this level of outcome was achieved
3. What actions can be taken to improve the
outcome
Community Impact Training
8
Outcome Indicator
• The specific item of information that tracks a
program’s success on an outcome
• Identifies the characteristic or change that
signals that an outcome has been achieved
• Is observable and measurable
• Usually is expressed as number and percent
of participants achieving the outcome
Community Impact Training
9
Program Outcome Criteria
For each outcome:
Is it reasonable to think the program can influence the outcome in a non-trivial way,
even though it can’t control it?
Would measurement of the outcome help identify program successes and pinpoint
problems?
Will the program’s various “publics” accept this as a valid outcome of the program?
For the set of outcomes:
Do they reflect the program logic—the chain of changes program outputs are
intended to set in motion for participants?
Do the longer-term outcomes represent meaningful benefits or changes in
participants’ condition or quality of life
Are potential negative outcomes identified?
Community Impact Training
10
Issues in Defining Outcomes
•There is not a right number of outcomes for a program
•Some programs may have more than one “outcome track”
•For some programs, initial outcomes may be closer to
outputs
•The more immediate the outcome, the more influence the
program has on its achievements
•The longer the outcome, the less direct the influence a
program has on the outcome and the more chance an
outside influence can be involved
•A program’s outcomes should not go beyond the scope of
its target audience
Community Impact Training
11
Program Outcomes vs.
Community Outcomes
Program Outcomes: Changes that program
activities intend to create in program participants
Community Outcomes: Changes in a defined
community population brought about by changing
conditions in the community
Community Impact Training
12
Program to Community Outcomes
How do program outcomes relate
to community outcomes and
community level change?
Community Impact Conference
13
Program to Community Outcomes
Some early assumptions that were made:
•Funding programs with good outcomes will
produce community outcomes
•Funding programs whose outcomes align with
community goals will produce community outcomes
•Aggregating program outcome data will provide
community outcome data
Community Impact Training
14
Community Outcomes Focused on by
United Way of Blair County
Education: “We envision a Blair County where children and
youth achieve their potential.”
Health: “We envision a Blair County where young and old
alike are physically and mentally healthy.”
Income: “We envision a Blair County where individuals and
families attain financial stability and independence.”
Meeting Emergency Needs: “We envision a Blair County
where there is a safety net for those experiencing
emergencies.”
Community Impact Conference
15
Questions and Answers
Community Impact Training
16