LOGIC MODEL: A Program
Performance Framework
New Educator Orientation
April 26, 2011
Oklahoma State University
Stillwater, OK
New Educator Thought for the
Day
“People don’t care how much you know
until they know how much you care.”
» Unknown
This will serve you well as you begin your
career in Extension
OCES Program Planning
• OCES works within broad program
guidelines.
– Long Range Plan of Work
• Rolling Plan of Work
– Typically 3 years or more, but is flexible
– Short term Planning to Accomplish Longer
Term Goals
• Annual Implementation Timeline
– This is your roadmap
Just What Is A LOGIC Model?
• The program logic model is defined as:
– A picture of how our organization does its
work—the theory and assumptions underlying
the program. A program logic model links
outcomes (both short- & long-term) with
program activities/processes and the
theoretical assumptions/principles of the
program.
What is a Logic Model?
• A simplified picture of a program, initiative or intervention in
response to a given situation.
• Shows the logical relationships among the resources that are
invested, the activities that take place and the benefits or changes
that result.
– Some call this ‘program theory’
• Logic modeling is really a way of thinking!
• A bridge between where you are and
where you want to be with your programs.
What is a Logic Model?
• A systematic and visual way (road map) to
present and share your understanding of the
relationships among:
– Resources you have to operate your program
– The activities you plan to do
– The changes or results you hope to achieve
– It’s a map of how you think your
program will work from start to
finish.
LOGIC
• If you don’t know where you’re going, how
are you gonna’ know when you get there?
– Yogi Berra
Brief History
• Logic Models Aren’t New
– Date back to the 1970s
• Suchman (1967), Weiss (1973, Bennett (1976), others
• Used Many Places:
– Private Sector
• TQM
– Public Sector
• Govt. Performance Results Act 1993
– Set Standards for Measuring Performance
– Non-Profit Sector
• United Way
– International Donor Agencies
– Evaluators
Goals for Today
• Learn about LOGIC Models
– A basic introduction to the logic model as an
action-oriented tool for program planning and
evaluation
• Practical Applications of LOGIC Models in
your programs
WHY LOGIC MODELS?
• Shows difference
•
•
between what we do
and impact we are
having
Provides a common
vocabulary
Focus on quality and
continuous
improvement
Logic Model
Common
Vocabulary
S
I
T
U
A
T
I
O
N
INPUTS
OUTPUTS
OUTCOMES
Government reports, OCES reports, Grant applications
Everyday Logic Model
H
E
A
D
A
C
H
E
Get pills
Take pills
Logical progression, common sense
Feel better
Everyday Logic Model
H
U
N
G
E
R
Find Food
Eat Food
Logical progression, common sense
Feel better
Logic Model
• OCES Logic Models will be somewhat
more complicated, but remembering the
simple examples should keep them from
becoming overwhelming or intimidating.
An Extension Example: Healthy
Eating for Oklahoma Youth
Extension invests time and resources
A variety of educational activities are
provided to youth who participate
(outputs)
These owners gain knowledge
and change practices resulting in
improved nutrition and better
long-term health. (outcomes)
Value to Society??
Another Example
• Situation: Cattle Stocking Rates are generally considered too great
for the carrying capacity of the land, resulting in weed encroachment
and poor cattle performance.
• Outputs: A series of educational programs regarding determining
and implementing appropriate stocking rates is developed,
marketed, promoted, delivered, and evaluated.
• Outcome: Stocking rates are reduced to the carrying capacity of
the land, resulting in better cattle performance and increased
potential for profit.
– Value to Society??
INPUTS
Faculty
Staff
Money
Time
Volunteers
Partners
Equipment
Technology
OUTPUTS
What we do
ACTIVITIES
Workshops
Counseling(Consulting??)
On-farm research
Facilitation
Product development
Curriculum design
Trainings
Field days
Conferences
Media
Who we reach
PARTICIPATION
Participants
Clients
Customers
Users
LOGIC MODEL: Program
Performance
INPUTS
Program
investments
What we
invest
OUTPUTS
Activities
Participation
What we
do
Who we
reach
OUTCOMES
Short
Medium
What results
Longterm
IF : THEN
• The IF:THEN relationship provides
for the development of the LOGIC
MODEL.
• The Logic MODEL is important to
OCES because our current( 07-11)
federal Plan of Work is designed
around it.
• So…Logic tells us the Logic Model is
important at the local level.
Logical Linkages:
Series of If-Then Relationships
IF
THEN
OCES
invests time
&
money
INPUTS
IF
THEN
Resource
inventory
can be
developed
OUTPUT
IF
THEN
Clients
will know
what is
available
IF
Clients
will access
services
OUTCOMES
– What is the Value to All Society??
THEN
Clients
will have
needs met
IF : THEN
• “IF: the purpose of youth groups is to
develop leadership and citizenship
skills (Wylie, 1990), and
• IF: we know that skills developed in
one’s youth carry into adulthood
(Ladewig & Thomas, 1987),
• THEN: youth leadership
organizations should be able to
document how their alumni are
impacting the communities in which
they reside…” (Pennington &
Edwards, 2004)
LOGIC MODEL: Program Performance Framework
INPUTS
S
I
T
U
A
T
I
O
N
OUTPUTS
OUTCOMES-IMPACT
Activities Participation
Short
What we invest
What we do Who we reach
What the
What the
What the
short term medium term ultimate
results are results are
impact(s) is
Staff
Volunteers
Time
Money
Materials
Equipment
Technology
Partners
Workshops
Meetings
Counseling
Facilitation
Assessments
Product dev.
Media work
Recruitment
Training
Learning
Action
Conditions
Awareness
Knowledge
Attitudes
Skills
Opinions
Aspirations
Motivations
Behavior
Practice
Decisions
Policies
Social action
Social
Economic
Civic
Environmental
Participants
Customers
Citizens
Reactions
Medium
ENVIRONMENT
Influential factors
Long-term
Environment–Influential Factors
• Extension program does not exist in a vacuum
(other educational sources)
• Context of the program (other sources of
behavior changes)
– politics, family circumstances, cultural milieu,
demographics, economics, values, biophysical
environment, policies, services
• What affects the program over which you have
little control?
Do the Outcomes First
• I definitely advocate doing the outcomes
first! I find that people come up with much
more effective activities when they do.
Use the motto, “ plan backward,
implement forward.”
– Beverly Anderson Parsons, WKKF Cluster Evaluator
PLANNING
INPUTS
Programmatic
investments
OUTPUTS
Activities
Participation
OUTCOMES
Short
i
Implement and Evaluate
Medium Long
term
Outcomes
• Are they Important?
• Are they Reasonable?
• Are they Realistic?
• Are there Negative Consequences?
S.M.A.R.T.
• Specific
• Measurable
• Attainable
• Realistic
• Timed
INPUTS
Staff
OUTPUTS
Develop
parent ed
curriculum
Targeted
Money
OUTCOMES
Parents
increase
knowledge
of child
dev
parents
Partners
Research
Deliver 6
interactive
sessions
attend
Parents
learn new
ways to
discipline
Parents
use
improved
parenting
skills
Reduced
rates of
child
abuse &
neglect
INDICATORS???
Progressive Outcome
Relationships
SHORT
MEDIUM
LONG-TERM
Seniors increase
knowledge of food
contamination risks
Practice safe cooling of
food; food preparation
guidelines
Lowered incidence of food
borne illness
Participants increase
Establish financial goals, Reduced debt and
knowledge and skills in use spending plan
increased savings
financial management
Community increases
understanding of
childcare needs
Residents and employers Child care needs are met
discuss options and
implement a plan
Empty inner city parking Youth and adults learn
Money saved, nutrition
lot converted to
gardening skills, nutrition, improved, residents enjoy
community garden
food preparation and mgt. greater sense of
community
Logic model with Indicators for Outputs
and Outcomes
Outputs
Outcomes
Program
implemented
Number of
workshops
held
Targeted
farmers
Number and
percent of
farmers
attending
Farmers learn
Number and
percent who
learned content
Farmers
practice new
techniques
Number and
percent who
adopted
practices
Farm
profitability
increases
Number and
percent show
improved farm
profits; amount
of increase
Where Does Evaluation Fit?
INPUTS
Staff
OUTPUTS
Design
parent ed
curriculum
Targeted
Money
Partners
OUTCOMES
Parents
increase
knowledge
of child dev
parents
Provide 6
training
sessions
attend
Parents
learn new
ways to
discipline
Parents
use
improved
parenting
skills
Reduced
rates of
child
abuse &
neglect
EVALUATION: What do you want to know? How will you know it?
Quality of
curriculum
# of sessions
delivered
# parents
attending/session
which parents
% of parents
Increase in
knowledge/skill
- post session
survey
Actual use
- follow-up
phone
interview
Decrease
in rates
- agency
records
Last Slide
• View evaluation as learning - integrate into the
way we work
• Build evaluation in upfront
• Ask ‘tough questions’
• Make measurement meaningful
• Be accountable for highest professional
standards
Summary
• Think of the Logic Model as Your
“Roadmap”
– Provides a graphic description of a program
(process, event, community initiative)
– Shows the relationship of program inputs and
outputs to expected results (outcomes)
– Makes explicit the underlying theory of a
program
Summary
• Made up of six components:
– Situation
– Inputs
– Outputs
– Outcomes
– Assumptions
– External Factors
Logic Model Websites
• http://www.uwex.edu/ces/lmcourse/
• http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf
• http://www.uidaho.edu/extension/LogicModel.pdf
• Or goto google.com, search for “logic model program evaluation”
• Be aggressive in your programming
– Establish needs early on
• Recognize things change
• Extension must be flexible
– Be a risk taker
– Utilize volunteers
New Educator Thought for the
Day
• “People don’t care how much you know
until they know how much you care.”
» Unknown
• This will serve you well as you begin your
career in Extension
Last Slide, Really!!
• Questions?