Tools to Assess Cognitive Outcomes
of Service-Learning and Civic
Engagement (UMCES, 2016)
Peggy Fitch, Ph.D. Vice President for Student
Development & Professor of Psychology, Central
College
[email protected]
Pamela Steinke, Ph.D., Dean of Teaching &
Learning Outcomes, University of St. Francis
[email protected]
Learning Outcomes
• Identify strengths and
appropriate uses of the P-SAP
and CLS.
• Specify how to score and analyze
data from the two instruments.
• Identify ways to use the
instruments on your home
campus.
Session Outline
• Problem-Solving Analysis
Protocol (P-SAP)
• Coding with Global Rubrics
• Adapting the P-SAP
• Cognitive Learning Scale (CLS)
• Uses on your campus for
research & assessment
• Closing comments
For more information on the
Problem-Solving Analysis
Protocol and Cognitive
Learning Scale go to:
http://departments.central.edu/
psychology/faculty/psap/
Problem-Solving Analysis Protocol (P-SAP):
• assesses application of content
knowledge to “real world” problems
• based on Eyler and Giles’ (1999) work on
cognitive outcomes of service-learning
• issues adapted to fit course content (see
P-SAP Questions & Issues handout)
• can be integrated into course exercises,
assignments and exams
• good inter-rater reliability and construct
validity with intellectual development
and cognitive learning measures (see PSAP website for HLC paper)
Coding the P-SAP
• Global Rubrics (see handout) code
analysis of problems and solutions
for:
• Locus
• Complexity
• Coding Examples (see handout PSAP Examples A and B)
Coding the P-SAP
• Coding exercise in pairs (see
handout P-SAP Coding Samples)
• Individually (5 min)
• Partners
Sample A-1
Sample B-1
Sample A-2
Sample B-2
Adapting and Using the P-SAP
• Integrating the P-SAP into
courses/programs
• Recommendations for adapting
problems on the P-SAP (see
Questions & Issues and P-SAP
Template handouts)
• Application on home campus
Cognitive Learning Scale (CLS)
• Measures self-report of application
and depth of knowledge (see
Cognitive Learning Scale handout)
• Pre-post versions allow comparisons
• Application on home campus
Uses of P-SAP and CLS for
Research & Assessment
• For research?
• questions
• designs
• For assessment to improve servicelearning practice?
• courses
• programs
Closing Comments
• Clearly define research questions and
learning outcomes (e.g., problem
solving, critical thinking, intellectual
development), then find measures that
fit best.
• Adapt P-SAP to fit your needs.
• Can use P-SAP and CLS free of charge for
assessment; ask that you let us know
how you are using the instruments.
• Questions/comments/additional ideas
for use on home campus?
For More Information…
Contact us:
[email protected]
[email protected]
Go to website:
http://departments.central.edu/
psychology/faculty/psap/