Enhancing Learning by
Improving Process Skills
in STEM
Developing Materials to Assess Process Skills in an Active Learning Classroom
1
2
3
Suzanne M. Ruder , Renee S. Cole and Juliette Lantz
1 Virginia Commonwealth University, 2University of Iowa, 3Drew University
ELIPSS Project Overview
Student
Interaction
Rubrics
Implementation
Guide
ELIPSS Strategy for Cohesive Development
Student Interaction Rubrics
Process skills are frequently cited as critical components of a successful
education. Assessing process skill development and providing feedback to
students and instructors is a key component for enhancing these skills in
STEM programs. This project involves the development of resources to
provide feedback to students, and to inform instructors as to the
effectiveness of their instructional strategies in supporting process skill
development. This feedback may ultimately result in increasing adoption of
evidence-based pedagogical strategies that foster process skill development.
IUSE Collaborative grant:
#1524965
#1524936
#1524399
Designed to use during
group work in the
classroom, to observe
process skills in action.
Student
Product
Rubrics
Workshops
Student Product Rubrics
Targeted Process Skills and Definitions
Skill
A
Assessment
(Self & Peer)
Definition
Summary
• Refinement of process skill definitions aided in development of
rubrics that are applicable to a broad STEM audience
• Primary Collaboration Team assembled for continuing rubric
testing for reliability, validity and utility
• Materials Developed:
IP
IP
TW
PS
• Student interaction
PS
CT
VALIDITY
rubrics (4 + 2 drafts)
Student
Student
RELIABILITY
CT
• Student product
Interaction
Product
UTILITY
Rubrics
Rubrics
rubrics (1 + 2 drafts)
Appropriate Tasks
Designed to use on student
written work (projects, quizzes,
exams, lab reports) to assess
process skills.
Gathering information and reflecting on experiences to improve
subsequent learning and performance.
Oral - Exchanging information and understanding through
speaking, listening and non-verbal behaviors.
OC
Communication Written - Conveying information and understanding to an intended
WC
audience through written materials (paper, electronic, etc.)
Analyzing, evaluating or synthesizing relevant information to form
CT Critical Thinking an argument or reach a conclusion supported with evidence.
IP
Information
Processing
Evaluating, interpreting, manipulating or transforming information
Planning, organizing, directing and coordinating one’s own and
M
Management
others’ efforts to accomplish a goal.
Thinking/reflecting about one’s thinking and how one learns, and
MC Metacognition
being aware of one’s knowledge.
Identifying, planning and executing a strategy that goes beyond
PS Problem Solving
routine action to find a solution to a situation or question.
Interacting with others and building on each other’s individual
TW
Teamwork
strengths and skills, working towards a common goal.
Rubric Design Process - an Iterative Approach
•
•
•
•
•
•
Problem Solving
Critical Thinking
Information Processing
Written Communication
Assessment
Metacognition
Robust Process to Establish Validity and Reliability
Reliability
Generalizability
Data currently
being gathered at
11 institutions.
• Workshop piloted – “Enhancing Learning by Assessing Process
Skills: Group Interaction Rubrics”
Primary Collaboration Team
Construct Validity
Generate
“anchor”
examples
M
ELIPSS Project Team
Face Validity
Construct
preliminary
rubric
OC
Utility
• Do rubric descriptors look appropriate?
• Does rubric measure what it is intended to
measure?
• Can different people use rubric to get
consistent results?
• Can rubric be used in multiple disciplines,
environments, and student populations?
• Can the rubric be used effectively by
instructors and students?
Tested with STEM faculty in:
Biology
Chemistry
Computer Science
Engineering
Environmental Science
Mathematics
•
•
•
•
•
•
•
•
Chris Bauer, Chemistry
Teresa Bixby, Chemistry
Patrick Brown, Biology
Caryl Fish, Chemistry/Environ.
Jill Guerra, Math
Stanley Lo, Biology
Chris Mayfield, Computer Science
Eunice Yang, Engineering
Graduate Students
• Jennifer Schmidt-McCormack
• Gilbert Reynders
Interested in using the rubrics go to:
https://goo.gl/Vi925q
Look for future website at ELIPSS.com