Welcome!
Student Evaluation: Requirements for evaluation and strategies for
ethically engaging with students about evaluation
Date: 20 April
Time: 10.10 to 12 PM
Room: P2-26 (SEU at City East)
Student Evaluation
Agenda
Administrative side of MCE
Help ……Mycourseexperience
also
Other things you can do…
Not: “Dealing with feedback”
Starting points
• Know its not a perfect tool
• Whole heap or language eg ‘student satisfaction’…doesn’t help
• Response rates are low…..heap of arguments about which students
respond…
• Yet it carries significance
Just for interest
Brief History
Used to be two ..still hear this terminology
• SET………. Student Evaluation of Teaching
• Voluntary
• Only you could ‘see’
• CEI ……….Course Evaluation Instrument
• Rule: every course must be evaluated each time it is run ……usually but not always
meant a CEI……problem
• Response rates low…too many questions and too many instruments
• MyCourseExperience was born: started with 7 questions now there are 13
Administration side of things: use the formal “Help Page”
Found through
http://i.unisa.edu.au/staff/teaching-innovation-unit
Teaching technologies
Direct link
http://i.unisa.edu.au/staff/teaching-innovation-unit/teaching/teaching-technologies/mycourseexperience/
Big Points
• The system creates both sets (Course and Teacher) evaluation questions at the beginning of the study
period (Not released…created)
• If the CC doesn’t ‘do’ anything it opens 30 days before the end of the SP
• Will close LAST day of the study period
• BUT these dates can be changed by the CC….must be open for a minimum of 1 week
Teacher evaluations ..Automatically established for all staff associated with the course
• Can be ‘deactivated’
• Should not be deactivated without the permission of the teacher being evaluated
Note 1: Deactivation is not possible if responses have been submitted. A Head of School request for
evaluation deletion must be logged with the Help Desk.
Note 2: All deactivations are logged and a report to Heads of School can be generated on request.
Timing
Action
Trigger
Evaluations open date
End of study period minus 30 days
Email invitation to Course Coordinator to select optional
questions
14 Days before evaluation open date
Email reminder 1 to Course Coordinator if no optional
questions are selected
11 Days before evaluation open date
Email reminder 2 to Course Coordinator if no optional
questions are selected
8 Days before evaluation open date
Question selection ends
When the first response is received
Email invitation to students to complete evaluation
Evaluation open date
First student reminder email
3 Days after the evaluation open date
Second student reminder email
7 days after the evaluation open date
Evaluation close
Last day of the study period
Core Course Questions
Overall, I was satisfied with the quality of this course.
I have a clear idea of what is expected of me in this course.
The assessment items assisted my learning in this course
I have received feedback that is constructive and helpful.
The learnonline course site resources were of a high quality.
Overall, what are the strengths of this course?
Are there any ways this course could be improved?
Core Teacher Questions
Overall, I was satisfied with the performance of the staff member.
The staff member supported my learning.
The staff member helped me to understand key concepts of the course.
The staff member helped to make the course interesting.
What were the best aspects of this staff member’s teaching?
How could this staff member improve their teaching?
Who can view
Head of School access
The Head of School Access page provides real-time myCourseExperience course and teacher evaluation data for Heads
of School.
•Course evaluation results for all offerings in the selected study period
•Teacher evaluations for all teaching staff associated with the course in the selected study period
The Teacher Search result provides
•Teacher evaluation results for the nominated teacher in the selected study period
•Course evaluation results for all courses associated with the teacher in the selected study period
Who can view?
The theory is anyone in a direct line above you
Course Coordinators can view:
• Course evaluation responses
• Teacher evaluation responses for instructors in their course teaching team only
Instructors can view:
•Responses for their own teacher evaluations only
Heads of School, Deans Teaching & Learning and Divisional Pro Vice Chancellors can access teacher evaluation
data using resources in the Restricted Student Evaluation of Teaching Folder in BI Reporting.
Program Directors can request reports through their Head of School who will lodge a VIP Request with
Business Intelligence and Planning.
The Maths
Strongly disagree
-100
Disagree
-50
Neutral
0
Agree
50
Strongly agree
100
So a score of 50 means every last student agreed
I find it odd that a score of 50 represents 100% approval
That was the admin part
Questions so far?
• A34 access to students and staff
• Assessment
GPA
Other forms of evaluation
• Retention rates
• Interview teaching staff
• Peer Partnerships
• Don’t forget…Discipline context
Focus groups with students
Strategies for mycourseexperience
Why do we wait till the end? If a student is failing there should be no shock
Same for us..we should know
We wouldn’t wait till the end if it was our research
Problem with asking direct questions…Power imbalance..
Strategy 1: Establish a weekly feedback related to THEM ..Self assessment
Strategy 2: Define the questions..establish meaning and connect to learning
Strategy 3: Exit questions
Creating opportunities to allow students to signal there is a problem: if its
formative assessment then its likely to work
Other examples
So what is a good score?