Using Results - Chabot College

Electrifying
Learning!
Engaging Students with Online
Homework/Activities & Resources using
Mastering
Scott Hildreth
Astronomy & Physics – Chabot College – Hayward, CA
Goals for Our Session




What is Mastering to me?
How and why I use it
Getting Started
Tips, Ideas, Caveats
Your feedback & questions are
welcome throughout!
Scott Hildreth - Chabot College - October 2010
2
An Overview of Mastering

Online Homework System with 24/7 availability
But much more…




Great Range of Problems, Tutorials, Quizzes
Dynamic, context-specific hints & feedback
Rich Diagnostics by student/class
Enormous “elasticity” for use across courses
Scott Hildreth - Chabot College - October 2010
3
Let’s See the System - 1
Live example of my physics class from last
spring, showing home screen,
assignments, due dates, etc.
Scott Hildreth - Chabot College - October 2010
4
Ways I Use Mastering

Required weekly homework assignments
In-class collaborative group work
Lecture – doing problems together
Required reading quizzes & exams
Exam Preparation

Extra Credit & Remedial Help




Scott Hildreth - Chabot College - October 2010
5
Let’s See the System - 2
View of a typical assignment, and then a tutorial problem
from physics
One of the reasons I’ve found the system to be useful for
my students is the types of questions available, and in
particular, the multi-part tutorial questions with
scaffolding, hints, feedback, and graphics.
Scott Hildreth - Chabot College - October 2010
6
Scott Hildreth - Chabot College - October 2010
7
Mastering Captures Data
Scott Hildreth - Chabot College - October 2010
8
Using Results
Cannon, Annie
Einstein, Al
Fermi, Rico
Feynman, Dick
Leavitt, Henrie
Pei, I.M.
Schwarzschild,
Xi, Hua
Scott Hildreth - Chabot College - October 2010
9
Using Results
Cannon, Annie
Einstein, Al
Fermi, Rico
Feynman, Dick
Leavitt, Henrie
Pei, I.M.
Schwarzschild,
Xi, Hua
Success by student
Scott Hildreth - Chabot College - October 2010
10
Using Results
Average Time
Scott Hildreth - Chabot College - October 2010
11
Using Results
Difficulty
Scott Hildreth - Chabot College - October 2010
12
Using Results
Score by Problem
Scott Hildreth - Chabot College - October 2010
13
Getting Started!
Scott Hildreth - Chabot College - October 2010
14
Creating Courses

Each class has UNIQUE course ID
Shared with students
 Make it easier to identify your course

Change “MAHILDRETH35293”
to
 ASTRO10SPRING2011HILDRETH

Scott Hildreth - Chabot College - October 2010
15
Creating Assignments

Create a Standard HW category
Hint options, Late penalties, # Attempts, etc.
 Easy to change later


As you get comfortable…
Add categories for quizzes, remedial, EC,
 Adjust credit for hints, late work, etc.
 Try simple editor to add/delete/enhance parts

Scott Hildreth - Chabot College - October 2010
16
Using the Item Library




Sort Problems by difficulty, type, title
Customize credit based on time or difficulty
Track total estimated time & difficulty
Add messages to enhance instructions
Scott Hildreth - Chabot College - October 2010
17
Using the Item Library




Sort Problems by difficulty, type, title
Customize credit based on time or difficulty
Track total estimated time & difficulty
Add messages to enhance instructions
Scott Hildreth - Chabot College - October 2010
18
Annotating Assignments
Scott Hildreth - Chabot College - October 2010
19
Let’s See the System - 3
Quick demonstration of creating a course, and
adding assignments, and viewing an enhanced
assignment with links to YouTube
Scott Hildreth - Chabot College - October 2010
20
Tracking Student Grades
Scott Hildreth - Chabot College - October 2010
21
Gradebook Views

Overall
Scores for
every
student

Adjustable
filters
Scott Hildreth - Chabot College - October 2010
22
Gradebook Views

Assignment
Scores for
Individual
Students
Scott Hildreth - Chabot College - October 2010
23
Gradebook Views

Specific Scores on Each Problem
Scott Hildreth - Chabot College - October 2010
24
Gradebook Views

EVERY
answer given
on every
problem in
every
assignment
Scott Hildreth - Chabot College - October 2010
25
Gradebook Views

Change credit, extend due dates - instantly
Scott Hildreth - Chabot College - October 2010
26
Exporting Grades

Easy to
export all
grades to
Excel with a
couple of
clicks…
Scott Hildreth - Chabot College - October 2010
27
Let’s See the System - 4
Illustrating student results with a sample
student account in my physics and
astronomy classes.
Scott Hildreth - Chabot College - October 2010
28
Familiarity breeds
success…

Over time, you will learn to incorporate
New Tutorial Problems with effective hints
 Which problems need additional hints
 Which problems don’t work as well
 New ways to use the system for your classes
and students.


Be patient, explore, & experiment!
Scott Hildreth - Chabot College - October 2010
29
Questions? Discussion?

Check out a resource list & research
http://www.chabotcollege.edu/faculty/shildreth/mastering

Login to my classes to look around

Email me with questions!
[email protected]
Scott Hildreth - Chabot College - October 2010
30
Additional Ideas

What Results Have I Seen Personally?

What Problems Can Occur?

Caveats & Gotcha’s
Scott Hildreth - Chabot College - October 2010
31
Personal Goals
 Track
 Take
student usage easily
earlier, positive action
 Students
obviously struggling
 Those working hard, and…
 Those hardly working.
Scott Hildreth - Chabot College - October 2010
32
Personal Goals
 Minimize
faculty learning curve
use one system for both disciplines
Scott Hildreth - Chabot College - October 2010
33
Results: Astro



Trend: Increase in Retention
Similar trend in Success
Student Surveys:

90% online AND on-campus say Mastering
Astro helped them succeed.
Scott Hildreth - Chabot College - October 2010
34
Results: Physics




10% Increase in Retention over prior years
before using Mastering Physics
No major differences in student success (!)
Increase in Force Concept Inventory (FCI)
Normative Gain!?
Student Surveys:

90% say Mastering Physics is the most
important factor in their success.
Scott Hildreth - Chabot College - October 2010
35
Using Results
Scott Hildreth - Chabot College - October 2010
36
Results: Overall

Data gives me enormous power!




Time saved NOT grading gives me enormous
potential!



How long do students spend on their HW?
What do they miss?
WHY do they miss it?
Revised 20+ labs in two years
Revised every lecture
Staying connected with my students!
Scott Hildreth - Chabot College - October 2010
37
Concerns & Criticisms
Scott Hildreth - Chabot College - October 2010
38
Concerns

How much time is required to LEARN the tool
on our side…. and,

How much time away from key concepts is
really required to teach the tool to the
student?

What about teaching students to diagram
problems, or explain steps of a solution?

What about Cheating?
Scott Hildreth - Chabot College - October 2010
39
Concerns & Criticisms

“You won’t really know what they are doing wrong
without looking at paper HW”

“Some problems don’t lend themselves to computer
mediation”

“You spend too much time teaching the tool, not the
concepts.”

“The tool is too complex.”
“The grading system makes errors.”

Scott Hildreth - Chabot College - October 2010
40
Caveats, Gotchas, Gremlins
Scott Hildreth - Chabot College - October 2010
41
Caveats, Gotchas, Gremlins





Incorrect Answers can occur
Java Plug-in’s need updating
Pay attention to Units (esp. radians vs.
degrees), Significant Figures, Tolerances
Gradebook can be crowded
Using Groups requires manually entering
grades for all members.
Scott Hildreth - Chabot College - October 2010
42
Online is not for Everyone
Scott Hildreth - Chabot College - October 2010
43
But on the plus side…




More time to focus on teaching
More information to use
More flexibility than textbooks alone
More accessibility
Scott Hildreth - Chabot College - October 2010
44
Cartoons….
Images reprinted in the online presentation and available
online were borrowed with permission from "email.this.book", The Cartoon Bank, Alfred A. Knopf, NY,
1996.
Scott Hildreth - Chabot College - October 2010
45