Teaching for
Retention
Promoting
Promoting Student
Student Learning
Learning
through
through Course
Course Design
Design with
with Early
Early
Identification
Identification &
& Intervention
Intervention
John
John F
F Kremer
Kremer –– Psychology
Psychology
Kate
Kate A
A Thedwall
Thedwall –– Gateway
Gateway
Kenneth
Kenneth EA
EA Wendeln
Wendeln –– Business
Business
IUPUI Gateway to Graduation
©2009
Gateway to Graduation
 7 Year Retention Initiative




~50 Gateway Courses
~23,500 Course Grades
Advisory Board
Course Coordinators
Current Focus:
Early Identification
and Active Intervention
IUPUI Gateway to Graduation
2
Gateway Courses
DFW Trends
All Gateway DFW%
Semester
Total # of Grades
29.2%
Fall 07
#22376
31.5%
Fall 06
#23041
32.1%
Fall 05
#23345
Fall 04
31.5%
#24124
31.1%
Fall 03
#24091
29.7%
Fall 02
0%
#24089
5%
10%
IUPUI Gateway to Graduation
15%
20%
25%
30%
Source: KEAW Analysis
of IUPUI DFW Reports
35%
3
Gateway Courses
DFW Trends - FTFT Students
Semester
FTFT Only DFW
All Gateway DFW%
and % of Total Grades
Total # of Grades
6.8% Δ
Fall 07
29.2%
22.7% DFW
#22376
39% of Grades
Fall 06
31.5%
25.1% DFW
#23041
35% of Grades
Fall 05
32.1%
26.0% DFW
#23345
34% of Grades
Fall 04
31.5%
24.6% DFW
#24124
32% of Grades
Fall 02
0%
31.1%
22.9% DFW
Fall 03
32% of Grades
#24091
22.8% DFW
29.7%
#24089
30% of Grades
5%
10%
IUPUI Gateway to Graduation
15%
20%
25%
30%
Source: KEAW Analysis
of IUPUI DFW Reports
35%
4
Gateway Courses
Fall 2007 DFW
by
Department
MATH #4287
ANTH #585
LEARN COMM #2622
SOC #695
45
40
35
30
25
20
15
10
5
0
PSY #1566
PHIL #540
BIOL #1029

Gateway #22376
CHEM #1279
# Grades
COMM #1510
BUS #1766
HIST #1599 ENG #2425
IUPUI Gateway to Graduation
Fall 07 ALL
Fall 07 FTFT
Source: KEAW Analysis
of IUPUI DFW Reports
5
Gateway Courses
DFW Trend
by
Department
MATH #4428
ANTH #580
LEARN COMM #2291
SOC #914
50
45
40
35
30
25
20
15
10
5
0
PSY #1860
PHIL #658
# Grades
Fall 02-07
Average
BIOL #1078

Gateway #23511
CHEM #1179
Fall
Fall
Fall
Fall
BUS #1914
Fall
Fall
COMM #1504
HIST #1713 ENG #2599
IUPUI Gateway to Graduation
Source: KEAW Analysis
of IUPUI DFW Reports
6
07
06
05
04
03
02
The Student Experience
Fa
ct
or
s
e
tiv
to
ac
lF
rs
Co
gn
i
ng
s
i
y
e
n
c
su ga ear
s
l I l Le rd L und
a
i
c
na wa gro
n
o
o
k
ti
na
Fi uca e T Bac
lls lls
d s
i
d
u
k
E t it
S Ski ers
ou
t
i
g
A lig ity
in ion Oth
p
e
r
R tu Co at rd
c
a
Ma cial uni ow s
e
So mm e T alu
d
nt
Co titu al V ns
e
o
At ltur tati mitmnce
Cu pec om lue e
f
Ex al C In enc le
y
Go mil nflu sty
Fa er I Life
Pe cial
So
cia
So
Qu Ac
al ad
ity em
of
ic
Le R i
g
Ap arn or
C
i
Cr
iti Kn ont titu ng
ca o en de
Te
l-T wl t
ch
hi edg of
no
n
lo
Ab kin e
g
y
S
Ti
L
g
m ea tud Ab ility
il
Ac e M rni y
ad an ng Sk ity
Ex em ag Sk ills
tr ic- em ills
ac r
ur ela ent
Ac ric te
tiv ul d
iti ar
es
Institutional Factors
Recruitment &
Academic Services
Admissions
Student Services
Financial Aid
Curriculum & Instruction
IUPUI Gateway to Graduation
Source: Studentretention.Org
7
Using Learning AND Motivation
To Improve Curriculum for Retention
High
Learning
•
•
•
•
Cognitive
Skills
Assessment
etc …..
e
tiv
c
A on
i
&
ly ent
r
v
a
E ter
In
Low
High
Low
Motivation
•
•
•
IUPUI Gateway to Graduation
Expectations
Commitment
Support ……
8
Example:
X100 Introduction to Business
Course Design:
Motivation for
Learning
Assessment
of Learning
Motivation
Learning
Feedback
Attendance & early
assignments allow for
early interventions
IUPUI Gateway to Graduation
9
Example:
Introductory Psychology
Using Data for Course Design
 Students Who Get DFWs
 Predicting DFWs
 Shaping Course Design
IUPUI Gateway to Graduation
10
Analysis of All DFW Students
% of
DFWs
Nonattenders
IUPUI Gateway to Graduation
Attend
Class
Did
HWK
Pass
Tests
No
No
No
11
Analysis of All DFW Students
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
No
No
No
Noncompliers
Yes
No
No
IUPUI Gateway to Graduation
12
Analysis of All DFW Students
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
No
No
No
Noncompliers
Yes
No
No
Low
Performers
Yes
Yes
No
IUPUI Gateway to Graduation
13
Analysis of All DFW Students
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
No
No
No
Noncompliers
Yes
No
No
Low
Performers
Yes
Yes
No
Drop Outs
Yes
Yes
Yes
IUPUI Gateway to Graduation
14
What Group has the Lowest
Percentage of DFW Students?
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
No
No
No
Noncompliers
Yes
No
No
Low
Performers
Yes
Yes
No
Drop Outs
Yes
Yes
Yes
IUPUI Gateway to Graduation
15
What Group has the Lowest
Percentage of DFW Students?
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
No
No
No
Noncompliers
Yes
No
No
Low
Performers
Yes
Yes
No
Yes
Yes
Yes
Drop Outs
10%
IUPUI Gateway to Graduation
16
Can We ….. These Students?
 Describe
 Explain
 Predict
 Change
IUPUI Gateway to Graduation
17
Sources of Data
 100 pieces of data on course activities
o
o
o
Homework
Attendance
Exam scores
 100 survey questions, 15 scales
 15 pre-course predictors - IMIR
o
o
HS GPA
SAT
 Interviews – Qualitative Data
IUPUI Gateway to Graduation
18
Possible Reasons
for DFW Grades
 Prior to IUPUI
o
HS GPA/SAT
 Current Non-Academic Behavior
o
Hours Working
o
Life Stress
 Current Academic Behavior
o
Number of Hours This Semester
o
Homework Completion
 Current Personal Attitudes/Perceptions
o
Test Preparation Skills
o
Perseverance in Studying
o
Interest in Doing Homework
o
Expect Success in Study Efforts
IUPUI Gateway to Graduation
19
Dropouts (10%)
 NOT related to HS GPA or SAT/ACT
 No quantitative data predicted these
students. Qualitative interviews
suggested the following
 Severe Stress
 Working 40 hrs/wk
 Taking 6-15 hours
 Plus: One course takes 2-3 hrs/day; &/or
 Plus: Major life event
IUPUI Gateway to Graduation
20
Dropouts (10%)
 Person A
 Working 40 hrs/wk
 Another Course: 2 hrs/day
 Husband sent to jail
 Can’t afford internet connection
 Nothing related to the course
 Person B
 Working 42 hrs/wk
 Brother committed suicide
 Sleeps 10-12 hrs/day: Migraine pain
 Nothing related to the course
IUPUI Gateway to Graduation
21
Support for Stressed Students
C: Tests available 10 hrs/day, 7
days/wk during 3-week period
C: Count highest of 3 test scores
C: If miss a class, may substitute any
of 30 other sections: JagTag
M: Contact & Understand
U: Advising?
IUPUI Gateway to Graduation
22
What Group has the Highest
Percentage of DFW Students?
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
No
No
No
Noncompliers
Yes
No
No
Low
Performers
Yes
Yes
No
Yes
Yes
Yes
Drop Outs
10%
IUPUI Gateway to Graduation
23
What Group has the Highest
Percentage of DFW Students?
% of
DFWs
Nonattenders
Noncompliers
40%
Low
Performers
Drop Outs
10%
IUPUI Gateway to Graduation
Attend
Class
Did
HWK
Pass
Tests
No
No
No
Yes
No
No
Yes
Yes
No
Yes
Yes
Yes
24
Non-compliers (40%)
 NOT related to HS GPA OR SAT/ACT
 Motivational factors predict 21% of
homework completion
 Hours working
 Perseverance in Studying
 Perception of Quality of Homework
 Implies many factors differing
remarkably across students
IUPUI Gateway to Graduation
25
Interesting Fact: Importance
of a Good Homework Start
 Total homework points was predicted by
the amount of homework completed in the
first week of the semester (r2 = .62)
 Time Studying
o
HS = 4 hrs/wk for ALL courses
o
B104 & all SOS courses = 4 hrs/wk
o
15 hour load = 20 hrs/wk
o
College requires approximately 5X the amount
of studying outside of class than high school
IUPUI Gateway to Graduation
26
Developing Motivation
C: Class pts HWK & timely finish
C: Interesting HWK with validity
C: Application to students’ lives
M: Interview, identify obstacles, problem
solve, set goals, follow-up
M: Emphasize weeks 1-4
U: Administrative Withdrawal tied to
homework completion, response to an
early warning system?
IUPUI Gateway to Graduation
27
Analysis of All DFW Students
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
25%
No
No
No
Noncompliers
40%
Yes
No
No
Yes
Yes
No
Yes
Yes
Yes
Low
Performers
Drop Outs
10%
IUPUI Gateway to Graduation
28
Non-Attenders (25%)
 NOT related to HS GPA or SAT/ACT
 No quantitative data predicted these
students.
 Unable to interview even with extreme
effort
 Students are Unavailable and do not
attend for Unknown reasons
WHO should be responsible for
contacting chronic non-attenders?
IUPUI Gateway to Graduation
29
Understanding Non-Attenders
to Motivate Them
C: Motivate on 1st day of class
M: Contact & Understand
U: Threat of Administrative Withdrawal
U: Revise Early Warning System
U: Who (advisors?) follows-up on early
warning
U: Change Ws to WX (not official grade)?
Need an Early & Active Intervention
IUPUI Gateway to Graduation
30
Interesting Data:
Predicting Incompleters
 Students who do not complete the class can be
identified in first 3-4 weeks of the semester by:
 attendance &
 HWK completion (r2 = .42)
 Students who do not complete the class can be
identified in first week of the semester by:
 attendance &
 HWK completion (r2 = .26)
Attendance & homework completion
QUICKLY predict Incompleters
IUPUI Gateway to Graduation
31
Analysis of All DFW Students
% of
DFWs
Attend
Class
Did
HWK
Pass
Tests
Nonattenders
25%
No
No
No
Noncompliers
40%
Yes
No
No
Low
Performers
25%
Yes
Yes
No
Drop Outs
10%
Yes
Yes
Yes
IUPUI Gateway to Graduation
32
Low Performers (25%)
 Study Skill factors (primarily) predict
58% of this group
o
Test Preparation Skills = Best Predictor
o
Expectancy for Study Success
o
Homework Points
o
Hours Working
 HS GPA or SAT/ACT = 32%
Cannot change HS GPA or SAT/ACT,
But CAN change test prep skills
IUPUI Gateway to Graduation
33
Course Features:
Developing Study Skills
C: Develop study aids (Flashcards,
memory outlines, practice tests,
Q/A text boxes)
C: Multiple test opportunities
C: Drop a test
C: Immediate Feedback
M: Match study method w/student
interest, set goals, follow-up
U: Nothing?
IUPUI Gateway to Graduation
34
Interesting Fact:
Study Habits
How will you prepare for your
first test?
 Read the book TWICE
 LESS than this
 MORE than this
IUPUI Gateway to Graduation
35
Interesting Fact:
Study Habits
How will you prepare for your
first test?
 Read the book TWICE – 20%
 LESS than this – 40%
 MORE than this – 40%
IUPUI Gateway to Graduation
36
Predicting B104 Success
from Pre-College Data
 Pre-college data predict only
1 of the 4 groups of students:
Low Performers on Tests
 Pre-college data have little
relationship to the DFW grades of
75% of the students in the course
 SAT and HS GPA have low r with
total course points
IUPUI Gateway to Graduation
37
HS GPA Predicts Total Points?
(r=.26)

 
 

       
 

  









           

         

    

    


     



 




               




                
    
           
           

   

                 
            

    
    


         
 
 
    










          




              










 


      
 

 

 


 
   

   



    


 



 

 


 


 

 

 
  


 




 




 
 





  


         



#35
300.00

200.00
100.00
0.00



r=.36
r=-.10
#23
2.00
3.00
4.00
High School GPA
IUPUI Gateway to Graduation
38
SAT Predicts Total Points?
(r=.2)


    
 
   

 

    

             





        


           

          


            
 

          
 
           
                 
       


       

















           

      

        


   

  
  
   



 


 

   
 

   
  


  
 


  





  
 

    

 


 






      




 
 
 




  






 



 
 








   



 
  
 

     

            

#32
300.00



200.00





r=.35
r=-.16
#30
100.00


0.00
500

750
1000
1250
1500
SAT Score
IUPUI Gateway to Graduation
39
HWK Predicts Test Scores!
(r=.4-.5)


50.00
40.00
30.00
20.00

     

  

       

     

   

  





  

    

 
       
 

        


 
       



    


    
        



 
    
 
          


      

 


     
         
        
 

    

 


      
      





    

       
  






       

  

 
 
         
    
 
        


 

      



    

 





 
 














 





0.00
5.00
10.00
15.00
Average Homework Points
IUPUI Gateway to Graduation
40
The ‘WE’ of Connecting with,
Engaging & Supporting the Student
IUPUI
Meta-Course
Support & Issues
Course &
Curriculum
My
Your
Class
Class
www.gateway.uc.iupui.edu
[email protected]
[email protected]
[email protected]
IUPUI Gateway to Graduation
41