LinC Presentation Spring 2003 (pdf file)

LinC Research
Site visit with Marybeth Mason
and Sally Murphy
¾Feedback on Retention and
Success Assessment
¾Discussion of other approaches
De Anza Research, May 19, 2003
1
Agenda
•Review research approach
•Discuss methodology
•Highlight findings
•List ideas for future analyses
De Anza Research, May 19, 2003
2
Data Collection
•Initial data collection
•Data thru fall 2002
•Plan to replicate each summer for
previous year
De Anza Research, May 19, 2003
3
Initial Research
•Established a baseline of information
•Did not attempt to account for
•differences in classroom teaching
•grading
•student motivation
De Anza Research, May 19, 2003
4
Research Question
•Assess an important goal of the
program:
•To improve student learning by
highlighting the connections between
disciplines and interesting topics,
thereby strengthening students’
intellectual curiosity and experiences.
De Anza Research, May 19, 2003
5
Research Approach
•Use grades as a proxy measure of
student learning
•Should expect higher course success
rates for Learning Communities
students, on average, than those in
comparable non-Learning Community
courses, ceteris paribus
De Anza Research, May 19, 2003
6
Methodology
•Student grades in learning community
sections were compared with nonlearning community sections of the
same or related courses for that term
•Course to course comparison not
always available
•Did not control for different class sizes
De Anza Research, May 19, 2003
7
Methodology Continued
•Grades grouped as:
•Success - A, B, C, or P
•Withdrawal - W
•Non-Success - D, F, NP, I
•The grade percents were based on all
the grades for the section, including W’s
De Anza Research, May 19, 2003
8
Course Comparisons
Spring 2002
GU
GU
L1
L1
L1
L1
L1
L2
L2
L2
L2
SF
SF
WC
WC
The Good, The Bad and The Ugly
The Good, The Bad and The Ugly
LART 100
LART 100
LART 100
LART 100
LART 100
LART 200
LART 200
LART 200
LART 200
Society: Go Figure!
Society: Go Figure!
Whose Country Is This Anyway?
Whose Country Is This Anyway?
De Anza Research, May 19, 2003
EWRT001A13D
HIST017A03D
EWRT100BXXX
LART100.01D
LART100.02D
LART100.61D
READ100.XXX
EWRT100AXXX
LART200.01D
LART200.02D
READ201.XXX
MATH105.12D
SOC 001.03D
ESL 005.01D
HIST017A02D
9
Level of Analysis
Whose Country Is This Anyway?
ESL 005.01D
LinC
HIST017A01D
Non-LinC
ESL 005.REL
HIST017AREL
2002F
Success
#
%
LinC
236
Non-LinC 3,288
84%
66%
Non-Success
#
%
23
819
8%
16%
Withdrew
#
%
23
869
8%
17%
De Anza Research, May 19, 2003
#
Total
%
282 100%
4,976 100%
10
Summary of Findings
•In a typical quarter
•more than 200 students
•10 to 15 LinC sections
•five or six “Learning Communities”
•1,401 students have participated in LinC
courses over the last four years
De Anza Research, May 19, 2003
11
Findings Continued
•Overall, the course success rates
were higher for LinC than similar
courses
•Course success rates for the program
have generally increased since the
program started in 1998
•LinC course success rates appear to
vary by curriculum content
De Anza Research, May 19, 2003
12
Success Rates for LinC and Similar Courses
De Anza College, 1998-2002
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Success
Non-Success
LinC
Withdrew
Non-LinC
De Anza Research, May 19, 2003
13
Success Rates of LinC and Similar Non-LinC Courses
by Term, De Anza College, 1998-2002
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
98w 98s 99w 99s 99f 00s 00m 00f 01w 01s 01m 01f 02w 02s 02m 02f
LinC
Non-LinC
De Anza Research, May 19, 2003
14
De Anza Research, May 19, 2003
15
De Anza Learning Communities
Winter to Spring Term Rentention
LC and Related Courses
Winter
HC
Returned
for Spring
Percent
Return
1998W
LC COURSES
RELATED COURSES
21
894
18
765
86%
86%
1999W
LC COURSES
RELATED COURSES
24
498
21
418
88%
84%
2001W
LC COURSES
RELATED COURSES
167
2820
148
2410
89%
85%
2002W
LC COURSES
RELATED COURSES
162
3167
143
2709
88%
86%
Total
LC COURSES
RELATED COURSES
373
6933
329
5867
88%
85%
De Anza Research, May 19, 2003
16
Future Analyses
•Combine information on course success
with classroom assessment data and
other survey information
•Additional variables such as previous
language skills, success in math and
English gateway courses, and economic
need will also be considered
De Anza Research, May 19, 2003
17
Future Analyses
Continued
•Future analysis will also look at college
persistence rates (an examination for one
following term showed slightly higher
rates for LinC students)
•Other areas of research will focus on
taking into account student and faculty
self-selection bias
De Anza Research, May 19, 2003
18
Statistical Tests
•Inferential statistical tests can also be
used
•Chi Square
•T Test
De Anza Research, May 19, 2003
19
Discussion
•Approaches used elsewhere?
•Other ways to measure success?
De Anza Research, May 19, 2003
20