1
Teaching Web Surveys Methods
Classroom Experiences Among University Instructors
Intro
Wojciech Jablonski
A thorough literature review shows that the range of publications on surveyspecific skills training is rather limited. Most existing studies focus on teaching
research methods in general, and, as a result, may deal with other (nonsurvey) quantitative techniques or with qualitative methods.
The study was conducted in August and September 2015 among instructors of survey methods who were employed in
Polish universities with sociology faculties:
Our study aimed to
 determine to what extent university instructors address web survey-related
topics in their curricula and
 check their opinions about the amount of information that should be
presented to university students in their coursework.
3
Method
2
42 universities (14 – public, 27 – private, 1 – church)
A total of 112 academics (out of 251 invitations sent) agreed to complete our web-based questionnaire. 73 instructors
declared they had, in the previous three academic years, taught at least one such class (undergraduate or graduate)
addressing survey-related issues to sociology students. Those respondents were invited to complete the core part
of the questionnaire, which included questions about web surveys.
Teaching Experience
Think of your classes with sociology students on survey research methods conducted in the most recent three academic years. Please indicate to what extent you covered web surveys-related issues.
1 – I did not cover this issue at all
5 – I discussed this issue thoroughly
UNDERGRADUATE LEVEL
mean
1+2
3
GRADUATE LEVEL
4+5
unable
to say
mean
1+2
3
4+5
unable
to say
Sampling design issues in probability web surveys
4.24
9%
10%
81%
0%
3.86
21%
6%
68%
5%
Sampling design issues in non-probability web surveys
4.19
5%
19%
76%
0%
3.74
22%
8%
65%
5%
Questionnaire preparation – question types
4.32
9%
12%
79%
0%
4.22
8%
14%
75%
3%
Questionnaire preparation – visual layout
3.80
17%
22%
61%
0%
3.83
19%
16%
62%
3%
Web survey nonresponse
3.34
27%
27%
44%
2%
3.31
27%
27%
43%
3%
Multiple devices (laptops/tablets/smartphones)
2.45
53%
25%
20%
2%
2.78
41%
24%
32%
3%
Contacting process (sending invitations, fieldwork monitoring)
2.95
42%
26%
32%
0%
3.08
41%
16%
40%
3%
Online panels
2.76
47%
26%
27%
0%
2.92
43%
22%
32%
3%
Web survey software
2.60
52%
21%
27%
0%
3.11
41%
16%
40%
3%
3
4+5
unable
to say
4
Teaching Expectations
Regardless of your experiences, please indicate to what extent web surveys-related issues should be covered during survey methods classes organized for sociology students.
1 – This issue should not be covered at all
5 – This issue should be thoroughly discussed
UNDERGRADUATE LEVEL
mean
1+2
GRADUATE LEVEL
3
4+5
unable
to say
mean
1+2
Sampling design issues in probability web surveys
4.57
3%
4%
89%
4%
4.56
3%
2%
85%
10%
Sampling design issues in non-probability web surveys
4.51
4%
7%
85%
4%
4.48
4%
4%
82%
10%
Questionnaire preparation – question types
4.59
1%
4%
92%
3%
4.46
3%
6%
83%
8%
Questionnaire preparation – visual layout
4.41
3%
11%
83%
3%
4.30
6%
10%
76%
8%
Web survey nonresponse
4.08
4%
22%
71%
3%
4.21
4%
16%
70%
10%
Multiple devices (laptops/tablets/smartphones)
3.77
11%
30%
53%
6%
3.86
10%
26%
53%
11%
Contacting process (sending invitations, fieldwork monitoring)
3.82
10%
31%
56%
3%
3.86
10%
26%
54%
10%
Online panels
3.99
8%
25%
61%
6%
3.98
11%
18%
60%
11%
Web survey software
4.06
9%
18%
67%
6%
4.06
10%
16%
63%
11%
GOR 2016
Dresden, Germany
3-4 March 2016