Experience of multiple approaches to increase
response rate in a mixed-mode implementation of a
population-based health survey
Urban Landreman
Hennepin County Public Health Department
AAPOR Annual Conference 2015
May 15, 2015
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
1998
2002
2006
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
2010
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Mixed Mode
On-line with Qualtrics-based survey
Paper version by mail
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Mailing 1
Post card – Sept 15, 2014
Mailing 3
Mailing 2
Post card
Letter
with thank you
with instructions
and reminder – Oct 10, 2014
for completing
the survey
on-line.
Some got incentive; Some did not
– Sept 19, 2014
Survey of the Health of All the Population and the Environment
Mailing 4
Letter
with instructions
for completing the survey
on-line – Oct 24, 2014
l www.MetroSHAPE.us
Mailing 5
Survey and letter
with instructions
for completing the survey
by mail – Nov 11, 2014
Mailing 6
Larger post card
to households in selected geographic area
with testimonial from director
of local health and wellness center
– Nov 19, 2014
Survey of the Health of All the Population and the Environment
Mailing 7
Survey and letter
to households in selected geographic areas
with instructions
for completing the survey
by mail – Jan 5, 2015
l www.MetroSHAPE.us
Incentives
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Incentive Map Sent To Households
Hennepin County
Washington County
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Incentive Map Sent To Some Households in Ramsey County
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Impact of Inclusion of Incentive on Response
Rate by Geographic Area – Ramsey County
25.0%
Percent Responding
20.0%
15.0%
10.0%
5.0%
0.0%
Saint Paul
Suburban Ramsey County
Incentive
No Incentive
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Expedited Mailings
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Demographics of Persons Requesting Mail Survey
Sex of persons requesting mail survey
40
80
35
70
30
60
Number of persons
Number of persons
Age of persons requesting mail survey
25
20
15
50
40
30
10
20
5
10
0
0
18-29
30-39
40-49
50-59
60-69
70-79
80-89
90 +
Age
Survey of the Health of All the Population and the Environment
Male
Female
Sex
l www.MetroSHAPE.us
Household Income of Persons Requesting Mail Survey
2013 Household Income
30
Number of persons
25
20
15
10
5
0
$23,000 or less
$23,001 $31,000
$31,001 $39,000
$39,001 $47,000
$47,001 $55,000
$55,001 $63,000
$63,001 $71,000
$71,001 $79,000
2013 Household Income
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
$79,001 $100,000
$100,001 or
more
Survey Mode
Preference
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Metro SHAPE 2014 Completed Surveys
Mail – 6093
On-line – 6701
iPad – 613
Android – 171
iPhone – 113
Both modes - 308
Mail
On-line
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Demographics of Persons By Mode Chosen
Mode chosen by age of person
Mode chosen by sex of person
60.0%
90.0%
Percent of persons
70.0%
Mail
On-line
50.0%
On-Line
Percent of persons
80.0%
60.0%
50.0%
40.0%
30.0%
20.0%
40.0%
30.0%
20.0%
10.0%
10.0%
0.0%
0.0%
18-29 30-39 40-49 50-59 60-69 70-79 80-89 90 +
Male
Female
Sex
Age
Survey of the Health of All the Population and the Environment
Mail
l www.MetroSHAPE.us
Household Income of Persons By Mode Chosen
Mode chosen by 2013 household Income
Mail
80.0%
On-line
70.0%
Percent of persons
60.0%
50.0%
40.0%
30.0%
20.0%
10.0%
0.0%
$23,000 or
less
$23,001 $31,000
$31,001 $39,000
$39,001 $47,000
$47,001 $55,000
$55,001 $63,000
$63,001 $71,000
$71,001 $79,000
2013 Household Income
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
$79,001 $100,000
$100,001 or
more
Percent of persons who completed the Metro SHAPE 2014 survey
with a handheld device by age group
12
Percent of respondents
10
8
6
4
2
0
18-24
25-39
40-64
Age Group
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
65 and older
Low
Response-Rate
Areas
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Number of returned surveys with extra postcard
North Minneapolis
Southwest Minneapolis
70
60
Post card goes to
Post Office
50
40
Thanksgiving
30
20
Mailing 5 goes to
Post Office
10
0
Nov
13
Nov
14
Nov
15
Nov
16
Nov
17
Nov
18
Nov
19
Nov
20
Nov
21
Nov
22
Nov
23
Nov
24
Nov
25
Survey of the Health of All the Population and the Environment
Nov
26
Nov
27
Nov
28
Nov
29
l www.MetroSHAPE.us
Nov Dec 1 Dec 2 Dec 3 Dec 4 Dec 5
30
Postal
Delivery
Service
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Day When First On-line Metro SHAPE 2014 Survey
Was Completed by Region
Minneapolis
Bloomington
0
Sept
22
1
Sept
23
Saint Paul –
without incentive
Dakota County
Washington County
2
3
4
5
6
7
8
9
10
11
12
Sept
24
Sept
25
Sept
26
Sept
27
Sept
28
Sept
29
Sept
30
Oct
1
Oct
2
Oct
3
Oct
4
Carver County
NW Suburban
Hennepin
County
Scott County
Survey of the Health of All the Population and the Environment
Saint Paul –
with incentive
l www.MetroSHAPE.us
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us
Contact Information:
Urban Landreman
Hennepin County Public Health Department
525 Portland Avenue S
Minneapolis, MN 55104
612-348-2283
[email protected]
www.hennepin.us/SHAPE – www.MetroSHAPE.us – www.MPHAN.org
Survey of the Health of All the Population and the Environment
l www.MetroSHAPE.us