D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
D2.2
PACT Methodological Report on Survey
Design and Survey Questionnaire
1st Reporting period
WP2 Design of the survey
Responsible Partner: RAND
Contributing partners: CSSC
Due date of the deliverable: April 2013
Actual submission date: May 17th 2013
Dissemination level: PU
PACT - Public perception of security and privacy: Assessing knowledge, Collecting
evidence, Translating research into action
th
Project co-funded by the European Commission within the 7 Framework
Programme – SECURITY theme
1
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Document Management
PROJECT FULL TITLE
Public Perception of Security and Privacy: Assessing Knowledge,
Collecting Evidence, Translating Research into Action
PROJECT ACRONYM
PACT
Collaborative Project funded under Theme SEC-2011.6.5-2, “The
relationship between human privacy and security”
GRANT AGREEMENT
285635
STARTING DATE
01/02/2012
DURATION
36 months
D2.2 PACT Methodological Report on Survey Design and Survey Questionnaire
Task: 2.2
Leader: RAND Europe
Authors: Sunil Patil, Neil Robinson, Dimitris Potoglou, Peter Burge, Tess Hellgren
All rights reserved.
No part of this publication may be reproduced, distributed or utilized in any form or by any means,
electronic, mechanical, or otherwise, without the prior permission in writing from the PACT consortium.
Download and print of the electronic edition for non-commercial teaching or research use is permitted on
fair use grounds. Each copy should include the notice of copyright.
Source should be acknowledged.
© 2013 PACT
www.projectpact.eu
2
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Executive summary
The Work-package 2 (WP2) involves three distinct, though interlinked, phases: (a) the Knowledge
Consolidation Workshop (KCW), (b) the design of the survey questionnaire and (c) the analysis of the pilot
data. This report, deliverable D2.2 in PACT's Description of Work (DoW), focuses on the abovementioned
phase (b).
RAND Europe leads this task and all WP2 partners have provided critical feedback throughout these phases.
The primary objective of the process followed at this stage of the project was to transform the three reallife Use Cases identified and shortlisted in the KCW into real-life choice scenarios in the survey.
This report describes the deliberations and the methodological approach used in designing the survey and
provides the survey questionnaire, which was used for cognitive testing and the pilot data collection.
Analysis and feedback following the pilot survey will provide further opportunity to refine this
questionnaire based on responses from the pilot survey and cognitive testing. This refined questionnaire
will be then provided with the deliverable D2.3 report which summarises the abovementioned phase (c).
Chapter 2 provides details on the rationale behind the transformation of the Use Cases into the choice
scenarios in the survey questionnaire, the core part of PACT's survey across the 27 Member States
(excluding Croatia, which was not a member when the study was proposed to the European Commission).
Particular emphasis in this chapter is placed upon the design procedure of the stated preference discrete
choice experiments of the survey, namely: identification of attributes and validation of levels (Section 2.2),
how the choice tasks are introduced to respondents (Section 2.4) and the design of the choice tasks for
each scenario (Section 2.5). Section 2.3 discusses the rationale behind the use of 'price'/'cost' as an
attribute in all choice scenarios.
Chapter 3 discusses the remaining elements of the survey questionnaire. The survey structure is discussed
in Section 3.1. The testing and implementation phases including the data collection modes (face-to-face
and Internet) are described in Section 3.2. Finally, Section 3.3 summarises considerations around the
sampling and recruitment of respondents in both the pilot and main surveys.
3
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Table of contents
Executive summary ------------------------------------------------------------------------------------------------------------------- 3
Table of contents---------------------------------------------------------------------------------------------------------------------- 4
1.
Introduction --------------------------------------------------------------------------------------------------------------------- 5
2.
PACT survey design ------------------------------------------------------------------------------------------------------------ 6
2.1 Transforming Use Cases in real life choice scenarios ---------------------------------------------------------------- 6
2.2 Identification of attributes and validation of levels ------------------------------------------------------------------ 7
2.3 Inclusion of price in choice scenarios ---------------------------------------------------------------------------------- 13
2.4 Describing the choices to respondents -------------------------------------------------------------------------------- 13
2.5 Selection of choice scenarios -------------------------------------------------------------------------------------------- 14
3.
Survey questionnaire -------------------------------------------------------------------------------------------------------- 16
3.1 Sections in the survey questionnaire ---------------------------------------------------------------------------------- 17
3.2 Testing and implementation of survey -------------------------------------------------------------------------------- 18
3.3 Considerations for sampling and recruiting of respondents ----------------------------------------------------- 20
4.
Concluding remarks ---------------------------------------------------------------------------------------------------------- 21
Annexes ------------------------------------------------------------------------------------------------------------------------------- 22
A1 Survey Questionnaire ------------------------------------------------------------------------------------------------------ 22
4
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
1. Introduction
PACT’s second work package includes designing the questionnaire and scenarios following the Knowledge
Consolidation Workshop1 (KCW). This report provides details on the survey design process and the
questionnaire that will be used for pilot data collection and cognitive interviews. The PACT questionnaire
seeks to obtain an understanding of respondents’ preferences for different security and privacy features
within very specific real-life situations from a variety of sectors. The three sectors chosen in the KCW at
Cambridge included: transport, internet and health. Each of these sectors presents different security and
privacy threats as well as sharing some common features related to collection, storage and sharing of
personal data.
In order to objectively measure respondents’ preferences to different levels of security and privacy
characteristics in each of these sectors, the description of work (WP2-WP4) proposed the design and
implementation of a large-scale survey incorporating stated preference discrete choice experiments. As
concluded in WP1, privacy and security preferences can very much depend on the situational context and
these preferences can also vary across different groups of individuals and within the same context. It was
therefore decided to measure the preferences in the context of choices that respondents maybe familiar
with. One specific context from each sector was chosen accordingly.
These contexts are:
1. Travel on metro or train (hereafter referred to as “Travel”)
2. Choice of an internet service provider (hereafter referred to as “Internet”)
3. Choice to purchase a device or service for storing health related information (hereafter referred to
as “Health”)
The focus of the survey design phase was to identify specific contexts where individuals can recognise and
make choices considering privacy and security threats. It also involved identifying measureable attributes to
describe these choices and developing experimental designs to generate choice scenarios to be presented
to each respondent. Apart from the preferences to security and privacy aspects in these three contexts the
survey also aims to capture socioeconomic and demographic characteristics of the respondents including
responses to attitudinal questions.
RAND Europe led the task of survey design and all PACT partners provided comments at various stages of
this task. Apart from the KCW, partners used PACT conference calls and emails to discuss a variety of issues
related to survey design. RAND also circulated two draft versions of the questionnaire to invite comments
from all partners. These discussions with the PACT consortium were particularly helpful in deciding on
issues involving scope of the survey, privacy issues that could arise in the questionnaire, alternate
methodologies, and questions related to measurement of attitudes. RAND used a variety of criteria
mentioned in Chapter 3 to decide which of the suggestions could be implemented. These included technical
considerations; response time available in the questionnaire and accessibility for many of the concepts.
Necessarily this was a process where no-one perspective could be implemented outright. However, we
incorporated feedback from partners in the following ways:
1
th
See PACT D2.1 Knowledge Consolidation Workshop Report, Cambridge – 8 October 2012.
5
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635






Providing a more balanced introduction to each scenario which attempts to identify clearly the
positives and negatives of each scenario with regards to the impact upon individual’s privacy and
security
Including pro-privacy values (levels) in some of the attributes (characteristics) (e.g. measures that
would articulate a benefit for people’s privacy)
Discussing and elaborating upon the attributes (characteristics) of each choice alternative
Incorporating suggestions from consortium members concerning the levels within each attribute
Adjusting the sets of background questions including the attitudinal questions (e.g. preferences for
risk taking)
Including questions designed to elicit views on trust in different entities (e.g. governments;
healthcare providers, etc.).
The following chapter describes the methodology of the survey design. The third chapter of this report
provides details on the outline, testing and implementation of the survey questionnaire, as well as on the
incorporation of the comments received from the ethical review.
2. PACT survey design
The survey incorporates stated preference discrete choice experiments to better understand individuals’
preferences for different privacy and security levels with real-life contexts. These experiments involve
asking respondents to choose from a set of hypothetical options or alternatives, for example, choosing
between different health data devices. Each set of alternatives presented in a question is called a choice
scenario. Each alternative in such a choice scenario is described by different attributes, for example, type of
health data stored, extent of data sharing, etc. Each attribute is defined by a number of different levels, for
example, the attribute ‘type of health data stored’ might take a value ‘all health conditions and
identification’ or ‘limited health information only’ in the description of one of the alternatives. These values
are termed levels. Experimental design methods are used to specify combinations of attribute levels, for
each alternative, ensuring that the preferences for value of each attribute can be quantified from the
respondents’ choices in the experiments. Typically a respondent is asked to indicate their preferred
alternative in more than one choice scenario.
Thus the preferences provide data for choice modelling, which can be used to estimate the population level
effect (positive or negative) of a given attribute level in affecting the choice of respondents. This approach
based on the stated preference discrete choice experiment (SPDCE) uses multiple-level combinations for a
variety of attributes, all relevant to the choice contexts. For example, in the travel context apart from
attributes related to privacy and security, individual alternatives can also be described using the attribute delay in travel. Further, in this experimental design the attribute levels do not necessarily vary in reciprocal
relation and hence this method is different than the ‘trade-off’ model which is often used in the security
and privacy literature. Accordingly, the population of the attributes can include the positive sum model
(e.g. increased security or security-technology may not necessarily correspond to increased loss of privacy)
as well as the zero-sum approach implied by the trade-off model.
2.1 Transforming Use Cases in real life choice scenarios
The first task in the questionnaire design was to transform the Use Cases identified in the KCW into
plausible and realistic choice contexts. The key in successful implementation of stated preference discrete
choice methodology is to clearly set the choice context and present respondents with choice scenarios
6
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
which they can easily relate to. The consortium used various criteria in this process including accessibility
and relevance of the scenario context to the lay person and the identification of security and privacy issues
involved. Another important consideration was that these choice contexts should be recognised by citizens
across all EU27 countries.
The KCW at Cambridge set the following scope with regard to the choice contexts:
1. It was decided that instead of asking about all types of public transport it is necessary to frame the
questions around the choice of journey by metro or train. This allowed exclusion of journeys
involving buses and trams which present different security threats and thus have different security
measures.
2. In the internet context the choice task was framed around the choice of internet service provider
(ISP). The concept of subscribing to an ISP is similar to subscribing to a utility company which
provides electricity or phone, thus it is easier for respondents to relate to such choice. This framing
of context around choice of ISP makes it easier to explain the different security and privacy aspects
to the respondent.
3. Similarly, in the case of the health context, the choice task was framed around offering a choice
between different devices or services which store a person’s health data and provide access to the
data in a variety of situations including emergencies. Currently, there are devices and mobile
phone/internet applications (apps) in the market which sell similar services. Such devices are
marketed as means to provide faster health access during emergencies (e.g. accidents) or to assist
the diagnosis and expedite treatment by providing quick access to information on allergies, blood
group, diabetic status, etc.
Thus framing each of these contexts as choices in day-to-day life, which are likely to be familiar or
understandable to the respondent is aimed to make the survey questionnaire realistic, accessible and
relevant.
2.2 Identification of attributes and validation of levels
In order to present the choice scenarios it is necessary to identify attributes that can describe the
alternatives. We followed a multi-tier approach for identifying the attributes and their corresponding
levels. The first draft of attributes and levels were identified in the KCW. This was followed by an internal
workshop involving team members at RAND to further refine this list.
Further IPSOS then conducted focus groups in London-UK, Athens-Greece, and Vilnius-Lithuania2 with the
aim of providing feedback to the project team regarding the public’s reactions, attitudes, familiarity with
the vocabulary as well as knowledge and behaviour towards the subject of privacy and security, within the
three contexts.
The project team also discussed the attributes and levels in the Stakeholder Advisory Group3 (SAG) meeting
held in Athens in October 2012 and conducted follow-up interviews with experts on each context.
This approach helped to identify attributes which were relevant in each context. It also provided us an
opportunity to validate the attribute levels that are presented in the choice scenarios. For example, the
feedback from stakeholders was particularly helpful in identifying the range of time limit that CCTV data
2
3
Further details on this will be provided in PACT D3.1 Summary of findings from the survey testing phase.
See SAG 1st meeting report, Athens, 15 October 2012.
7
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
can currently be stored for, and the range of realistic cost changes to pay for security measures in the price
of train or metro tickets.
The final lists of attributes and levels selected for each context are given in Table 1 to 3.
Table 1 Attributes and levels for travel context
Attribute
Recognition
capabilities in CCTV
cameras
Details
Closed circuit television
cameras are often used at
stations and inside vehicles to
monitor the recorded activities
or those in real time. This
attribute describes any
advanced features that the
camera can have.
2
Time period for
storing the CCTV
information
Period during which CCTV data
will be stored by the travel
authority [conditional on
presence of CCTV ]
3
Who has access to
CCTV information
[conditional on presence of
CCTV ]
4
Type of security
personnel at the
station
5
Security measures at
the station
6
Time to pass through
security checks and
related queues
1
[delay conditional on security
measures being 2 to 4, No delay
only applicable for no security
measure]
Levels
1. None, CCTV cameras not used
2. Standard CCTV
3. Advanced CCTV that enables
abandoned bag detection
4. Advanced CCTV that enables
real-time recognition of
suspicious movement of people
5. Advanced CCTV that enables
real-time face recognition
1. Data not stored
2. Data stored for 3 days
3. Data stored for 7 days
4. Data stored for 15 days
5. Data stored for 45 days
1. Only the transport authority
2. Transport authority and police
3. Transport authority, police and
European security agencies
4. Travel authority, police,
European and International
security agencies
1. None
2. Private security firm staff
3. Transport authority security
staff
4. Unarmed Police
5. Armed police with trained dogs
1. None
2. Randomly selected for full body
pat-down and bag check
3. Randomly selected to go
through metal detector or full
body scanner
1. 10 seconds
2. 30 seconds
3. 1 minute
4. 2 minutes
5. 10 minutes
8
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
7
Attribute
Details
Additional security
surcharge (on top of
ticket cost)
For countries not using Euro,
the amount is converted using
exchange rate and displayed
after rounding off
Levels
6. No delay
1. None
2. 5 Euro cents
3. 10 Euro cents
4. 30 Euro cents
5. 50 Euro cents
6. 1.00 Euro
Table 2 Attributes and levels for internet context
Attribute
Extent of internet usage
information stored
Details
This is the information
related to internet use that
is stored by the internet
service provider and may
be provided to the law
enforcement agencies to
help with any on-going
investigation
2
Retention period of
personal information
Period for which personal
data will be stored by ISP
[conditional on any data
being stored]
3
Extent of information
sharing
[conditional on any data
being stored]
1
4
Annual report of data
monitoring activities in
your country publicised
by ISP
This feature describes the
information provided by
the ISP to the users
Levels
1. No internet usage information
will be stored
2. List of websites visited
3. List of websites visited and
location of user
4. All internet activities but not
including the content of
communications
5. All internet activities including
the content of communications
1. Data stored 1 month
2. Data stored 6 months
3. Data stored 1 year
4. Data stored for 5 years
1. No data sharing [if data
storage=1, always present this]
2. Data shared with national law
enforcement agencies
3. Data shared with national and
EU law enforcement agencies
4. Data shared with law
enforcement agencies across the
world
1. No information provided by ISP
2. number of law enforcement
requests related to data
disclosure every year
3. number of law enforcement
requests related to data
disclosure as well as the types
of data that were accessed by
the law enforcement agencies
every year
9
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Attribute
5
Conditions under which
ISP enables the
surveillance of users by
the police
6
Services offered to
improve online privacy
7
Monthly cost or discount
for internet security and
data management
Details
Levels
4. number of law enforcement
requests related to data
disclosure as well as the types
of data that were accessed by
the law enforcement agencies
and the number of convictions
that were made based on this
data every year
The extent to which law
1. Any time without a warrant
enforcement requires legal 2. If there is a suspicion against a
approval to perform
person and without a warrant
surveillance
3. If there is suspicion against a
person and only with warrant
4. Only under state of government
declared emergency
Different technologies to
1. None
enhance online privacy or
2. Tips on how to set up fully
prevent websites visited
anonymous browsing (user
from gathering personal
location not available to
data without user’s
websites unless allowed by
knowledge and to provide
user)
privacy-related information
3. Advice to users on which websites don’t meet their indicated
level of privacy
4. Automated standard
anonymisation of your online
activities
Additional fee on top of
1. Discount of 3 Euros
broadband subscription
2. Discount of 1 Euro
respectively cheapening of 3. None
the broadband subscription
4. You pay 1 Euros
5. You pay 3 Euros
10
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Table 3 Attributes and levels for health context
Attribute
Information stored on
the device/system for
sharing
- Basic health
information such
as blood group,
allergies,
diabetic status
- Identification
information :
name, address,
age, photograph,
nationality
- Information
about serious
health conditions
- Information
about all health
conditions(includ
ing mental
health, sexual
health,
addictions if any)
Which authorities can
access the information
on device/system
[conditional on
entry/edit rights]
Details
Which of person’s
records can be
accessed with the
device?
Levels
1. Basic non-identification information
such as blood group, allergies, diabetic
status and nationality
2. Your name, address, age, photograph,
along with blood group, allergies,
diabetic status, nationality, emergency
contact
3. Your name, address, age, photograph,
along with blood group, allergies,
nationality, emergency contact, and
information about serious health
conditions
4. Your name, address, age, photograph,
along with blood group, allergies,
nationality, emergency contact, and
information about all health conditions
(including mental health, sexual health,
addictions if any)
How broadly is data
shared? Who can
access the data linked
to the device?
3
Cases when access to
information is widened
to governmental
agencies across EU
4
Who can enter/edit the
information?
In which
circumstances the
national and EU
government agencies
other than the
hospital providing
treatment can also
access your records
linked with the
device?
Involvement of
different parties in
processing
1. Only hospitals in your country of
residence
2. Hospitals in and outside of your
country of residence
3. Hospitals in and outside of your
country of residence and Emergency
medical personnel
4. Hospitals in and outside of your
country of residence, Emergency
medical personnel and other
emergency services including fire and
rescue
1. Bombing / terrorist incident and major
accident (e.g. railway crash)
2. Natural disaster (e.g. earthquake)
3. Public health emergency (e.g. flu
pandemic)
4. Any personal health emergency (car
accidents, fires)
5. Never
1
2
1. Only your family doctor
2. Your family doctor, authorised hospital
11
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Attribute
5
Who else can view the
information apart from
the medical specialists?
6
Availability of
anonymous information
sharing for medical
research
7
Cost
Details
Levels
staff and emergency medical
personnel in your country
3. Your family doctor, authorised hospital
staff and emergency medical personnel
across EU
1. No one
2. Immediate family
3. nurses providing home care
4. Your insurance company
5. Private sector pharmaceutical
companies
1. Only if you have provided a prior
consent
2. Only after your death but without prior
consent from next to kin/blood
relatives
3. Only after your death but with prior
consent from next to kin/blood
relatives
4. Anytime without your prior consent
5. Never
1. Free (given by your hospital)
2. 1 Euros per month
3. 2 Euros per month
4. 3 Euros per month
5. 4 Euros per month
12
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
2.3 Inclusion of price in choice scenarios
The consortium has discussed on several occasions the drawbacks of using price in relation to complex
issues such as the one of privacy and security. However, it was important to introduce a price/cost attribute
across all three contexts, for the following reasons:
1. We present choices which often involve cost/price (e.g. paying for internet, purchasing a ticket,
purchasing a health device costs money). More importantly the security and privacy features
involved in each sector have direct cost implications associated with them. For example, part of the
costs to deploy CCTV, is directly passed on to the travellers or is paid indirectly through revenues
from general taxation. Therefore, part of the costs (if not all) to deploy CCTV cameras is ultimately
paid by the citizens/taxpayers. In the choice scenarios, we make this important element explicit and
present direct cost implications as part of the choice scenario.
2. Having cost as part of the set of attributes used across the three sectors (travel, internet provider,
health) enables us to make comparisons on how respondents value the common attributes across
different contexts using a same unit of measurement (money). Thus we will be able to empirically
test whether individuals’ sensitivity to privacy and personal data depends on the context. For
example, do respondents value sharing of their personal data across parties the same (or
differently) when travelling on the metro, when surfing the Internet or in a situation that concerns
their personal health data. Having a common measure such as people's willingness to pay (or
accept payment) for specific measures enables such comparisons.
3. Within a sector specific context (e.g. travel), we can test questions such as: Is the willingness to pay
(or accept) the same for ‘Standard CCTV’ with ‘2 to 6 month data storage’ compared to ‘Advanced
CCTV’ with ‘1 month data storage’?
4. Finally, inclusion of cost would be a very useful input for the Decision Support System (DSS) in order
to better place the results of this exercise within a standardised framework, for example for
comparing costs and benefits.
Another attribute that could be a common unit of measurement is ‘time’. However, valuation of time is
very much context dependent (e.g. it could be valued highly when in urgency, or it could be valued
differently for duration of data storage and for delay in travel time). Thus even though everyone has same
units of time available, its valuation can vary in different contexts even for the same person. Further, while
it might be relatively easy to include time in the travel context, it is not the case in health and internet
context. Hence cost was perceived as a more suitable unit for comparisons.
The motivation to include price in choice scenarios is therefore not about putting a price on privacy per se
but to use price as a mechanism to allow us to introduce a common baseline throughout the different
contexts.
2.4 Describing the choices to respondents
In order to obtain a valid response from the respondents, it is necessary to ensure that they understand the
choice tasks and underlying security and privacy contexts. The survey was designed to facilitate this
objective and to bring the respondents into the relevant frame of mind by the time they reach the
questions involving choice scenarios in each context. Accordingly respondents are first asked some
background questions with the aim of understanding their existing behaviour (e.g. frequency of use of
metro). They then are introduced to the potential security and privacy threats that may arise due to
13
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
security measures put in place in each context. It was necessary to ensure that this introduction was
balanced and did not lead the respondent to create a bias before presenting the choice scenarios; hence
the introductions were framed as questions around the respondents’ awareness and level of concern
regarding security and privacy threats. These questions were then followed by the choice scenarios from
that context.
We investigated the possibility of presenting the choice scenarios in a variety of formats. It was decided
that it is not desirable to use picture-based choice scenarios mainly because it is not possible to describe
most of the attributes using pictures and also pictures could be perceived in different ways by respondents
from different backgrounds. A concise sentence based format was selected to facilitate the presentation
and ease of understanding by the respondent.
2.5 Selection of choice scenarios
In the questionnaire a respondent is presented with a number of choice scenarios for a given context.
Experimental design methods are used to specify the attribute levels that are presented for each attribute
in the choice scenario. These ensure that there is minimal (or no) correlation between attribute levels, so
that the importance of each can be identified. It was necessary to consider the conditionalities that are
inherent in attribute level combinations. For example if no CCTV is deployed, then the duration of data
storage is not relevant and hence that attribute should not be presented. We therefore avoided presenting
infeasible or unrealistic combinations in the choice scenarios. We deployed an experimental design
approach which allowed us to maximise the statistical power of the analysis of the information gathered
from the surveys.
As explained in Box 1, the smallest possible size for the design matrix for travel context was of 60 rows,
however considering the expected large sample size we used a design matrix with 120 rows, i.e. 120 choice
scenarios. For health and internet contexts size of the design matrix was kept the same to simplify the
survey implementation.
14
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Box1 Technical details of PACT stated preference survey design
A choice scenario involves presentation of several configurations (alternatives) of a real-life scenario.
These configurations are described using various attributes around security technologies or related
policy measures that may affect privacy. Each of the attributes may take one of many possible levels.
In a choice task, the respondent is presented with different configurations and is asked to choose one
such configuration.
For example, the PACT survey includes a Travel scenario. Different configurations of this scenario are
described by seven attributes (see, Table 1). The possible levels of each of these attributes are listed in
the third column of Table 1. A choice task in the travel scenario will present respondents with three
alternative configurations and a ‘none of these’ option. These three alternative configurations are
differentiated based on the combinations of value of levels for each of the seven attributes.
When the number of attributes, levels, and alternative options increase, the number of possible choice
tasks multiplies rapidly and becomes impractical to present all possible combinations to the
respondents. For example, if there are only two attributes A and B each taking one of three possible
levels and if the choice scenario involved only two alternatives, we obtain (3 x 3) x (3x3) = 81 possible
choice scenarios.
In order to generate a number of choice scenarios, which respondents can evaluate without excessive
cognitive burden and within the allocated time-length of the survey, it is necessary to select a subset of
these combinations. This subset along with respondents' choices should provide adequate data so that
the influence of each attribute level in the choice process can be recovered through modelling of this
data. The selection process is performed using a variety of stated-choice experimental design methods
and search algorithms. For example, an orthogonal experimental-design guarantees no correlation
across levels of different attributes, whereas the objective of an efficient experimental-design is to
minimise the variance of estimated model parameters. The methodology of discrete choice modelling
uses logit models which are non-linear thus an efficient design is preferred over the orthogonal design.
We use the efficient experimental-design approach to search for a candidate subset of alternative
configurations, a design matrix. However, efficient designs require prior information (‘priors’) on the
model parameters to be estimated. These priors are usually obtained from previous studies, which is
not possible in this survey as it is the first survey on this topic using this methodology. Hence, for
generating the design matrices for the pilot study zero priors are assumed as no prior information is
currently available. Following the analysis of pilot data, we will use the model parameters recovered
from the pilot study as priors in the generation of the design matrices in the main survey.
The size of design matrix is determined using the number of parameters to be estimated and the
necessity to ensure the level balance in the design matrix. Level balance is a desirable property which
ensures that each attribute level appears an equal number of times for each attribute. While level
balance is not a necessity it helps to avoid systematic biases in the design.
15
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Because each individual cannot possibly evaluate 120 choice scenarios, it is necessary to split these choice
scenarios across respondents. We judged that each respondent could evaluate five choice scenarios per
context (15 choice scenarios in total, across the three different contexts). This should allow us to keep the
survey length manageable. To do this we used a blocking algorithm which divides the 120 choice scenarios
in 24 blocks of 5 choice scenarios whilst seeking to minimise the correlation between the block and each
attribute. This ensures that we avoid presenting only low or high attribute levels to a respondent for a
certain attribute. This means that we have 24 versions of the choice experiments within the questionnaire.
During implementation of the survey one of these blocks will be drawn at random for each respondent for
each stated preference experiment.
In the next chapter we describe the outline of the questionnaire and issues related to testing and
implementation of the survey.
3. Survey questionnaire
The survey questionnaire was designed so that it can be answered within 40 minutes by a respondent. We
outline the survey sections in Section 3.1. Further since the survey will be conducted in 27 countries it
needed special considerations which are described in Section 3.2 along with description of the survey
implementation approaches. The sampling issues are described in Section 3.3.
In general the number and type of questions as well as the answer options were chosen based on the
following criteria:





total length of the survey
relevance to the study’s objectives
ease of understanding for the ‘lay person’ across EU27 member states
continuity with subsequent work packages of PACT, and
considerations from perspective of analysis of the data from 27,000 respondents
When a question was deemed to be sensitive the respondents were always provided with an option of not
to answer. This survey was also sent for an independent ethics review. There were a number of suggestions
on the clarification of following issues in the questionnaire.
The PACT questionnaire was also reviewed by an independent expert who provided comments after the
ethical review. The reviewer suggested inclusion/consideration of the following points




Details about the random sample selection process, i.e. specifying who will draw this sample?
Details on the method used for checking the accuracy of translation of survey in variety of
languages
Relevance of question on ethnicity to participants in different countries
The informed consent should be part of the questionnaire and should mention project coordinator,
surveying organisation, funding source, authorisation from relevant authorities, process of
selection of respondent and their inclusion in the sample, details on confidentiality and anonymity,
retention and ownership of data, terms of participation, use of data for current and future studies,
contact person’s details at the end of the survey, etc.
The comments on specific questions, contact details, and funding source will be accommodated in the
questionnaire itself. However, IPSOS and RAND highlighted that some of these recommendations on
informed consent if incorporated in main text of the survey will have impact on survey length and possibly
16
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
on the response rate. IPSOS suggested that it is best to put together an information document, including
information on project coordination, purpose of the survey, participant selection, confidentiality,
ownership of data etc. In the context of face-to-face surveys, the document will be printed off and handed
to each respondent before starting the survey. For online surveys, the content of the document will be
shown on a screen so that respondents are able to read it before agreeing to participate in the survey. The
respondent confirms the awareness of this document and provides consent on the basis of this document
before the survey begins. A detailed response on how the ethics review comments will be addressed is
provided separately4.
3.1 Sections in the survey questionnaire
The survey questions (given in Annex A1) can be divided in one of the following categories.
1. Demographic questions
These questions include questions related to respondents’ age, gender, education, working status, etc.
These questions will help us in testing whether such socio-demographic factors affect the person’s attitude
and preferences involving security and privacy in the three contexts. Respondents’ age, region of residence
and gender are also used to define quotas so that the online sample recruited for the survey is nationally
representative for each country on these three criteria. After reviewing the draft questionnaire, partner
data collection agencies involved in the cognitive testing highlighted that in some Member States there is a
legislation which prohibits collection of information related to ethnicity and religion. Thus it is not possible
to collect information on respondents’ ethnicity and religion systematically across 27 Member States,
hence these questions will be dropped from the questionnaire in the main stage survey.
2. Context specific background questions
These questions help us to understand familiarity or relevance of each choice scenario to the respondent.
These can be used to test hypotheses such as – Does frequency of travel affects perceptions related to
security and privacy threats in travel? Does a respondent’s health status affect their perceptions related to
sharing information on their health?
3. Questions related to attitudes toward: security; privacy; surveillance; trust
These questions are designed so that we can construct indices for attitudes toward security, privacy,
surveillance, and trust. After a thorough literature review on these topics in the context of security and
privacy we selected some questions as starting point. As far as possible these questions and their scales
were kept similar to the original questions in the literature so that we have use validated questions. Our
aim was to preserve the tone and language of the original questions 'as is'. In many cases however, we had
to slightly alter the statement to make them suitable for the survey and contexts and to accommodate
differences when the studies were conducted outside Europe, or clarify any abstract terms included in the
questions. We tried to maintain the general meaning of the scales to preserve validity.
4. Questions involving choice scenarios
Following the methodology described in the Section 2, respondents will be presented with five choice
scenarios for each context. These questions follow the questions which introduce security and privacy
4
PACT letter in reply to the REA letter requesting clarifications following the ethical review of the survey questionnaire”, Ref.
Ares(2013)981969 - 30/04/2013
17
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
threats in each context. We also included diagnostic questions which will be asked following the choice
scenarios to gather information related to respondents’ understanding of the choice scenarios.
Respondents get an option of providing feedback on what if anything was unclear in the choice scenarios.
3.2 Testing and implementation of survey
As the survey will be conducted in a variety of languages it was necessary to ensure that we avoid certain
words or sentences which could be difficult to translate or could mean something else in other languages.
IPSOS based on their extensive experience provided feedback on this issue and the wording of the
questionnaire was adjusted accordingly5. RAND also tested the survey internally choosing respondents who
were not a part of the project team. The cognitive interviews and pilot testing will provide further input on
wording issues and survey accessibility more generally. A small window of time between cognitive
interviews and pilot will allow us to incorporate some of the smaller issues in pilot questionnaire. However,
the feedback from cognitive testing and face-to-face pilot interviews along with the results of analysis of
pilot data will be completely incorporated in the questionnaire before the final stage of survey –the main
survey across all 27 countries.
The survey implementation will be carried out in a variety of formats. The most appropriate format for the
pilot and main survey was chosen based on the Internet penetration in the country. Online surveys using
Internet panels offer advantages in terms of presentation of the survey, sampling and ensuring the quotas,
allowing respondents to complete the survey in their time of convenience, achieving larger geographical
coverage in short time, etc. However, for countries with low internet penetration face-to-face surveys are
more suitable which also offer advantages in terms of being able to answer any queries that respondents
have during the survey, and the interviewer can also provide additional feedback on the survey based on
their observations. It is a common practice to conduct the face-to-face interviews using questionnaire
printed on paper (Paper-and-Pencil Interviews PAPI) or using a questionnaire displayed on computer/laptop
(Computer-Assisted Personal Interviews CAPI).
Thus we use survey instruments in different stages of the PACT study in different countries as listed in Table
4. In Germany and Italy we plan to use both face-to-face and internet based surveys to be able to test if
there are any key differences. Table 4 also lists the sampling techniques used for recruiting the respondents
in each stage. PACT deliverable D3.2 will provide a detailed report outlining the sampling approach adopted
for both online and face-to-face surveys. Whilst the cognitive interviews are conducted using a paper
based survey, the face to face surveys in pilot will be conducted using CAPI. Internet based surveys will also
be used in the pilot data collection in Denmark and Italy.
5
Further details on the translation related issues are included in IPSOS “Methodological note on translation of critical terms”.
18
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Table4 Details of PACT survey stages
Survey
phase
Implementation
Countries (sample
size)
Recruitment of respondents
Focus groups
Face-to-Face
group
discussion(focus
groups)
UK (8)
Greece (8)
Lithuania (8)
Members of the general
population; only internet users;
aged 30-60; mix of gender, age,
life stage and social class
December
2012
UK (6)
Hungary (6)
Portugal (6)
Members of the general
population; mix of people (age,
gender, etc.); at least two
respondents per country who
do not use the internet; at least
two respondents per country
who do not take public
transport very often (less than
once a month)
April 2013
Romania (50) (CAPI)
Italy (25) (PAPI)
Quota sampling (following as
much as possible the structure
of the general population by
age, gender and region)
May 2013
Online panel
Denmark (50)
Italy (25)
IPSOS online panels ; quota
sampling (following as much as
possible the structure of the
general population by age,
gender and region)
May 2013
Face-to-Face
(CAPI)
Malta (750)
Estonia (1000)
Slovenia (1000)
Slovakia (1000)
Poland (1000)
Czech Republic (1000)
Lithuania (1000)
Hungary (1000)
Latvia (1000)
Cyprus (1000)
Portugal (1000)
Greece (1000)
Romania (1000)
Bulgaria (1000)
Germany (500)
Italy (500)
Random probability sampling
June-July
2013
(planned)
Online panel
Netherlands (1000)
Luxembourg (750)
Sweden (1000)
Denmark (1000)
Quotas based on age, gender
and region
June-July
2013
(planned)
Cognitive
testing
Face-to-Face
(PAPI)
Face-to-Face
(CAPI)
Pilot Survey
Main Survey
Timeline
19
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Survey
phase
Implementation
Countries (sample
size)
Recruitment of respondents
Timeline
Finland (1000)
UK(1000)
France (1000)
Austria (1000)
Belgium (1000)
Ireland (1000)
Spain (1000)
Germany (500)
Italy (500)
3.3 Considerations for sampling and recruiting of respondents
Focusing the Use Cases on specific contexts allowed us to keep potential findings relevant to the choice
scenarios and made it possible to capture finer details in each choice context. However, it is clear that some
choice contexts could be less relevant to some sections of the population than others. Specifically, the
survey sections on travel and internet could be less relevant for people who never use metro or train and
people who have never used internet respectively.
For the travel context we believe that people will be still able to relate to the information presented even if
they never use metro or train, mainly because the security measures which are described in choice
scenarios are of common knowledge and people could come across these in other situations such as air
travel. Hence it was decided that we present the travel context to all respondents irrespective of their
familiarity with train or metro travel. However we capture the familiarity through a question about
frequency of travel using metro and train, which we can use to test if the responses from respondents who
have never travelled or who travel infrequently by metro or rail should be dropped during analysis. Further,
for these respondents, we present the travel section after health and internet sections to ensure that we
present the respondents with the most familiar contexts first.
The decision related to the presentation of the internet context to respondents who have never used
internet was not as straightforward as compared to the travel context. The internet context is the most
technical section of the questionnaire, from a lay person’s perspective. This section may be difficult for
people who have never used the internet before (such respondents will be recruited only from face-to-face
surveys). To address this issue, we added a small introduction in the survey to explain what the internet is
to people who have never used it. However, during the initial stages of cognitive testing of the
questionnaire it was found that asking internet related questions to people who have never used it involves
risks of:
1. a big attrition rate in the responses (which could bias the sample for travel and health) and
2. getting insincere responses which could be of little use or misleading.
The cognitive interviewers also observed that people who do not use the Internet did not really understand
various (seemingly) basic terms (such as web search) on internet use. It was felt that even if we consider
explaining all the terms related to internet use, it will consume a lot of interview time and hence was
20
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
deemed infeasible. Accordingly, it was decided that people who have never used Internet should not be
asked to answer the internet section of the survey.
4. Concluding remarks
The PACT survey is one of the largest surveys on the topic involving public perceptions of security and
privacy and will be conducted across 27 European Member States. This document provided details on the
methodological approach, survey implementation, ethical review and sections of questionnaire. The survey
design process was followed by the cognitive testing and pilot data collection before the questionnaire is
used for the collection of data across all countries. The questionnaire attached with this report will be
refined further depending on the feedback received from the cognitive interviews and pilot data analysis.
21
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Annexes
A1 Survey Questionnaire
Date: 13th May 2013
Q_COUNTRY.
PROG: HIDDEN QUESTION
RECORD COUNTRY OF SURVEY
METHODOLOGY:
1. ONLINE
2. OFFLINE
Please confirm if you have read the information document and whether you agree to proceed with this
survey in light of information provided in this document.



Yes, I have read the information document and agree to participate in the survey
No, I have read the information document but I do not want to participate in the survey
No, I have not read the document
PROVIDE THE LINK TO THE DOCUMENT IF ANSWER 3 – NO, I HAVE NOT READ THE DOCUMENT
Q_INTRO.
PROG: INFO TEXT
We are a research team of 11 partners led by the Centre for Science, Society and Citizenship in Italy.
Through this research study, which is funded by the European Commission, we are aiming to understand
individual perceptions and concerns about security and privacy of European citizens in everyday life.
As part of this study, we are conducting a survey and would welcome your participation.
Your responses will be kept confidential and will be used for research purposes only, as per the Market
Research Society’s Code of Conduct. Findings derived from combining all responses will be made publicly
available via reports and research articles.
The survey takes approximately 40 minutes to complete. Before the main survey begins we’ll ask you the
following three questions to ensure that we have sufficient responses from people from all age groups,
gender and region.
_________________________________________________
DEMOGRAPHIC QUESTIONS
_________________________________________________
22
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Q1. Are you…?
PROG: SINGLE ANSWER
1. Male
2. Female
Q2. How old are you?
PROG: NUMERICAL 2 DIGITS FROM 0 TO 99
PROG: IF Q2<18 STOP INTERVIEW
/---/
Q3. From the options below, please choose the region that you live in.
PROG: USE EXCEL FILE FOR THE REGION PER COUNTRY
Q4. How often do you use a metro, train, or other mass public transport system for travel within or
between cities?
PROG: SINGLE ANSWER
1. Every day
2. Several times a week
3. Once a week
4. Several times a month
5. Once a month
6. Several times a year
7. Once a year or less
8. Never
PROG: IF CODE 8- NEVER, THE ORDER OF THE SECTIONS SELECTED IN Q4 WILL BE:
1) INTERNET SECTIONS (QUESTIONS FROM Q20 TO QB8)
2) HEALTH SECTION ( QUESTIONS FROM Q26 TO QC8 )
3) TRAVEL SECTION ( QUESTIONS FROM Q14 TO QA8 )
PROG: IF NO CODE 8 IN Q4 THE ORDER WILL BE THE QUESTIONNAIRE ORDER:
1) TRAVEL SECTION ( QUESTIONS FROM Q14 TO QA8)
2) INTERNET SECTION ( QUESTIONS FROM Q20 TO QB8 )
3) HEALTH SECTION ( QUESTIONS FROM Q26 TO QC8 )
Q5. Have you ever used the Internet?
PROG: ASK THIS QUESTION ONLY FOR METHODOLOGY =OFFLINE
1. Yes
2. No
23
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
PROG :IF CODE 2 SELECTED IN Q5 AND NO CODE 8 IN Q4 SHOW THE FOLLOWING ORDER OF THE
SECTIONS:
1) TRAVEL ; 2 ) HEALTH; 3 ) INTERNET
IF CODE 2 SELECTED IN Q5 AND CODE 8 SELECTED IN Q4 SHOW THE FOLLOWING ORDER OF THE
SECTIONS:
1) HEALTH; 2 ) TRAVEL ; 3 ) INTERNET
IF CODE 1 SELECTED IN Q5 AND CODE 8 IN Q4 SHOW THE FOLLOWING ORDER OF THE SECTIONS: 1)
INTERNET; 2 ) HEALTH ; 3 ) TRAVEL
IF CODE 1 SELECTED IN Q5 AND NO CODE 8 SELECTED IN Q4 SHOW THE FOLLOWING ORDER OF THE
SECTIONS: 1) TRAVEL; 2 ) INTERNET ; 3 ) HEALTH
Q6. How frequently do you travel outside the country of your residence for holiday or work?
PROG: SINGLE ANSWER
1.
2.
3.
4.
5.
6.
Several times a month
Once a month
Several times a year
Once a year
Once every 2 years or less
Never
Q7. What do you think are the most important challenges to the security of EU citizens at the
moment?
PROG: PLEASE SELECT UP TO 3 ANSWERS
Error message : There are too many answers, maximum 3 are allowed.
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
Civil wars and wars
Corruption
Cybercrime
Economic and financial crises
Environmental issues/ Climate change
Illegal immigration
Insecure employment conditions (e.g. low wages, long working hours, temporary employment)
Insecurity of EU borders
Natural disasters
Nuclear disasters
Organised Crime
Petty crime
Poverty
24
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
14.
15.
16.
17.
18.
19.
20.
Religious extremism
Terrorism
The gap between rich and poor people
Privatisation of public services.
Unemployment
Other (please, specify) [ OPEN ANSWER ]
Don’t know [ EXCLUSIVE ANSWER ]
Q8. How much do you trust the following institutions? Please use a scale from 1 to 5 where 1 means
you do not trust them at all and 5 means you trust them completely.
PROG: SINGLE ANSWER PER ROW
SCALE:
1. Do not trust at all
2.
3.
4.
5. Trust them completely
ITEMS:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
Banks in your country to allow you to invest, save and protect your money
Companies in your country to offer you products and services
Data protection authorities to help enforce your data protection rights
Large internet based companies such as Google or Facebook to allow you find and share
information online
Multinational companies to offer products and services
NGOs and civil society groups to help keep other organisations in check
Private health insurance companies in your country to provide for healthcare
Religious institutions in your country to allow you to exercise the right to worship
The army to protect your country
The courts of law in your country to provide for law and order
The European Union to provide and prosperity in Europe
The health care in your country to provide for health
The media (newspapers, television, radio, online) in your country to allow you access to news and
current affairs
The national government of your country to provide for security
The United Nations to keep global power in check
Trade unions in your country to help protect your labour rights
Universities in your country to give quality education
Q9. Please indicate how concerned you are with each of the following issues. Use a scale from 1 to 5
where 1 means Not Concerned At All and 5 means Very Concerned.
PROG: SINGLE ANSWER PER ROW
25
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
SCALE:
1. Not concerned at all
2.
3.
4.
5. Very concerned
ITEMS:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
National security in your country by national security we mean absence of war or terrorism
The impact of unemployment in your country on its security
Your personal safety on buses, trains, and metros
Unauthorised people using your bank card or your bank card information
The gap between the rich and the poor leading to possibility of civil unrest
The level of your computer’s protection against viruses or spam
Security of online purchasing or online bank transactions
Someone having access to your personal information without your knowledge and consent
A health epidemic in your country
Bad working conditions (e.g. low wages, long working hours)
Your general personal safety for the next 6 months
Your own job security
Your own health and wellbeing
Q10.How familiar are you with the laws in your country that deal with the protection of personal
information collected through public security surveillance? Please use a scale from 1 to 5 where 1
means No Knowledge At All and 5 means Good Knowledge.
PROG: SINGLE ANSWER
1. No knowledge at all
2.
3.
4.
5. Good knowledge
Q11. To what extent do you believe laws are effective in protecting your personal information
collected through public security surveillance? Please use a scale from 1 to 5 where 1 means Not
Effective At All and 5 means Very Effective.
PROG: SINGLE ANSWER
1. Not effective at all
2.
3.
4.
26
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
5. Very effective
Q12.To what extent you feel there is sufficient democratic control on the use of your personal data by
security agencies. Please use a scale from 1 to 5 where 1 means Not Sufficient At All and 5 means
Very Sufficient.
PROG: SINGLE ANSWER
1. Not sufficient at all
2.
3.
4.
5. Very sufficient
Q13. How successful do you think your government is in respecting human rights and freedom while
implementing public security-related surveillance? Please use a scale from 1 to 5 where 1 means Not
At All Successful and 5 means Very Successful.
PROG: SINGLE ANSWER
1. Not at all successful
2.
3.
4.
5. Very successful
__________________________________________________________________________________
1. Section 1 : Questions on Travel
__________________________________________________________________________________
Q14_intro.
PROG : INFO TEXT
The following questions are related to travel experience by metro or train.
PROG: DO NOT PRESENT THE FOLLOWING QUESTIONS: Q14, Q15, Q16, Q17, Q18 IF TRAVEL FREQUENCY
Q4 = NEVER;
Q18b- ASK ALL
Q14. Think about the last time you travelled by metro or train. On that journey, how long did you
have to wait for the train/metro at the station?
PROG: SINGLE ANSWER
1. Less than 15 minutes
27
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
2.
3.
4.
5.
6.
15 minutes to up to 30 minutes
30 minutes to up to 1 hour
1 hour to up to 2 hours
2 hours to up to 3 hours
More than 3 hours
Q15. Thinking of your last journey, how long did you spend on the metro or train?
PROG: SINGLE ANSWER
1.
2.
3.
4.
5.
6.
Less than 15 minutes
15 minutes to up to 30 minutes
30 minutes to up to 1 hour
1 hour to up to 2 hours
2 hours to up to 3 hours
More than 3 hours
Q16. What was the cost of ticket in your last train/metro journey? Please give an approximate single
one-way journey cost if you purchased a season ticket or a return ticket.
PROG: NUMERICAL 2 DIGITS AND 2 DECIMALS
PROG: CURRENCY EURO, GBP, ETC. DEPENDING ON THE COUNTRY
/__/, /__/
Q17. Now thinking about your metro/train journeys over the past two years, which of the following
security
measures
have
you
come
across?
Select all that apply.
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
PROG: MULTIPLE ANSWERS POSSIBLE
Closed circuit television (CCTV) cameras on station premises
Closed circuit television (CCTV) cameras inside train/metro compartments
Unarmed security personnel
Armed security personnel
Security dogs
Metal/drug/explosives detector
Body searching
Other
None of the above [ EXCLUSIVE ANSWER ]
Don’t know [ EXCLUSIVE ANSWER ]
Q18b. Which of the following do you consider to be threats to security when travelling by metro or
train?
Select all that apply.
PROG: MULTIPLE ANSWERS POSSIBLE
28
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
PROG: ASK ALL
1. Pick-pocketing
2. Terrorism
3. Aggression towards women
4. Violence
5. Misuse of alert buttons, emergency brakes, etc.
6. Suicide attempts on train tracks
7. Vandalism (damaging public property)
8. Antisocial behaviour (e.g. drunk people who cause trouble to passengers)
9. Illegal drug transactions
10. Fare evasion (not paying fares)
Q18 . Which of the following have you ever personally experienced/witnessed during a previous journey?
Select all that apply
PROG: MULTIPLE ANSWERS PER ROW AND PER COLUMN
PROG: CODE 11 IS NOT MANDATORY
PROG: COLUMN 3 EXCLUSIVE
1.Experienced 2.Witnessed Neither experienced
nor witnessed
Pick-pocketing
Terrorism
Aggression towards women
Violence
Misuse of alert buttons, emergency
brakes, etc.
Suicide attempts on train tracks
-
Vandalism (damaging public property)
-
Antisocial behaviour (e.g. drunk people
who cause trouble to passengers)
Illegal drug transactions
-
Fare evasion (not paying fares)
-
-
Other (please specify) [OPEN TEXT]
Q19_INTRO.
PROG: INFO TEXT
PROG: TO ALL
29
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Various security measures and technologies have been put in place at train and metro stations and inside
vehicles to address such security threats. Such measures include deploying CCTV to spot suspicious objects,
persons, and activities, deploying metal detectors or scanners to reveal hidden explosives or arms, and
deploying security personnel to deter anti-social and criminal behaviour. Some of these security provisions
can also have implications related to your privacy.
Q19. Which of the following are you concerned about when travelling by metro/train?
Select all that apply.
1.
2.
3.
4.
5.
6.
7.
PROG: MULTIPLE ANSWERS POSSIBLE
Misuse of CCTV images by the authorities
Storage of CCTV images for longer than necessary according to law
Misuse of travel data (travel origin, destination, frequency) for tracking a person’s whereabouts
Misuse of security measures for sexual or racial harassment
Sharing travel data and CCTV images across and outside the EU.
None of these [ EXCLUSIVE ANSWER ]
I never travel using metro/train [ EXCLUSIVE ANSWER ]
___________________________________________________________________________
EXERCISE 1: TRAIN / METRO TRAVEL:
_____________________________________________________________________________
INTRO_TRADEOFF1_1.
PROG: INFO TEXT
Imagine that you are just about to make a journey on metro or train. Transport operators and security
agencies may implement a range of security measures such as video surveillance and deploying security
personnel with the aim of making such train and metro journeys safer against a range of threats including
pickpocketing, vandalism or even terrorism. Some of these measures have potential for misuse and may
also affect your privacy for example when security personnel go through your baggage.
Next we’ll present you with a set of five scenarios with different options for this hypothetical metro or train
journey. In each question please carefully consider the potential each option has in terms of addressing
possible security and privacy threats. You are also presented with the costs for security measures. This is
usually paid as part of your ticket price.
QA1_INTRO.
Please then choose the option you most prefer. We note that there are no correct answers, we are simply
interested in your preferences.
30
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
PROG: SINGLE ANSWER
PROG: PLEASE RANDOMISE THE ORDER OF ATTRIBUTES (ROWS) FOR DIFFERENT RESPONDENTS- THE
ORDER REMAINS SAME FOR ALL QUESTIONS OF A RESPONDENTS}
PROG : EACH RESPONDENTS SEES 5 SCENARIOS BASED ON THE EXCEL FILE
31
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QA1. Which of the following options would you most prefer for your train or metro journey?
Option A
Option B
Option C
Advanced CCTV that enables
abandoned bag detection
Advanced CCTV that enables realtime face recognition
Data stored for 45 days and can
be accessed by Only the travel
authority
Data stored for 15 days and can
be accessed by Travel authority,
police, European and
International security agencies
Advanced CCTV that enables realtime recognition of suspicious
movement of people
Data stored for 3 days and can be
accessed by Travel authority,
police, European and
International security agencies
None at the station
Travel authority security staff at
the station
Armed police with trained dogs at
the station
Physical security checks at the
station and time added
No physical checks
Randomly selected for full body
pat-down and bag check, which
could take an additional 10
seconds
Randomly selected to go through
metal detector or full body
scanner, which could take an
additional 10 minutes
Additional security surcharge
(on top of ticket cost)
Security surcharge of 0,50 Euro
No security surcharge
Security surcharge of 0,50 Euro
CCTV cameras
Type of security personnel at
the station
Option D
None of these,
I would prefer not to make this
journey by train/metro
32
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QA2. Which of the following options would you most prefer for your train or metro journey?
Please note that the options have changed
PROG: SINGLE ANSWER
PROG: QA2 REPRESENTS THE SECOND SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL
FILE
QA3 .Which of the following options would you most prefer for your train or metro journey?
Please note that the options have changed
PROG : SINGLE ANSWER
PROG : QA3 REPRESENTS THE THIRD SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL
FILE
QA4. Which of the following options would you most prefer for your train or metro journey?
Please note that the options have changed
PROG: SINGLE ANSWER
PROG : QA4 REPRESENTS THE FORTH SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL
FILE
QA5 Which of the following options would you most prefer for your train or metro journey?
Please note that the options have changed
PROG: SINGLE ANSWER
PROG: QA5 REPRESENTS THE FIFTH SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QA.6 Were you able to make choices from the situations just presented to you?
PROG: SINGLE ANSWER
1. Yes
2. No
33
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QA.7. Why did you find it difficult to make the choices?
PROG: OPEN
PROG: IF QA.6 == NO
[INSERT OPEN TEXT BOX]
QA.8. Of the options presented, which of the following were unclear to you? Select all that apply.
PROG: MULTIPLE ANSWERS
PROG : IF QA.6 == NO, ALLOW MULTIPLE CHOICE BETWEEN 2 AND 8; CODE 1 EXCLUSIVE
1.
2.
3.
4.
5.
6.
7.
8.
None, all choices were clear [ EXCLUSIVE ANSWER ]
Recognition capabilities in CCTV cameras
Time period for storing CCTV data
Who has access to CCTV data?
Type of security personnel at the station
Security measures at the station
Time to pass though security checks and related queues
Additional security surcharge (on top of ticket cost)
34
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
__________________________________________________
2. Questions on Internet use
__________________________________________________
Q20_INTRO.
PROG: INFO TEXT
Now, we’ll ask you some questions related to the Internet.
PROG: IF METHODOLOGY = OFFLINE AND NO EXPERIENCE OF INTERNET ‘Q5=No’ THEN – SHOW
THE FOLLOWING INTRODUCTION CARD EXPLAINING WHAT INTERNET IS. ALSO, SKIP NEXT
THREE QUESTIONS , Q21, Q22,23
The Internet is a global system of interconnected computer networks. It carries an
extensive range of information resources and services. It is used for communication in
various ways such as sending/receiving emails, making video calls, internet based phone
calls, and for keeping contact with general public, friends and family through social
networks. Different websites offer a medium just like books or newspapers to access this
information and to make contact just like the telephone. Websites are also a medium to
access services such as shopping, banking or paying bills online. The Internet can be
accessed from a computer and smart phone that is connected to the network. An internet
service provider sells you such an access.
Q20. In a typical week, how many hours do you spend on the Internet for personal use (i.e., not
including work-related use of the Internet)?
PROG: SINGLE ANSWER
1.
2.
3.
4.
5.
6.
7.
More than 20 hours per week
Between 14 and 20 hours per week
Between 7 and 13 hours per week
Between 3 and 6 hours per week
Between 1 and 2 hours per week
Less than 1 hour per week
I do not have access to the Internet for personal use
Q21. Please select from the list below the type of activities that you have used the internet for during
the past month. Select all that apply.
PROG: MULTIPLE ANSWERS POSSIBLE
1. Email / communications (including content)
2. Accessing news, magazine websites
3. Web search (e.g. Google)
35
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
Online banking
Online shopping
Online bill payment
Chat rooms, discussion forums, and comments on websites
Watching movies, videos, TV shows and listening to online music/radio
Social networking (e.g. Facebook, MySpace, LinkedIn) and/or photo/video sharing
Online phone and video calls (e.g. Skype)
Contributing to blogs and Microblogs (e.g. Twitter)
Gaming
Online betting, casinos, etc.
File sharing (Access to P2P networks and torrent sharing) and downloading content
e-Government services
Cloud services: storage, cloud apps (e.g. Dropbox, iCloud, AWS-Amazon)
Other
Q22. If you have a social networking profile (on websites similar to Facebook, Twitter, Myspace), which
of the following describes your privacy settings:
PROG: SINGLE ANSWER
1.
2.
3.
4.
5.
6.
Public, so that everyone can see your pictures/comments
Partially private, so that friends of friends or your networks can see your pictures/comments
Private so that only your friends can see your pictures/comments
I don’t know
I don’t have a social networking profile
Prefer not to answer
Q23. Which of the following are you concerned about when using the internet? Select all that apply.
PROG: MULTIPLE ANSWERS POSSIBLE
PROG : TO ALL
1. Spam/unwanted emails
2. Financial /credit card fraud
3. Phishing- theft of financial data (such as credit card information) or Identity theft –theft of
personal information to be used for impersonating you
4. Malware or computer virus which harms your computer
5. Harassment or cyber bullying
6. Use of internet by terrorists training and planning of attacks
7. Use of internet for creating panic and/or spreading hatred
8. Use of internet to share and publish child pornography
9. Use of internet to perpetrate organised crime
10. Illegal sharing and downloading of copyrighted material (e.g. movies)
11. Other, please, specify [OPEN TEXT BOX]
36
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
12. None of these [ EXCLUSIVE ]
13. I have never used the internet [ EXCLUSIVE]
Q24.Have you or someone you know experienced any of the following? Select all that apply.
PROG: MULTIPLE ANSWERS PER ROW AND PER COLUMN
PROG: CODE 6 IS NOT MANDATORY
PROG: COLUMN 3 IS EXCLUSIVE
PROG : TO ALL
1.You have
experienced
this yourself
2.One of your
acquaintances
experienced this
3.Neither you or
your acquaintances
experienced this
1.Spam emails
2.Financial /credit card frauds
3.Phishing- theft of financial
data (such as credit card
information) or Identity theft
–theft of personal information
to be used for impersonating
you
4.Malware or computer virus
which harms your computer
5.Harassment or cyber
bullying
6.Other,
please,
specify
[OPEN TEXT BOX]
Q25_INTRO.
PROG : INFO TEXT
Various security measures and technologies are put in place by Internet Service Providers (ISP) and
websites to address such security threats. Police and crime investigation agencies through internet service
providers and websites can get access to information on a person’s online activity in terms of their physical
location, websites visited, e-mail/social network communication, and contents uploaded and downloaded
by them. Such information is used in investigation of crimes and especially those involving illegal
downloads, distribution of child pornography, tax evasion, financial crimes and identity theft. Some of the
security measures used by these parties can also have implications related to your privacy.
Q25.Which of the following are you concerned about when using the Internet? Select all that apply.
PROG : MULTIPLE ANSWERS POSSIBLE
37
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
1.
2.
3.
4.
5.
6.
7.
8.
Personal data shared by websites with third parties for spam or marketing
Internet surfing habits shared with third parties for personalized/targeted advertising
Violation of terms of use in relation to personal information submitted online
Private conversations being monitored
Access of internet surveillance data across security agencies
Your location made known and shared with third parties (e.g. law enforcement agencies).
None of these [ EXCLUSIVE ]
I have never used the internet [ EXCLUSIVE ]
INTRO_TRADEOFF 2.
[Stated Preference section for Internet Service Provider]
PROG: INFO TEXT
An ISP is a company that provides you with an Internet connection through cable or wireless connection
(like utility companies offering you electricity and gas services). Imagine that you are just about to start or
renew a subscription to an internet service provider. While the Internet is a great tool for a variety of
activities including communication, shopping and banking, it is also used by criminal elements. Law
enforcement entities have requested access to and have successfully used internet communications data
for prevention, investigation, detection, and prosecution of criminal offences. Some features of this
monitoring and storage requirement may affect your privacy and also has potential for misuse such as in
cases where these data may be used to monitor the activities of any group which may come into conflict
with the state.
Next we’ll present you with a set of five scenarios involving different options for this hypothetical
subscription to an Internet Service Provider. In each question please carefully consider the potential each
option has in terms of addressing possible security and privacy threats. You are also presented with the
costs for internet security and data management. This is usually paid as part of your subscription.
QB1_INTRO.
Please then choose the option you most prefer. We note that there are no correct answers, we are simply
interested in your preferences.
PROG: PLEASE RANDOMISE THE ORDER OF ATTRIBUTES (ROWS) FOR DIFFERENT RESPONDENTS- THE
ORDER REMAINS SAME FOR ALL QUESTIONS OF A RESPONDENTS
PROG : ONE RESPONDENTS WILL SEE 5 SCREENS OF 3 OPTIONS EACH + NONE OF THESE BASED ON THE
EXCEL FILE PROVIDED
38
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QB1. Which of the following options would you most prefer as your internet service provider?
PROG : SINGLE ANSWER
Option A
Option B
Option C
Handling of your internet usage
information
Information about list of websites visited
and location of user will be stored for 1 year
and will not be shared with any law
enforecement agency
Information about list of websites visited
will be stored for 6 months and will be
shared with law enforcement agencies
across the world
Information about all internet activities but
not including the content of communications
will be stored for 5 years and will be shared
with national law enforcement agencies
Annual report of data monitoring
activities in your country
The ISP will publicise annually information
about:
The ISP will publicise annually information
about:
The ISP will not publicise any information on
data monitoring acitivies in your country
number of law enforcement requests
related to data disclosure, and
number of law enforcement requests
related to data disclosure,
types of data that were accessed by the
law enforcement agencies in your country
types of data that were accessed by the
law enforcement agencies, and
Option D
None of these,
I would prefer to look for another Internet
Service Provider
number of convictions that were made
based on this data in your country
Conditions under which ISP enables
surveillance of users by the police
ISP can enable surveillance of users by the
police if there is suspicion against a person
and only with a warrant
ISP can enable surveillance of users by the
police if there is a suspicion against a
person and without a warrant
ISP can enable surveillance of users by the
police only under government declared state
of emergency
Serivces offered to improve online
privacy
ISP will offer tips on how to set up fully
anonymous browsing (user location not
available to websites unless allowed by
user)
ISP will not offer any service to improve your
online privacy
ISP will offer advice to users on which
websites don't meet their indicated level of
privacy
Monthly cost or discount for internet
security and data management
You receive a 3 Euros discount
You pay a 3 Euros premium
There is no impact on price
39
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QB2 .Which of the following options would you most prefer internet service provider?
Please note that the options have changed
PROG: SINGLE ANSWER
PROG : QB2 IS THE SECOND SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QB3. Which of the following options would you most prefer internet service provider?
Please note that the options have changed
PROG: SINGLE ANSWER
PROG : QB3 IS THE THIRD SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QB4. Which of the following options would you most prefer internet service provider?
Please note that the options have change
PROG: SINGLE ANSWER
PROG: QB4 IS THE FORTH SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QB5. Which of the following options would you most prefer internet service provider?
Please note that the options have change
PROG: SINGLE ANSWER
PROG: QB5 IS THE FIFTH SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QB.6. Were you able to make choices from the situations presented to you ?
PROG : SINGLE ANSWER
1. Yes
2. No
QB.7. Why did you find it difficult to make the choices.
PROG: OPEN
40
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
PROG: IF QB.6 == NO
[INSERT OPEN TEXT BOX]
QB.8. Of the options presented, which of the following were unclear to you? Select all that apply.
PROG: MULTIPLE ANSWERS POSSIBLE
PROG: ALLOW MULTIPLE CHOICE BETWEEN 2 AND 7, IF QB.6 == NO
1.
2.
3.
4.
5.
6.
7.
None, all choices were clear [ EXCLUSIVE ]
Extent of internet usage information stored
Retention period of personal information
Annual report of data monitoring activities in your country publicised by ISP
Conditions under which ISP enables the surveillance of users by the police
Services offered to improve online privacy
Monthly cost or discount for security and data management
41
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
__________________________________________________
8. Questions on health records
Q26_INTRO.
PROG : INFO TEXT
PROG : TO ALL
We would now like to ask you some question related to healthcare.
Q26.How would you estimate your health in general?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
6.
Very good
Good
Fair
Bad
Very bad
Prefer not to answer
Q27.Does your current health status require any specialised medical services?
PROG : SINGLE ANSWER
1. Yes
2. No
3. Prefer not to answer
Q28.Do you suffer from any medical conditions which require long-term treatment (more than six
months)?
PROG: SINGLE ANSWER
1. Yes
2. No
3. Prefer not to answer
INTRO_TRADEOFF_3 .
[Stated Preference section for healthcare]
PROG : INFO TEXT
Now, we will present you with a set of hypothetical scenarios related to the storage and accessibility of
your health data/records. These data may include personal details such as: name, address, blood
group/type, allergies, current health conditions and medical history.
42
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Currently, there are devices or services (in the form of health ID, card, tag, etc.) on the market which can
store your own health data or allow access to those data. These devices/services are available for purchase
or may be provided by your national government at some cost to you. Payment for such devices or services
may be explicit or made through income tax or health insurance contributions. The following scenarios
present the cost of such devices and services.
Such devices and services can assure faster response and accurate treatment in a medical emergency, by
making doctors and medical personnel aware of any existing conditions (e.g., allergies to medicine, food),
by helping authorities with personal identification and fast response in an medical-emergency situation
(e.g.. pandemic, flu), while traveling abroad, and by helping advance research in medical science.
For certain age groups and vulnerable populations, such devices and services can help in disease
prevention, for example by providing medical support via tele-medicine services, especially for elderly
people, people with disabilities, or those who live in remote areas. Also, such devices and services can help
early detection of epidemics and receipt of early location-based warnings or guidelines.
INTRO_Q29. On the other hand, such devices and services can have implications related to the privacy of
your health data.
PROG : INFO TEXT
Q29.Which of the following would you feel concerned about?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
Information accessed by non-medical personnel (e.g. police)
Information accessed by private companies (such as pharmaceutical and insurance companies),
Information accessed by unauthorised individuals and institutions
Misuse of personal health information for harassment
None of these
INTRO_QC1_1.
PROG : INFO TEXT
Imagine that you are presented with a choice of purchasing such a medical data storage device or service.
Such a device or service can be very useful in providing quick access to your medical records in variety of
situations and can also help reduce the medical errors. However, information stored on such a device or
system can also be misused or may affect your privacy for example when unauthorised users get access to
such information.
Next we’ll present you with a set of five scenarios involving different options for this hypothetical purchase
of health data storage device or system. In each question please carefully consider the potential each
option has in terms of its usefulness and threat to privacy.
INTRO_QC1_2.
PROG : INFO TEXT
43
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Please then choose the option you most prefer. We note that there are no correct answers, we are simply
interested in your preferences.
PROG INSTRUCTIONS TRADE OFF: – PLEASE RANDOMISE THE ORDER OF ATTRIBUTES (ROWS) FOR
DIFFERENT RESPONDENTS- THE ORDER REMAINS SAME FOR ALL QUESTIONS OF A RESPONDENTS
PROG : ONE RESPONDENT SEES 5 SCREENS OF 3 OPTIONS + NONE OF THESE BASED ON THE EXCEL FILE
44
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QC1 . Which of the following options would you most prefer for a health record storage device/system?
PROG : SINGLE ANSWER
Option A
Information stored on the device/system for sharing
Basic health information: blood group, allergies, diabetic status
Identification information: name, address, age, photograph,
nationality
Information about serious health conditions
Information about all health conditions: mental health, sexual
health, addictions, if any
Option B
Information on device/service
Basic health information
Identification
Serious health conditions
All health conditions
P
P
P
P
Option C
Information on device/service
Basic health information
Identification
Serious health conditions
All health conditions
P
P
O
O
Option D
Information on device/service
Basic health information
Identification
Serious health conditions
All health conditions
P
O
O
O
Which authorities can access the information on device/system
Hospitals in and outside of your country
of residence and emergency medical
personnel can access the information
Hospitals in and outside of your
country of residence can access the
information
Hospitals in and outside of your country
of residence, emergency medical
personnel and other emergency
services including fire and rescue can
access the information
Cases when access to this information is widened to
governmental agencies across EU
Access to information is widened in the
event of public health emergency (e.g. flu
pandemic)
Access to information is widened in
the event of in no circumstances
Access to information is widened in the
event of any personal health emergency
(car accidents, fires)
Who can enter/edit this information?
Your family doctor, authorised hospital
staff and emergency medical personnel
in your country can enter/edit
information
Only your family doctor can enter/edit
information
Your family doctor, authorised hospital
staff and emergency medical personnel
in your country can enter/edit
information
Who else can view this information apart from the medical
specialists?
Immediate family can also view your
information on this device/service
Your insurance company can also view
your information on this
device/service
Nurses providing home care can also
view your information on this
device/service
Availability of anonymous data sharing for medical research
Your information can be used for medical
research anytime without your prior
consent
Your information can be used for
medical research only if you have
provided a prior consent
Your information can never be used for
medical research
Cost
It will be free (given by your hospital)
It will cost 2 Euros per month
It will cost 4 Euros per month
I would not purchase any such
device/service
45
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
QC2. Which of the following options would you most prefer for the health record storage
device/system?
Please note that the options have changed
PROG : SINGLE ANSWER
PROG : QC2 REPRESENTS THE SECOND SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL
FILE
QC3 .Which of the following options would you most prefer for the health record storage
device/system?
Please note that the options have changed
PROG : SINGLE ANSWER
PROG : QC3 REPRESENTS THE THIRD SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QC4. Which of the following options would you most prefer for the health record storage
device/system?
Please note that the options have changed
PROG : SINGLE ANSWER
PROG : QC4 REPRESENTS THE FORTH SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
QC5. Which of the following options would you most prefer for the health record storage
device/system?
Please note that the options have changed
PROG : SINGLE ANSWER
PROG : Q52 REPRESENTS THE FIFTH SCREEN SEEN BY THE RESPONDENT BASED ON THE EXCEL FILE
INTRO _QC6 .
PROG : INFO TEXT
Please answer the following questions to help us understand how you made the choices.
QC.6 .Were you able to make choices from the situations presented to you?
PROG : SINGLE ANSWER
46
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
1. Yes
2. No
QC.7. Why did you find it difficult to make the choices
PROG : OPEN
PROG : [IF QC.6 == NO]
[INSERT OPEN TEXT BOX]
QC.8. Of the options presented, which of the following were unclear? Select all that apply.
PROG: MULTIPLE ANSWERS POSSIBLE
PROG: [ALLOW MULTIPLE CHOICE BETWEEN 2 AND 8, IF QC.6 == NO]
1.
2.
3.
4.
5.
6.
7.
8.
None, all characteristics are clear [ EXCLUSIVE ]
Information stored on the device/system for sharing
Which authorities can access the information on device/system
Cases when access to information is widened
Who can enter or edit the information
Who else can view the information
Availability of anonymous information sharing for medical research
Cost
47
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
________________________________________________
4. General questions
________________________________________________
Q30.We would like to ask your opinion regarding some general issues .In the following questions,
please indicate your answer by selecting a number from 1 to 5, where 1 corresponds to Not At All
Important and 5 corresponds to Very Important.
PROG : SINGLE ANSWER PER ROW
SCALE :
1. Not at all important
2.
3.
4.
5. Very important
ITEMS:
1. Protecting the privacy of my personal information is ..
2. Taking action against important security risks (e.g., international terrorism, organised crime) is..
3. Defending civil liberties and human rights is …
Q31. For each of the following statements, please indicate your answer by selecting a number from 1
to 5, where 1 corresponds to Disagree Strongly, 3 corresponds to Neutral, and 5 corresponds to
Agree Strongly.
PROG : SINGLE ANSWER PER ROW
SCALE :
1. Disagree strongly
2.
3. Neutral
4.
5. Agree strongly
ITEMS :
1.
2.
3.
4.
Technology has almost got out of control
Government can generally be trusted to look after our interests
The way one votes has no effect on what the government does
In general business helps us more than it harms us
48
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Q32. For each of the following statements, please indicate your answer by selecting a number from 1
to 5, where 1 corresponds to Disagree Strongly, 3 corresponds to Neutral, and 5 corresponds to
Agree Strongly.
PROG : SINGLE ANSWER PER ROW
SCALE :
1. Disagree strongly
2.
3. Neutral
4.
5. Agree strongly
ITEMS :
1. Often security is just an excuse to impose stricter surveillance and control over the population
2. Public security surveillance systems are not designed to provide acceptable privacy protections
3. I feel that the priorities of State authorities in terms of security differ significantly from my
personal worries and expectations
4. More surveillance has risks of creating discrimination or amplifying differences between social
groups
5. In terms of results (reduction of crime rates) I don’t think investments in security are being
particularly effective
6. I’m concerned about the amount of personal information collected by private companies and
government
7. I’m concerned about the accuracy and quality of personal information stored about me
8. The best way to protect my privacy is with stronger regulations and laws
Q33. For each of the following statements, please indicate your answer by selecting a number from 1
to 5, where 1 corresponds to Disagree Strongly, 3 corresponds to Neutral, and 5 corresponds to
Agree Strongly.
PROG : SINGLE ANSWER PER ROW
SCALE :
1. Disagree strongly
2.
3. Neutral
4.
5. Agree strongly
ITEMS :
1. Most Internet websites are safe environments in which to exchange information with others
2. Most Internet websites are reliable environments in which to conduct business transactions
3. Most Internet websites handle personal information submitted by users in a competent fashion
49
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
4. I would rather decline access to certain services than giving out my personal data or letting my
behaviour be monitored
5. I am concerned that too much personal information is collected and stored by Internet websites or
Internet Service Providers
Q34. Here are some statements about personal information related to healthcare. Please indicate the
extent to which you, as an individual, agree or disagree by selecting a number from 1 to 5, where 1
corresponds to Disagree Strongly, 3 corresponds to Neutral, and 5 corresponds to Agree Strongly.
PROG: SINGLE ANSWER PER ROW
SCALE:
1. Disagree strongly
2.
3. Neutral
4.
5. Agree strongly
ITEMS :
1. A system which stores health related data can be useful in providing treatment higher quality
treatments
2. A system which stores health related data can be useful in preventing health epidemics
(e.g.,H1N1/swine flu)
3. I am concerned that in case of a health emergency there could be a delay to identify the person
needing help and their health conditions before the treatment begins
4. I’m concerned that health care providers are collecting too much personal information about me.
5. Health care providers are successful in preventing unauthorised access to personal information.
6. Computer databases that contain personal information should be protected from unauthorized
access no matter how much it costs
Q35. For each of the following statements please indicate the likelihood that you would engage in the
described activity or behaviour. Please indicate your answer by selecting a number from 1 to 5, where 1
corresponds to Very Unlikely, 3 corresponds to Not Sure, and 5 corresponds to Very Likely.
PROG: SINGLE ANSWER PER ROW
SCALE:
1. Very unlikely
2.
3. Not sure
4.
5. Very likely
50
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
ITEMS:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
Revealing a friend's secret to someone else
Moving to a city far away from your extended family
Leaving your young children alone at home while running an errand
Walking home alone at night in an unsafe area of town
Engaging in unprotected sex
Not returning a wallet you found that contains € or £ or kr. 200
Drinking heavily at a social event??
Driving a car without wearing a seat belt
Riding a motorcycle without a helmet
Choosing a career that you truly enjoy over a more secure one
Sunbathing without sunscreen
Admitting that your tastes are different from those of a friend
Passing off somebody else's work as your own
Speaking your mind about an unpopular issue in a meeting at work
Having an affair with a married man/woman
Starting a new career in your mid-thirties
________________________________________________
5. Demographic questions
________________________________________________
Q36_INTRO.
PROG : INFO TEXT
In the next and final section we’ll ask you some questions about yourself. These are important for general
analysis, and will not in any way be used to identify you.
Q36. Please choose the option below that best describes your current work status?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
Working full time
Working part time
Responsible for taking care of affairs at home
Without any current occupation, not working
Student
Retired
Not in paid employment because of long term illness or disability
Seeking work
Prefer not to say
Other [Please specify] [ OPEN ANSWER]
51
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
Q37.How old were you when you completed your education?
PROG : NUMERICAL
PROG: [FILL IN FREE NUMERIC BOX 5- 99] YEARS
Q38. What is the highest level of education you have achieved?
PROG : SINGLE ANSWER
PROG : INSERT THE EDUCATION OPTIONS BASED ON THE COUNTRY
1.
2.
3.
4.
5.
6.
7.
8.
No formal education or primary education incomplete
Primary education
First cycle of secondary education (up to 16 years old, i.e.: GCSE/O level)
Second cycle of secondary education (up to 18 years old, i.e. A level or equivalent or vocational
course of a similar level)
Post secondary education but not university level
Undergraduate or postgraduate university level education, including Bachelors, Masters and other
equivalent degrees
PHD or equivalent postgraduate advanced level research qualification
Don't know
Q39. Which of the following best applies to you?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
6.
7.
Married/ In civil partnership
Living together/co-habiting
Single
Widowed
Divorced
Separated
No answer
Q40. Which of the following best describes the area where you live?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
6.
A big city
The suburbs or outskirts of a big city
A town or a small city
A country village
A farm or home in the countryside
Prefer not to say
52
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
7. Other
Q41. What is your nationality? Please select the country(ies) that applies(y).
PROG : SINGLE ANSWER
PROG : INSERT list of 27 Member states, prospective member states, + other
Q42. How many people under the age of 18 are living in your household? (By ‘household’ we mean all
the people who share the same address and share cooking and food with you. Please include all
people aged 0 to 17)
PROG: SINGLE ANSWER
1.
2.
3.
4.
5.
6.
7.
8.
None
1
2
3
4
5
6 or more
Prefer not to say
Q43.Including yourself, how many people aged 18 and over are living in your household?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
6.
7.
1
2
3
4
5
6 or more
Prefer not to say
Q44.What is your religion, if any?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
Christian (Catholic / Orthodox / Protestant / Other Christian)
Islam (Alevi / Aleviter / Ismaili (Seveners) / Ithna ‘ashari (Twelvers) / Sunni / Shia / Sufi / Zayadi)
Jewish
Hindu
Sikh
53
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
6.
7.
8.
9.
10.
Buddhist
Other
No religion
Don’t know
Prefer not to disclose
Q45.To which of the following groups would you say you belong to?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
White
Black
South Asian, Indian, Pakistani etc.
East Asian Chinese, Japanese etc.
Arabic, Central Asian
Native American, Aboriginal
Latin American
Mixed background
Other
Don’t know
Prefer not to disclose
Q46. Which of the following comes closest to how you feel about your household’s income nowadays?
PROG : SINGLE ANSWER
1.
2.
3.
4.
5.
Living comfortably on present income
Coping on present income
Finding it difficult on present income
Finding it very difficult on present income
Prefer not to disclose
Q47. What is your household’s total monthly income before taxes? Please provide a rough estimate.
Please keep in mind that your answers are strictly confidential.
PROG : SINGLE ANSWER
PROG : TO INSERT COUNTRY SPECIFIC INCOME BANDS, AND PROVIDE OPTION OF ‘PREFER NOT TO
DISCLOSE
54
D2.2 PACT Methodological report on survey design and survey questionnaire
PACT project – GA: 285635
3. End of Questionnaire
Thank you for your participation in this survey. Should you require further information about this survey or
our research programme, please contact: [email protected] or visit: http://www.projectpact.eu/
If you have any further comments, please, feel free to share those with us in the box provided below:
[PROVIDE AN OPEN BOX FOR RESPONDENTS OR INTERVIEWERS TO TYPE IN]
55