The Missing Link:
From Concepts to Questions
in Economic Surveys
Ger Snijkers – Statistics Netherlands
Diane K. Willimack – US Census Bureau
2nd European Establishment Statistics Workshop (EESW)
12-14 September 2011, Neuchatel, Switzerland
Overview
1.
2.
3.
4.
From theory to data: in theory
From theory to data: in practice
Methods
Iterative approach
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
1
From Theory to Data: How?
Empirical world:
Theoretical world:
1.
Theory
?
Missing Link: Conceptualisation and Operationalisation
Data file
EESW2011, 12 Sept 2011
2
1. From Theory to Data: in theory
Empirical world:
Operationalisation
Survey measurement
Data processing
Theoretical world:
1.Conceptualisation
Theory
Data file
Processing errors
Response
Concepts
Measurement & Non-response errors
Pre-testing
Questionnaire
Specification errors
Operationalisation errors
Attributes
Question(s)
Operational definition
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
3
2. From Theory to Data: in practice
Empirical world:
Operationalisation
Survey measurement
Data processing
Theoretical world:
1.Conceptualisation
Theory
Data file
Processing errors
Response
Concepts
Missing link!
Measurement & Non-response errors
Pre-testing
Questionnaire
Specification errors
Operationalisation errors
Attributes
Question(s)
Operational definition
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
4
2. From Theory to Data: in practice
Consequences:
•
•
•
•
Missing variables
Measurement errors: variability and bias
Non-response
Response burden and trust
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
5
3. Conceptualisation and Operationalisation
Approaches:
1. Top-down:
-
Theory driven
Reasoning
2. Bottom-up:
-
Theoretical world
Missing Link: Conceptualisation and Operationalisation
Data driven
Using observations
(quantitative and qualitative;
not only survey data)
Empirical world
EESW2011, 12 Sept 2011
6
3.1. Theory-driven approaches
•
•
Dimension/Attribute analysis
Content Development Techniques
Theoretical world:
Conceptualisation
Theory
Concepts
Attributes
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
7
3.2. Data-driven approaches
•
•
•
•
•
•
Questionnaire Sampling
Early-stage Scoping Interviews /
Exploratory Focus Groups
Concept Mapping
Feasibility studies
Accounting Expert Reviews
Record Keeping Studies
Missing Link: Conceptualisation and Operationalisation
Exploring
concepts and
attributes,
with increasing
degree of
specification
EESW2011, 12 Sept 2011
8
4. Iterative Approach
Empirical world:
Operationalisation
Theoretical world:
1.Conceptualisation
Theory
Data file
1. Theory-driven
methods
Concepts
3. Relating Q
to theory
Response
4. Pre-testing
Questionnaire
2. Theory-driven & Data-driven methods
Attributes
Question(s)
Operational definition
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
9
Thank you
Missing Link: Conceptualisation and Operationalisation
EESW2011, 12 Sept 2011
10