Introduction to Topic v - Software & Tools for
Data Editing and Imputation
C. Poirier1
M. Templ2,3,4
1
STATISTIK AUSTRIA
2
Die Informationsmanager
3
data-analysis OG
4
UNECE Worksession on Editing, Oslo, 25/09/12
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
1/6
Introduction
Claude
(v) Software & Tools
Introduction of development work
Prototypes & production systems
Desired characteristics
- Modular
- Reusable
- Flexible
Processing of a mixture of data
- Numerical or categorical data
- Micro or macro data
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
2/6
Introduction
Claude
(v) Software & Tools
Visual tools
Analyses
Diagnostics
Data mining
Data confrontation
Foundation
SAS
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
3/6
Introduction
Matthias
(v) Software & Tools
Huge interest in that topic - many contributions
General trend, not only with the contributions for this topic:
● 168
● 2.8e+10
, but contributions related to SAS:
Todorov and Templ [2012], Templ and Todorov [2012]: if someone
search for
●48
● 1.2e+10
flexibility in data import/export
state-of-the-art methods
excellent features for presenting your data
high-performance computing
and if one really looks for an economical solution one arrives at
.
we will see in the next presentations if the last sentence is also true for
editing purposes related to the papers presented.
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
4/6
Introduction
Matthias
(v) Software & Tools
Huge interest in that topic - many contributions
General trend, not only with the contributions for this topic:
● 168
● 2.8e+10
, but contributions related to SAS:
Todorov and Templ [2012], Templ and Todorov [2012]: if someone
search for
●48
● 1.2e+10
flexibility in data import/export
state-of-the-art methods
excellent features for presenting your data
high-performance computing
and if one really looks for an economical solution one arrives at
.
we will see in the next presentations if the last sentence is also true for
editing purposes related to the papers presented.
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
4/6
Introduction
Matthias
(v) Software & Tools
Huge interest in that topic - many contributions
General trend, not only with the contributions for this topic:
● 168
● 2.8e+10
, but contributions related to SAS:
Todorov and Templ [2012], Templ and Todorov [2012]: if someone
search for
●48
● 1.2e+10
flexibility in data import/export
state-of-the-art methods
excellent features for presenting your data
high-performance computing
and if one really looks for an economical solution one arrives at
.
we will see in the next presentations if the last sentence is also true for
editing purposes related to the papers presented.
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
4/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
Introduction
Matthias, Claude
(v) Related 7 Papers
: TEA. Editing and imputation in US (mixture of using C, SQLite and
R)
: Visual editing with the tableplot package. Treemaps.
: R-x12: making x12 user-friendly
: Time series: editing in UNIDO
: editing in CBS by packages deducorrect and editrules
SAS: SAS Macro: automation of E&I processes
: AMELIA2: Maximum Likelihood approach with bootstrapping
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
5/6
References
References
M. Templ and V. Todorov. Official statistics and survey methodology
meets R. The Survey Statistician, 66:26–34, 2012.
V. Todorov and M. Templ. R in the statistical office: Part 2. Working
paper, United Nations Industrial Development, 2012.
Claude Poirier, Matthias Templ
Introduction Topic (v)
Oslo, 25/09/12
6/6