Q2010
Helsinki
European Conference on quality in Official
Statistics
A quality evaluation analysis of the Italian
Business Register of Enterprise Groups
Session 27: Use of administrative sources I
Helsinki 5 May 2010
Fulvia Cerroni - Serena Migliardo - Enrica Morganti
Italian National Institute of Statistics
A quality evaluation
analysis of the Italian BR
on EGs
Agenda
Backgrounds
Data quality Management
The sources and the process
Quality of the input
Quality of the process
Quality of the output
Conclusions
5 May 2010
2
A quality evaluation
analysis of the Italian BR
on EGs
Backgrounds
• use of administrative archives in place of statistical surveys
• reducing the statistical burden
• From 1999 first model result of meetings with experts, academic
and administrative providers
• EGs year 2003 are disseminated
• From 2004 profiling activity on largest EGs
• From 2005 Inward FATS integrated into BR
• reengineering of the process
5 May 2010
3
A quality evaluation
analysis of the Italian BR
on EGs
Data Quality management
• Data Quality Management
• From 2005 a system of quality indicators as a Quality Report
• A three step approach: input/process/output
STEP
Timeliness
Relevance Accuracy and
punctuality
INPUT
X
X
PROCESS
X
X
X
X
OUTPUT
X
Coherence Output
Accessibility
and
quality
and clarity
comparability trade off
X
5 May 2010
X
X
Performance,
User needs
Confidentiality
cost and
and
transparency
respondent
perceptions
and security
burden
X
X
X
4
A quality evaluation
analysis of the Italian BR
on EGs
The sources and the process (1)
Stock Exchange
contains: all relevant shareholders of listed shared companies
information structure: bottom-up / top down
Chamber of Commerce
contains all shareholders of non listed shared companies
information structure: bottom-up
Annual Reports
contains: list of consolidated enterprises by Italian Group Heads
Also foreign subsidiaries are included
information structure: top down
5 May 2010
5
A quality evaluation
analysis of the Italian BR
on EGs
The sources and the process (2)
Preconditions:
• same linking key
• same timeliness
• same information content
1. Integration of the administrative sources
2. Checking and validation procedures
• Inward Fats survey
• Italian top 50 EGs
• EGs with at least 500 employees
• Enterprise with at least 250 employees in ASIA (BR of Active
enterprises)
5 May 2010
6
A quality evaluation
analysis of the Italian BR
on EGs
ACCURACY
STEP = INPUT
Var
Accuracy - Coverage S ources
A.1 - Total number
of relationships by
source
2007
Annual Report
366,711
363,774
368,762
-2,937
4,988
244,107
-124,655
Stock Exchange
23,755
23,476
25,084
-279
1,608
28,598
3,514
2,120,130
2,485,897
2,527,333
365,767
41,436
2,541,999
14,666
Annual Report
341,224
338,845
342,75
-2,379
3,905
230,808
-111,942
Stock Exchange
23,673
23,399
24,996
-274
1,597
25,137
141
2,120,130
2,485,897
2,527,333
365,767
41,436
2,541,999
14,666
Chamber of Commerce
TIMELINESS
Timeliness
Var
2006
Chamber of Commerce
A.2 - Total number
of univocal
relationships by
source
Var
2005
S ources
T.1 - Months b/e the
Annual Report
end of reference
period and the date
Stock Exchange
in which sources are
available
Chamber of Commerce
2005
2006
[2006, 2005]
2007
[2007, 2006]
Var
Var
[2006, 2005]
[2007, 2006]
2008
[2008, 2007]
Var
2008
[2008, 2007]
16
15
14
-1
-1
14
0
17
16
13
-1
-3
12
-1
16
15
14
-1
-1
9
-5
5 May 2010
7
A quality evaluation
analysis of the Italian BR
on EGs
ACCURACY
STEP = PROCESS
(1)
(1)
Accuracy Coverage
Sources
2005
2006
2007
Annual Report
Stock Exchange
A.7 - Number
Chamber of Commerce
of control
Fats
relationships
Manual Check
Total
90,96
12,125
313,607
4,652
173
421,517
91,478
11,931
382,083
4,864
167
490,523
93,959
12,883
401,447
5,861
821
514,971
Accuracy Coverage
2005
2006
2007
32,566
6,41
127,45
1,797
1,221
42,878
599
4,863
165
217,949
33,299
6,862
129,634
1,87
1,175
44,119
740
5,859
813
224,371
Sources
Annual Report
37,212
Stock Exchange
6,345
A.8 -Number Chamber of Commerce
99,078
of control
Annual Report, Stock Exchange and Chamber of Commerce
1,519
relationships
Annual Report and Stock Exchange
1,355
of groups
Annual Report and Chamber of Commerce
38,799
with at least
Stock Exchange and Chamber of Commerce
501
two legal
FATS
4,651
units
Manual Check
173
Total
189,633
5 May 2010
Var
Var
[2006, 2005] [2007, 2006]
518
2,481
-194
952
68,476
19,364
212
997
-6
654
69,006
24,448
Var
Var
[2006, 2005] [2007, 2006]
-4,646
733
65
452
28,372
2,184
278
73
-134
-46
4,079
1,241
98
141
212
996
-8
648
28,316
6,422
2008
82,985
13,668
421,987
285
518,925
2008
30,237
6,962
140,178
1,916
1,3
37,397
626
277
218,893
Var
[2008, 2007]
-10,974
785
20,541
-5,861
-536
3,954
Var
[2008, 2007]
-3,062
100
10,544
46
125
-6,722
-114
-5,859
-536
-5,478
8
A quality evaluation
analysis of the Italian BR
on EGs
ACCURACY
STEP = PROCESS
(2)
(2)
5 May 2010
9
A quality evaluation
analysis of the Italian BR
on EGs
ACCURACY
(3)
STEP = PROCESS
(3)
INWARD FATS survey
EGs 2005
EGs 2006
% of foreign EGs on total EGs
before FATS after FATS before FATS after FATS
- frequency
7.9
12.0
8.6
11.6
- employees
5.3
9.0
5.8
8.9
- enterprises
11.9
23.9
14.2
24.7
Manual checks
Kind of Check
Amended relationships
Added relationships
Duplicated relationships with
ITALIAN parent
Duplicated relationships with
FOREIGN parent
Change of the Group Head unit
Added foreign legal unit
TOTAL
Frequency
%
437
156
39.8
14.2
70
6.4
307
28
3
124
0.3
11.3
1,097
100.0
TIMELINESS
Timeliness
S ources
T.2
Integration of administrative sources, Inward Fats
and manual checks
5 May 2010
2005
2006
2007
24
15
7
Var
Var
[2006, 2005]
[2007, 2006]
-9
-8
10
A quality evaluation
analysis of the Italian BR
on EGs
STEP = OUTPUT
STEP =O UTPUT
ACCURACY
Accuracy - C ove rage
T ot al EGs wit h at least one act ive
ent erprise
- wit h a It alian Group Head
Var
[2007, 2006]
63,656
70,872
74,681
7,216
3,809
56,028
62,635
66,090
6,607
3,455
7,628
8,237
8,591
609
354
16,959
20,270
21,640
3,311
1,370
154,247
171,994
176,789
17,747
4,795
5,308,316 5,578,949 5,729,210
270,633
150,261
A.20
- wit h a Foreign Group Head
EGs wit h at least one act ive ent erprise
of which having a physical person as
Group head
Number of It alian act ive ent erprises of
BR on EGs
Number of employees of It alian act ive
ent erprises of BR on EGs
A.21
Coverage of Italian active enterprises
% of It alian act ive ent erprises from BR
EGs / T ot al ent erprises of It alian BR of
Act ive ent erprises
20.3
21.6
21.5
1.3
-0.1
A.22
Coverage of em ployees of Italian active
enterprises
% of employees of It alian act ive
ent erprises from BR EGs / employees of
It alian BR of Act ive ent erprises
56.2
56.9
56.4
0.07
-0.5
A.17
A.18
A.19
TIMELINESS
Var
[2006, 2005]
2007
2006
2005
Timeliness
T .3
2005
Months from the end of the process and the
dissemination of data
5 May 2010
2006
7
Var
[2006, 2005]
2007
4
1
-3
Var
[2007, 2006]
-3
11
A quality evaluation
analysis of the Italian BR
on EGs
ACCESSIBILITY
STEP = OUTPUT
• Internal users / external users
COHERENCE
• 5 years are available and comparable
• Benchmark to check MNEs on EGR
OUTPUT QUALITY
TRADE OFF
• Timeliness / accuracy
• Sometimes accept lower accuracy in order to reduce timeliness
PERFORMANCE,
COST
RESPONDENT
BURDEN
• Cost for quality maintenance :
•
cost for source acquisition
•
cost for high skilled resources
5 May 2010
12
A quality evaluation
analysis of the Italian BR
on EGs
USERS NEEDS
STEP = OUTPUT
• Inward FATS survey statistics
• International trade
• National Accounts
• EGR project
• Eurostat
• External users requests
5 May 2010
13
A quality evaluation
analysis of the Italian BR
on EGs
Conclusions
Strengths of Italian BR on EGs
• Standardized process
• Integration and complementary of input sources
• Data monitored annually by source and by step process
Weakness
• Change in data providers
• Stakeholders needs
• Timeliness
• Human resources
Solutions
• good relationship / maintenance of stability and continuity of the data flow
• active role of Istat with administrative bodies detaining data
5 May 2010
14
Thank you for your attention
For further information:
Fulvia Cerroni:
[email protected]
Serena Migliardo:
[email protected]
Enrica Morganti:
[email protected]
5 May 2010
15