PRODCOM - Office for National Statistics

Survey response
Response to users of UK
Manufacturers’ Sales by Product
Survey (PRODCOM) outputs
December 2015
Office for National Statistics
1
Response to users of UK Manufacturers’ Sales by Product Survey
Contents
Background ........................................................................................................................ 3
Summary of key results .................................................................................................... 4
Results in detail ................................................................................................................. 5
Q1. Which of the following PRODCOM estimates do you use? ................................................................ 5
Q2. Do you use any other source(s) of manufacturing statistics? ............................................................. 6
Q3. What do you use PRODCOM estimates for?...................................................................................... 7
Q4. Please provide further detail for each of your selections above, for example the projects on which
you have used PRODCOM data for and the impact it has had. ................................................................ 7
Q5. Which of the following PRODCOM products or services have you used? ......................................... 9
Q6. How satistfied or dissatisfied are you with the following features of our statistical bulletins?. ......... 10
Q7. How satistfied or dissatisfied are you with the following characteristics of our statistical bulletins? 11
Q8. How satistfied or dissatisfied are you with the following characteristics of PRODCOM
data/reference tables?.............................................................................................................................. 12
Q9. Quality measures are published alongside PRODCOM estimates to provide users with an
indication of the precision and data quality. How satisfied or dissatisfied are you with the following
PRODCOM quality measures? ................................................................................................................ 13
Q10. UK Manufacturers’ Sales by Product survey (PRODCOM) data is now published in Open Data
format on the ONS website. This tool allows you to tailor datasets to your requirements and
download them in a choice of formats (CSV, XLS, XML).Were you aware of this tool?. ........................ 14
Q11. If yes, how satisfied or dissatisfied are you with the following characteristics of PRODCOM
Open Data tables? ................................................................................................................................... 14
Q12. Which of the following industrial divisions are of interest to you in the PRODCOM publications?
Please select all that apply ....................................................................................................................... 15
Q13. PRODCOM estimates were previously published together with HMRC trade data on the ONS
website. These data are no longer published together as users can access the trade data directly
from the HMRC website.Has this change negatively impacted on your work? ....................................... 16
Q14. We are trialing or considering the following improvements to how we communicate PRODCOM
estimates. How useful, or not useful, are these improvements likely to be to your work? ...................... 17
Q15. Do you have any further comments about PRODCOM products or services? For example, are
there any improvements you would like to see? ...................................................................................... 19
Q16. If you have requested PRODCOM data or information within the last 12 months, did the
response you received meet your requirements?.................................................................................... 20
Q17. How did you hear about PRODCOM publications? ........................................................................ 21
Q18. What sector do you work in? ........................................................................................................... 22
Q19. Would you be willing to discuss your responses further? ............................................................... 22
Q20. To make improvements on an ongoing basis, we aim to continue collecting feedback from our
users. Would you be willing to take part in future surveys? ..................................................................... 22
Outcome ........................................................................................................................... 23
Getting in Touch .............................................................................................................. 25
Accessibility ..................................................................................................................... 25
Copyright .......................................................................................................................... 25
Office for National Statistics
2
Response to users of UK Manufacturers’ Sales by Product Survey
Background
The PRODCOM branch within Office for National Statistics (ONS) is responsible for producing the
UK Manufacturers’ Sales by Product (PRODCOM) survey alongside associated estimates and
publications which we publish twice a year, in June (provisional estimates) and December
(intermediate and final estimates).
We have to engage with users as enshrined in the UK Statistics Authority (UKSA) Code of Practice
and emphasised in their 2012 assessment of PRODCOM. This includes to improve or widen user
engagement, measure satisfaction on how we disseminate our statistics, better understand and
meet, where possible, any changing needs and to notify users of the actions we plan to take.
During September and October 2015 we conducted a short user engagement survey for
approximately 6 weeks, closing on 26th October. It was available via an online forum ‘Survey
Monkey’ and publicised through PRODCOM web pages, Twitter, StatsUserNet, as well as emailed
directly to 106 known users on the PRODCOM mailing list, 74 Virtual Microdata Laboratory (VML)
and 9 UK Data Service (UKDS) users.
The aim of the survey was generally to help us ascertain the key outputs that are used, what users
think about the quality of these outputs, recent or proposed improvements and improvements that
users would like us to consider.
Within this report are the main findings from the survey and the outcome. Both quantitative and
qualitative feedback is reported. A link to this report will be included in the PRODCOM Intermediate
2014 and Final 2013 statistical bulletin, due for publication on 17th December 2015.
ONS would like to thank all users who responded to the survey. The findings will be used to help
improve our products and services and to develop the way we engage and communicate with
users.
Office for National Statistics
3
Response to users of UK Manufacturers’ Sales by Product Survey
Summary of key results
Key findings from the survey were as follows:

There were 16 responses from a variety of stakeholders including government
departments, a devolved administration, consultancy firms, academics, and trade bodies

The majority of respondents have used all of the 3 main sets of PRODCOM results
although the most used (86.7%) was the final results. The least used was the intermediate
results (60.0%) while provisional results had a usage of 73.3%.

87.5% of respondents use other sources of manufacturing statistics. 68.8% of respondents
also used manufacturing data sources not produced by ONS

The most common use of PRODCOM estimates was for market research (43.8%) while the
most popular product or service was the excel reference tables, at 81.3% usage. Majority
(83.0%) of users indicated that the removal of the HMRC trade data, which was previously
published alongside PRODCOM estimates, had not negatively impacted on their work

Overall, those who used the statistical bulletin, excel reference tables and quality measures
were generally satisfied with these outputs although over half (58.3%) of users were
unaware of the Open data tool

Some respondents felt aligning PRODCOM product codes to the classification of products
by activity (CPA) and publishing results at 6-digits product level rather than at 8-digit level
will be helpful while others indicated that it will not be useful

All PRODCOM industrial divisions were of interest to respondents; particularly fabricated
metal products (76.9%), motor vehicles, trailers and semi-trailers (69.2%) and machinery
and equipment (69.2%). Over 50.0% usage was reported for 18 out of the 25 divisions

Suppressing less data, informing them of new releases through direct email and a section
in the statistical bulletin that provides extra commentary for a specific industrial division,
were improvements users said they would find very or fairly useful. Other improvements
mentioned include stratifying the sample by region, better labelling, footnotes and clarity to
the reference tables

The most frequent way people had heard about PRODCOM was “Word of Mouth” or via
“ONS Website”; no respondents access PRODCOM through StatsUserNet, Twitter or
Facebook
Actions that have been taken or will be taken in response to this feedback is summarised in the
‘Outcome’ section at the end of this report.
Office for National Statistics
4
Response to users of UK Manufacturers’ Sales by Product Survey
Results in detail
All figures in the charts are given as a percentage of the respondents who answered each
particular question, rather than as a percentage of the 16 respondents to the survey as a whole.
The number of responses to each question is given just beneath the text of the question. For
example, 15 of the 16 respondents provided a response to question 1. The bar chart thus contains
information on the percentage of these 15 respondents.
Q1: Which of the following PRODCOM estimates have you used? Please select all that apply
Answered: 15
Non response or Not Applicable (N/A): 1
The responses indicated that the final PRODCOM estimates (published annually in December)
were our most popular set of estimates at 86.7% usage. This might be expected, as the final
results have been through 2 rounds of revisions so user trust may be higher when compared with
provisional or intermediate results.
However, this may also reflect on how some users view the timeliness of our statistics (see
questions 7 and 8) as our final results are published around 24 months after the end of the
reference period.
Provisional and intermediate results are published 6 and 12 months respectively after the end of
the reference period. High usage was also reported for these estimates (73.3% for provisionals
and 60.0% for intermediates).
We will investigate posible options to improve the timeliness of the final estimates and consult
further with users when this work has been completed.
Office for National Statistics
5
Response to users of UK Manufacturers’ Sales by Product Survey
Q2: Do you use any other source(s) of manufacturing statistics?
Answered: 16
Non response or N/A: 0
The majority of PRODCOM users who responded to the user engagement survey also use other
manufacturing statistics including:

other ONS sources such as UK Trade in Goods, the Annual Business Survey (ABS), Index
of Production, Turnover and Orders in Production and Services Industries

manufacturing statistics external to ONS such as European statistics, other National
Statistics, HMRC trade data, information from trade associations or from individual
companies, and market research reports
Office for National Statistics
6
Response to users of UK Manufacturers’ Sales by Product Survey
Q3: What do you use PRODCOM estimates for? Please select all that apply
Answered: 16
Non response or N/A: 0
The most common use of PRODCOM statistics was Market Research, reported by 43.8% of
respondents. The same proportion also reported ‘Other’, indicating that the current uses for
PRODCOM are quite diverse.
‘Other’ uses include production of government statistics, presentations to industry, benchmarking,
for publications and planned future use for policy purposes.
Q4: Please provide further detail for each of your selections above (for example the projects
on which you have used PRODCOM data and the impact it has had).
Answered: 14
Non response or N/A: 2
From the further detail given by respondents, several of our users seem to make use of
PRODCOM estimates to aid with market research or projects, often alongside other market
research reports.
Our company is interested to grow its market in UK, for this reason we need to know which
markets are growing to better understand customers’ needs and approaches to the business.
I use PRODCOM when market research reports do not contain specific enough data.
Users such as trade associations or research consultancies utilise PRODCOM estimates to
prepare reports on specific sectors and aspects of the economy, for example growth or potential
future challenges or strategic planning.
UK's Textiles industry, challenges and prospects
The data are used to compile "production" data (I know it is technically sales of UK made
goods) for the industries that we cover as a Trade Association - these are metal working
Office for National Statistics
7
Response to users of UK Manufacturers’ Sales by Product Survey
machine tools, cutting tools and tool/work-holding equipment. We use the data both at an
industry level and at the product level, although the latter is, of course, restricted somewhat
by confidentiality. Industry level data is used in policy/planning (including as part of the
forecasting process for our industry) and in media announcements; product level data is
more relevant to market research, including the use of the data in exchanges and
comparisons internationally.
Used for internal strategic planning. Summary of key statistics made available to the furniture
sector to assist with their own planning (particularly useful to the large number of SMEs who
don't have the resource to trawl the data) Use snapshots to support press releases Use data
to support published technical output.
Finally, some government users require PRODCOM data to either carry out assessments,
analysis, help compile official statistics or design their sample.
To provide benchmarks to assess the success of applicants to the Queen's Awards for
Enterprise. The awards are given to those who can "show that your organisation has
achieved outstanding growth in overseas earnings relative to your business size and sector"
with regards to international exports.
Data feeds Supply and Use tables which determine the definitive annual estimate of GDP (a
statutory requirement) . . . PRODCOM data are critical to informing the supply and use
balancing process for the manufacturing industries.
. . . to augment other datasets to estimate activity and therefore emissions from specific
sectors. This feeds into the national submissions of emission estimates for Greenhouse
Gases and also Air Quality pollutants, to international reporting mechanisms (to the EU and
UN). Typically the PRODCOM data are used to provide insight into the time series of
activities in individual economic sectors.
The qualitative responses to the use of PRODCOM data are extremely helpful as they could help
tailor future improvements to user needs and also targeted to specific products, industries or
industrial divisions.
Office for National Statistics
8
Response to users of UK Manufacturers’ Sales by Product Survey
Q5: Which of the following PRODCOM products or services have you used? Please select
all that apply
Answered: 16
Non response or N/A: 0
The most popular PRODCOM product or service was the excel reference tables, at 81.3% usage.
By comparison, the next highest was the statistical bulletin at 31.3%, then both the open data
tables and the methodology information were at 18.8%.
PRODCOM outputs are available via the Virtual Microdata Laboratory (VML) and UK Data service
(UKDS). However, these services do not appear to be well utilised by respondents. This could
partly be due to these users not filling in the user engagement survey, lack of awareness of the
usefulness of these services or a future intended use of the VML, as indicated by a respondent.
There have been recent improvements to PRODCOM data and metadata that are deposited at the
VML and renewed effort will be made to publicise this service.
Furthermore, we will continue to improve the products that are most used and engage with users to
identify how these products could be improved further to enhance utilisation.
Office for National Statistics
9
Response to users of UK Manufacturers’ Sales by Product Survey
Q6: How satisfied or dissatisfied are you with the following features of PRODCOM statistical
bulletins?
Answered: 13
Non response or N/A: 3
Very
satisfied
Satisfied
Main points
15.4
Summary
Percentage (%)
Very
Don’t
dissatisfied
use
Dissatisfied
30.8
Neither
satisfied nor
dissatisfied
7.7
0.0
0.0
46.2
15.4
30.8
7.7
0.0
0.0
46.2
Results by Products
23.1
15.4
15.4
7.7
0.0
38.5
Results by industrial
division
23.1
15.4
7.7
7.7
0.0
46.2
European comparisons
7.7
7.7
23.1
0.0
0.0
61.5
Infographics and charts
0.0
15.4
15.4
0.0
0.0
69.2
Background notes
section
7.7
38.5
7.7
0.0
0.0
46.2
The majority of respondents who use the statistical bulletin were either ‘very satisfied’ or ‘satisfied’
with most of its features - 32 of the 45 responses other than ‘Don’t use’ give this indication. The
main points, summary and background notes section especially show more users being satisfied
with these features compared with the others.
Qualitative feedback suggested that the statistical bulletin is . . .
. . . a good and concise summary which helps put text to statistics. This enables me to
understand what the data says and to help me explain it to others.
. . . very good, if I just need a quick summary of the landscape.
The 2 features of the statistical bulletin - “Results by Products” and “Results by Industrial Division”
where comparatively more users reported being ‘very satisfied’ were also the features that some
users expressed dissatisfaction.
A respondents’ expression of disapproval was as follows:
. . . hard to untangle - and I am a highly experienced user; (It’s) difficult to track down sector
and product definitions when they change.
This comment provides insight to a specific area of improvement for us to consider, such as
providing users, through the PRODCOM webpages, with the annual changes to the PRODCOM
product codes and the PRODCOM List. Furthermore, we will consider improving the information
and commentary we provide within the results by products and industrial division sections.
Office for National Statistics
10
Response to users of UK Manufacturers’ Sales by Product Survey
Q7: How satisfied or dissatisfied are you with the following characteristics of PRODCOM
statistical bulletins?
Answered: 10
Non response or N/A: 6
Very
satisfied
Satisfied
Timeliness of the bulletin
10.0
40.0
Neither
satisfied
nor
dissatisfied
40.0
Ease of access
20.0
30.0
Appearance
30.0
Relevance to your needs
Coherence with other data
sources
Percentage (%)
Dissatisfied
Very
dissatisfied
10.0
0.0
40.0
10.0
0.0
30.0
40.0
0.0
0.0
20.0
50.0
30.0
0.0
0.0
20.0
30.0
40.0
10.0
0.0
Overall, feedback from users of the PRODCOM statistical bulletin is positive across the 5
characteristics but especially with regards to relevance and appearance.
Instances of dissatisfaction were reported for timeliness, ease of access and coherence with other
data sources as gleaned from this response:
Timeliness is much better now that Eurostat requires the data to be lodged by the end of
June, but there is always scope for quicker publication . . . I have long had a problem in the
coherence of the data from PRODCOM, the Index of Production and the ABI/ABS . . . I know
that they are not necessarily collecting the same data, but they rarely give the same order of
magnitude and, occasionally, even point in different directions.
The number of users who indicated that they were ‘neither satisfied nor dissatisfied’ was almost as
high as those who expressed levels of satisfaction, for most of the characteristics. This may be an
indication that, overall, we need to do more to improve the statistical bulletin, for example provide
more detailed information regarding the coherence of PRODCOM and other related ONS data
sources.
Office for National Statistics
11
Response to users of UK Manufacturers’ Sales by Product Survey
Q8: How satisfied or dissatisfied are you with the following characteristics of PRODCOM
reference/data tables?
Answered: 10
Non response or N/A: 6
Very
satisfied
Satisfied
20.0
50.0
Neither
satisfied
nor
dissatisfied
20.0
0.0
70.0
Ease of access
20.0
Appearance
Relevance to your needs
Level of detail
Timeliness
Coherence with other data
sources
Comparability over time
Percentage (%)
Dissatisfied
Very
dissatisfied
10.0
0.0
20.0
10.0
0.0
50.0
10.0
10.0
0.0
10.0
70.0
10.0
10.0
0.0
20.0
50.0
20.0
10.0
0.0
0.0
40.0
40.0
20.0
0.0
10.0
40.0
40.0
10.0
0.0
Note: Some rows may not sum to 100% because not all of the 10 respondents gave an answer for each row.
The excel reference tables were earlier reported as the most popular PRODCOM product.
Although levels of satisfaction were expressed across all 7 characteristics of the tables, the
majority of users did so for 5 of the characteristics, with the highest being for appearance.
Dissatisfaction was also reported especially for coherence with other data sources.
There is always a difference between the figures from Eurostat PRODCOM and ONS
PRODCOM figures. I understand the issue could be due to suppression of some of the data
and exchange rate conversion of £ to Euro. There have been some instances the Eurostat
figures are higher than UK figures.
It’s quite hard to sift key data from the list of options . . . and to know which elements make
up the headline figures. Volume (weight) data is sometimes difficult to reconcile. Values can
be significantly different from ABS (even accounting for different collection times and periods)
There were different views regarding the removal of HMRC trade data with some users
appreciating the extra clarity gained, while others felt the tables were less useful following the
removal (also see question 13).
The appearance is much better now that the export/import data has been taken out and we
only get the PRODCOM data; this has allowed the time series of the PRODCOM data to be
published and is a great improvement.
There has been a big improvement to the structure of the data tables recently. However not
having the export data has meant that the data is not as useful to us. And not having an easy
way to link into the HMRC data means that we can't construct the data we need.
We will engage further with users of the trade data to see how best we can meet their needs in
addition to improving user awareness to the differences between data sources.
Office for National Statistics
12
Response to users of UK Manufacturers’ Sales by Product Survey
Q9: Quality measures are published alongside PRODCOM estimates to provide users with
an indication of the precision and data quality. How satisfied or dissatisfied are you with the
following PRODCOM quality measures?
Answered: 11
Non response or N/A: 5
Percentage (%)
Very
Don't
dissatisfied
use
Very
satisfied
Satisfied
Neither satisfied
nor dissatisfied
Dissatisfied
UK Manufacturer
Sales (in £millions)
0.0
63.6
18.2
0.0
0.0
18.2
Standard error (in
£millions)
0.0
27.3
18.2
0.0
0.0
45.5
Standard error
expressed as
a percentage of UK
Manufacturer Sales
0.0
18.2
18.2
0.0
0.0
54.5
Number of
companies making
the product in the
sample
9.1
27.3
18.2
0.0
0.0
36.4
Total employment of
companies making
the product in the
sample (in
thousands)
9.1
27.3
18.2
0.0
0.0
36.4
Note: Some rows may not sum to 100% because not all of the 11 respondents gave an answer for each row.
Users expressed levels of satisfaction with the various aspects of the PRODCOM quality measures
with most feedback positive or neutral.
However, there were aspects of the quality measures such as the standard error with a high
percentage (54.5%) of non usage. The following qualitative feedback provides a rich source of
information as to where we could investigate further to improve the relevance of the quality
measures to the satisfaction of users.
While I understand why it is done, the figure of "<=5" does not really help much and, at the
product level, rounding the employment numbers to the nearest 1000 (does "<=1" imply that
it is less than 500 because if it was, say 750, it would round-up to 1?) is not really helpful. For
employment and number of companies, it would be more useful to have figures at the 4-digit
industry level; we get this from the ABI/ABS, but that is for companies classified to the
industry, not necessarily the number who are making the products of that industry.
The coefficient of variation (the standard error as a percentage of the estimate), in particular, is an
important indicator of the reliability of a statistic. A review of PRODCOM quality measures has
already been identified by the PRODCOM team as future work, but this will now be brought
forward.
Office for National Statistics
13
Response to users of UK Manufacturers’ Sales by Product Survey
Q10: UK Manufacturers’ Sales by Product survey data is now published in open data format
on the ONS website. This tool allows you to tailor datasets to your requirements and
download them in a choice of formats (CSV, XLS, XML). Were you aware of this tool?
Answered: 12
Non response or N/A: 4
Less than half of respondents (41.7%) indicated that they are aware of the open data tool which
was launched in December 2014, to make PRODCOM data available in a user friendly and
interactive format.
Q11: If yes, how satisfied or dissatisfied are you with the following characteristics of
PRODCOM open data tables?
Answered: 6
Non response or N/A: 10
Very
satisfied
Satisfied
Level of detail
16.7
16.7
Neither
satisfied nor
dissatisfied
50.0
Appearance
16.7
33.3
Clarity
0.0
Ease of access
Ease of use
Relevance to your needs
Percentage (%)
Dissatisfied
Very
dissatisfied
16.7
0.0
50.0
0.0
0.0
33.3
50.0
16.7
0.0
0.0
33.3
50.0
16.7
0.0
0.0
16.7
50.0
33.3
0.0
16.7
33.3
50.0
0.0
0.0
Users who were aware of our open data tables, expressed satisfaction, particularly on the
appearance of these tables, which we introduced in December 2014, and relevance to their needs.
However, there was also some constructive feedback on their ease of use.
I find it difficult to use this format at times as I can't always remember how I accessed it the
previous time. If I used it more often then I think I would better remember all the various
parameters and sub analysis I use.
With the introduction of the open data tables, the intention is to eventually phase out excel
reference tables rather than use both tools. However there was indication that the excel format is
the preference of some users.
I have not spent much time with this tool. It is a nice tool if you want a quick info about a
specific product and you don’t want to download the whole data. But for in-depth analysis on
more than 1 product I still prefer downloading the excel sheet and analysing on my own.
The open data tables have been restructured. The tool will be publicised further to increase
awareness, and an updated user guide produced with relevant screen shots and detailed guidance
to improve user experience.
Office for National Statistics
14
Response to users of UK Manufacturers’ Sales by Product Survey
Q12: Which of the following industrial divisions are of interest to you in the PRODCOM
publications? Please select all that apply
Answered: 13
Non response or N/A: 3
Respondents indicated an interest in all 25 PRODCOM industrial divisions. There was over 50.0%
interest reported in 18 divisions with at least 38.5% of respondents interested in each division.
The most popular divisions seemed to centre around the manufacture of metals and metal
products, vehicles and transport equipment, machinery and its repair and installation, and
computer and electronic equipment.
This information is of interest as it identifies industrial divisions we could possibly focus our
commentary on in the statistical bulletin.
Office for National Statistics
15
Response to users of UK Manufacturers’ Sales by Product Survey
Q13: PRODCOM estimates were previously published together with HMRC trade data on the
ONS website. These data are no longer published together as users can access the trade
data directly from the HMRC website. Has this change negatively impacted on your work?
Answered: 12
Non response or N/A: 4
In November 2014, ONS ceased publishing HMRC trade data together with PRODCOM estimates
due to comparability issues and because users could access the former directly from the HMRC
website. Prior to removal, a discussion was held with a number of key users.
As mentioned earlier at question 8, there were different views, with some users appreciating the
extra clarity gained when using the reference tables, while others felt the tables were less useful.
When asked directly if the removal of the trade data had negatively impacted on their work, the
majority (83.3%) of users suggested that it had not.
The combined data often appeared to contradict each other - publishing separately improves
the clarity of PRODCOM data.
We think this is a positive move . . . it has allowed much better presentation of the
PRODCOM time series data . . . For our main industry (metal working machine tools, called
metal forming machinery 2841 in PRODCOM), there is a good match between the
PRODCOM and HS/CN classifications. We track the export/import data at a quarterly level
(occasionally monthly) from the HMRC database and it is easy for us to match this up to the
PRODCOM figures. We never used export/import data in the PRODCOM tables.
Have always used HMRC data separately
Some respondents (16.7%), however, indicated that there had been some impact or potentially
there could be a minor impact.
It is not possible to match the data . . . We seem to have a list of definitions which include
product codes with 3, 5 and 7 digits. Trade data can only be downloaded from the HMRC
web site at 2, 4, 6 and 8 digit levels.
Office for National Statistics
16
Response to users of UK Manufacturers’ Sales by Product Survey
Don't know as I have yet to do the latest analysis. If the sector sub categories are the same,
and the data sets between PRODCOM and HMRC are comparable then the impact will be
minor.
We will engage further with users of the trade data who are unable to match the 2 sets of estimates
to see how best we can assist them in comparing the data more easily.
Q14: We are trialling or considering the following improvements to how we communicate
PRODCOM estimates. How useful, or not useful, are these improvements likely to be to your
work?
Answered: 13
Non response or N/A: 3
Percentage (%)
Not at all
Don't
useful
know
Very
useful
Fairly
useful
Not very
useful
7.7
23.1
30.8
7.7
23.1
Special focus or analysis on a specific
manufacturing industry or division within each
statistical bulletin
23.1
38.5
7.7
7.7
15.4
Suppressing less data to improve transparency
of PRODCOM estimates to users
69.2
7.7
0.0
0.0
23.1
Aligning product codes to the classification of
products by activity (CPA) and publishing
PRODCOM estimates at 6-digit level rather
than at 8-digit product level
23.1
0.0
7.7
30.8
30.8
An annual user event
30.8
15.4
15.4
7.7
23.1
Direct email to users to inform them of new
data releases and developments
53.8
7.7
7.7
0.0
23.1
Use of LinkedIn and StatsUserNet to keep
users informed of new PRODCOM products /
outputs
15.4
30.8
15.4
15.4
15.4
Use of Twitter to keep users informed of new
products / outputs
0.0
15.4
38.5
15.4
23.1
A shortened or abridged version of the
PRODCOM statistical bulletin
Note: Some rows may not sum to 100% because not all of the 13 respondents gave an answer for each row.
Generally, there was mixed opinion across the different proposed improvements to the survey.
Based on the number of responses, improvements that users would particularly find useful include
suppressing less data (76.9%), the specific focus on particular manufacturing divisions (61.6%)
and sending emails directly to users regarding new releases and developments (61.5%).
Response was also mixed regarding an annual user event, the use of LinkedIn and StatsUserNet,
producing a shortened or abridged statistical bulletin and aligning PRODCOM product codes to the
classification of products by activity (CPA). Users largely did not think that use of Twitter would be
useful in relation to communicating new products or outputs.
Qualitative feedback, again gives valuable insight to the perceptions of users. On the proposal to
use LinkedIn/StatsUserNet, 46.2% of respondents said they will find it useful while 30.8% would
not find it useful.
Office for National Statistics
17
Response to users of UK Manufacturers’ Sales by Product Survey
How information is communicated depends on different users approaches. Would you be
setting up a group in LinkedIn, for example, so that a discussion could take place?
Twitter and social media such as LinkedIn really have no place in ONS statistics. LinkedIn is
used primarily for sales contacts and promotion and Twitter for keeping abreast mainly of
celebrity news. Please do not waste your time in this direction and instead focus on the
matter of producing timely and easily accessible statistics.
The European Statistical Office is proposing under the PRODCOM package in FRIBS1 to align the
product codes to the CPA. Potential benefits include reduced burden on data producers and
suppliers, and less data suppression. Whereas 23.1% of respondents felt this would be useful,
38.5% did not think it would, with just under a third (30.8%) of users reporting ‘dont know’.
I don't understand CPA and prefer the current 8-digit product level instead. I am used to this
and am worried about comparative data if the product code is changed.
Aligning product codes to the classification of products by activity (CPA) and publishing
PRODCOM estimates at 6-digit level rather than at 8-digit product level will be a very useful.
Suppressing less data . . . is always more useful, although confidentiality rules have to be
kept to guarantee trust in the system. This could be achieved by the publication of the data at
the 6-digit level rather than the 8-digit level . . . it is more useful to have the full data at 6-digit
level than some 8-digit data published and some not.
Going forward,

ONS Statistical Disclosure Control Unit are currently undertaking a project to review the
disclosure tools being used by ONS business surveys and PRODCOM branch commenced
a project in October 2015 to review the current procedures for improving data transparency

at the Eurostat level, UK is supporting the proposal to align PRODCOM with the 6-digit
CPA system of classification, under the FRIBS package, because of the potential benefits
earlier mentioned. Users will be kept informed of progress through the news section of the
PRODCOM web pages

proposals that we trailled in December 2014 and June 2015, such as informing users of
new releases directly by email will be continued

there will be increased efforts to publicise annual events such as the recently formed ONS
Business Statistics Microdata User Group, whose inaugural meeting was held in
September 2015, in addition to the annual business statistics user event, co- hosted by
ONS and the Department for Business, Innovation and Skills (BIS) which focused on ‘The
Changing Shape of UK Manufacturing’ in 2014
1 1
The Framework Regulation Integrating Business Statistics (FRIBS) is aimed at integrating regulations and developing
a legal framework for the systematic collection, compilation, transmission and dissemination of statistics related to the
structure, economic activity, competitiveness, global transactions and performance of the European business sector.
Office for National Statistics
18
Response to users of UK Manufacturers’ Sales by Product Survey
Q15: Do you have any further comments about PRODCOM products or services? For
example, are there any improvements you would like to see?
Answered: 6
Non response or N/A: 10
Users detailed a variety of potential improvements, some of which have already been discussed in
earlier sections of this report. By repeating them, users were perhaps emphasising the importance
of the improvements they would like us to consider.
The proposed improvements include:

Reducing suppression
Much data is suppressed and it is understandable why but could the data perhaps be
amalgamated with other data in such a way not to reveal confidential manufacturing
data but still help marketing analysts understand general trends?
As already mentioned at question 14, there is planned action to improve data transparency

More specific products
It is a bit of a problem when you are looking for a specific product and it has been
grouped together with many other items - which is what I find for medical devices but I
do appreciate it would be difficult to code all of them specifically
The PRODCOM list currently contains around 3,800 unique product codes and as such
capturing more products at a more detailed level may increase data suppression.

Regional data
In order . . . to make full use of PRODCOM data, the sample needs to be stratified by
region so that representative statistics . . . could be produced.
Due to the detailed nature of PRODCOM, regional estimates may increase the number of
data suppressed in the tables. However, in August 2015, we introduced Government Office
Region variable to our data stored on the ONS’ Virtual Microdata Laboratory which should
allow approved users to calculate regional totals as required or for regional analysis.

Clarity, labelling and footnotes
Comments alluded to improving the clarity of the data tables by improving labelling and
footnotes. The team will continue to improve quality checks and to explore ways to enhance
data clarity, in addition to completing the restructuring of the open data reference tables for
the December 2015 release.

Flexible publication at 6 or 8 digit level as per confidentiality requirements
Perhaps the most useful development would be developing a flexible approach
to publication of data at the 6 or 8 digit level, depending on the confidentiality
requirements. However, I can see that this could need manual intervention
Office for National Statistics
19
Response to users of UK Manufacturers’ Sales by Product Survey
which would be more work. Is there scope for involving the trade associations
(who will have their own commitments to confidentiality) for the various
industries in this work?
We already engage with a number of trade associations but also want to widen our
engagement with users. We will extend this engagement to cover other trade associations
in 2016 to discuss, investigate and consider in more detail any specific requirements.
Q16: If you have requested PRODCOM data or information within the last 12 months, did the
response you received meet your requirements?
Answered: 13
Non response or N/A: 3
Over half (53.8%) of respondents who had requested for data or infomation within the last 12
months had their requirements fully met, while 23.1% reported that their requirements were
partially met.
Specifically, respondents’ expectation was for a more timely response to their requests. Two areas
mentioned were responding to email requests and VML data access. We will ensure all requests
are answered promptly.
Regarding the VML, work is underway to improve the application process, specifically, the time
taken to approve research proposals. Wherever possible, the VML team are looking to remove the
administrative burden placed on researchers, whilst at the same time applying appropriate scrutiny
during the decision making process. In the last 6 months, access to the new VML environment has
grown significantly. Access points within the UK have expanded from the ONS offices in London,
Wales and Titchfield, to include other government departments connected to the Public Services
Network (PSN), Scotland and Northern Ireland and plans to provide VML access to government
Office for National Statistics
20
Response to users of UK Manufacturers’ Sales by Product Survey
users in Wales early in 2016 are ahead of schedule.
Q17: How did you hear about PRODCOM publications? Please select all that apply
Answered: 13
Non response or N/A: 3
The most common ways users heard about PRODCOM was either via the ONS website (38.5%),
or through word of mouth (38.5%).
None of our users indicated they heard about PRODCOM publications through Face book, Twitter
or StatsUserNet nor had they heard about PRODCOM through news outlets, despite our short
stories on popular summer products (July 2015) and Christmas products (December 2014) gaining
extensive media coverage. A possible explanation is the short stories were attributed to ONS
rather than specifically to PRODCOM.
The ‘Other (please specify)’ result consisted of users who heard it from their current or former
workplace and also from a published journal article.
The response to this question is helpful as it guides us to where we need to focus our attention to
widen our user base and publicise our outputs, as well as to explore how we can improve the
effectiveness of other communication channels (46.2% of users earlier indicated at question 14
that they would find it useful if we used LinkedIn and StatsUserNet to keep them informed of new
outputs).
Office for National Statistics
21
Response to users of UK Manufacturers’ Sales by Product Survey
Q18: What sector do you work in?
Answered: 13
Non response or N/A: 3
Respondents worked in a reasonably even spread of sectors, weighted slightly towards
Government/public bodies and slightly away from commercial businesses. The ‘Other’ users
comprise a mixture of trade associations and not for profit organisations.
We plan to increase utilisation across all 4 sectors, and explore different methods of doing so in
each sector.
Q19: Would you be willing to discuss your responses further?
Answered: 13
Non response or N/A: 3
The majority of users (62.0%) said they will be willing to discuss their responses further. We will
follow-up on some of the responses to gain further information.
Q20: To make improvements on an ongoing basis, we aim to continue collecting feedback
from our users. Would you be willing to take part in future surveys?
Answered: 13
Non response or N/A: 3
A bigger majority (92.3%) said they are willing to take part in future surveys.
Office for National Statistics
22
Response to users of UK Manufacturers’ Sales by Product Survey
Outcome
A number of actions have already been implemented.
1. PRODCOM open data reference tables have been restructured. Revisions to the PRODCOM
data and metadata deposited at the revamped VML were completed in July 2015.
These products have been publicised, with the relevant links, through the December 2015
statistical bulletin, through StatsUserNet and via direct emailing to known users to increase
awareness. The news section of the PRODCOM web pages has also been updated.
We have also revised the text in the notes section of the statistical bulletin to encourage more
users to apply to the VML as an approved researcher, as access to microdata gives unparalleled
opportunity for users or researchers.
Users will continue to be encouraged to become more comfortable with these facilities as a part of
the ONS’ “digital by default” agenda and are therefore encouraged to view the open data online,
and also download the dataset as a CSV.
We will continue to improve the products that are most used and engage with users to identify how
these products could be improved further to enhance utilisation.
2. The PRODCOM user interpretation manual has been updated with relevant screen shots and
detailed guidance on the effective use of open data tables to improve user experience. In addition,
users are encouraged to not only view the open data online, but also download the dataset as a
CSV.
Although some users expressed a preference for the excel reference tables, these may have to be
discontinued at some point due to resource constraints. Further information will be provided to
users through the news section of the PRODCOM web pages.
3. A review of the PRODCOM quality measures has been brought forward and will be conducted
pending the availability of resources.
We will further implement the following:




Investigate possible options to improve the timeliness of the final estimates and consult
further with users when this work has been completed
Publicise annual changes to the PRODCOM product list since 2008
Give a detailed explanation of the lack of coherence between UK PRODCOM and EU
PRODCOM estimates, and between PRODCOM and other ONS data sources such as the
ABS and Index of Production within the PRODCOM technical report and the notes section
of the statistical bulletin, to improve awareness to the differences between data sources
Encourage users to apply to the VML as an approved researcher, by providing further
information through the statistical bulletin and on the PRODCOM news page - although the
VML is by nature a very secure environment which requires all projects be approved in
advance, the access to microdata gives unparalleled opportunity for users or researchers
Office for National Statistics
23
Response to users of UK Manufacturers’ Sales by Product Survey





Complete the 2 ongoing disclosure methods projects which could eventually lead to
improved data transparency
Explore other avenues of widening our user base such as engagement with trade
associations to discuss and consider any specific requirements and work closely with the
ONS trade branch to identify potential trade associations or through joint events
Engage, through Government User Group meetings or direct contact, with users who are
unable to match the trade data and PRODCOM estimates to explore how best we can
assist them to compare the data more easily
Inform users through Government User Group meetings or via the PRODCOM news page
of Eurostat developments regarding the PRODCOM package in FRIBS2, specifically on the
proposed alignment with the CPA system of classification and once agreed by EU member
states, the PRODCOM technical report will be updated and further information will be
shared on products that will be published at 6-digit level and implementation plans
Re-evaluate the channels through which we publicise PRODCOM data as it is clear that not
all users are in favour of engaging with us through Facebook, Twitter or StatsUserNet and
ensure new stories that use PRODCOM data are more easily able to be linked back to
PRODCOM, rather than just ONS.
Progress against these outcomes will be published in our user engagement report in 2016 which
will include the outcome of other strands of the 2015 PRODCOM medium term user engagement
strategy.
2
The Framework Regulation Integrating Business Statistics (FRIBS) is aimed at integrating regulations and developing a
legal framework for the systematic collection, compilation, transmission and dissemination of statistics related to the
structure, economic activity, competitiveness, global transactions and performance of the European business sector.
Office for National Statistics
24
Response to users of UK Manufacturers’ Sales by Product Survey
Getting in Touch
If you have any queries or comments about the survey process, please email Simeon Bowen at
[email protected] or call 0845 601 3034.
You can also write to us at the following address:
Consultation Coordinator,
Room 1.101
Office for National Statistics,
Government Buildings,
Cardiff Road,
Newport,
South Wales,
NP10 8XG.
For further information on ONS surveys, please visit http://www.ons.gov.uk/ons/about-ons/getinvolved/consultations/index.html
Follow us:
Facebook
Twitter
LinkedIn
YouTube
Storify
Accessibility
All material relating to this consultation can be provided in braille, large print or audio formats on
request. British Sign Language interpreters can also be requested for any supporting events.
Copyright
© Crown copyright 2015
You may re-use this document/publication (not including logos) free of charge in any
format or medium, under the terms of the Open Government Licence v3.0. Where we have
identified any third party copyright information you will need to obtain permission from the
copyright holders concerned.
To view this licence visit:
https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/
email [email protected]
Office for National Statistics
25