Survey response Response to users of UK Manufacturers’ Sales by Product Survey (PRODCOM) outputs December 2015 Office for National Statistics 1 Response to users of UK Manufacturers’ Sales by Product Survey Contents Background ........................................................................................................................ 3 Summary of key results .................................................................................................... 4 Results in detail ................................................................................................................. 5 Q1. Which of the following PRODCOM estimates do you use? ................................................................ 5 Q2. Do you use any other source(s) of manufacturing statistics? ............................................................. 6 Q3. What do you use PRODCOM estimates for?...................................................................................... 7 Q4. Please provide further detail for each of your selections above, for example the projects on which you have used PRODCOM data for and the impact it has had. ................................................................ 7 Q5. Which of the following PRODCOM products or services have you used? ......................................... 9 Q6. How satistfied or dissatisfied are you with the following features of our statistical bulletins?. ......... 10 Q7. How satistfied or dissatisfied are you with the following characteristics of our statistical bulletins? 11 Q8. How satistfied or dissatisfied are you with the following characteristics of PRODCOM data/reference tables?.............................................................................................................................. 12 Q9. Quality measures are published alongside PRODCOM estimates to provide users with an indication of the precision and data quality. How satisfied or dissatisfied are you with the following PRODCOM quality measures? ................................................................................................................ 13 Q10. UK Manufacturers’ Sales by Product survey (PRODCOM) data is now published in Open Data format on the ONS website. This tool allows you to tailor datasets to your requirements and download them in a choice of formats (CSV, XLS, XML).Were you aware of this tool?. ........................ 14 Q11. If yes, how satisfied or dissatisfied are you with the following characteristics of PRODCOM Open Data tables? ................................................................................................................................... 14 Q12. Which of the following industrial divisions are of interest to you in the PRODCOM publications? Please select all that apply ....................................................................................................................... 15 Q13. PRODCOM estimates were previously published together with HMRC trade data on the ONS website. These data are no longer published together as users can access the trade data directly from the HMRC website.Has this change negatively impacted on your work? ....................................... 16 Q14. We are trialing or considering the following improvements to how we communicate PRODCOM estimates. How useful, or not useful, are these improvements likely to be to your work? ...................... 17 Q15. Do you have any further comments about PRODCOM products or services? For example, are there any improvements you would like to see? ...................................................................................... 19 Q16. If you have requested PRODCOM data or information within the last 12 months, did the response you received meet your requirements?.................................................................................... 20 Q17. How did you hear about PRODCOM publications? ........................................................................ 21 Q18. What sector do you work in? ........................................................................................................... 22 Q19. Would you be willing to discuss your responses further? ............................................................... 22 Q20. To make improvements on an ongoing basis, we aim to continue collecting feedback from our users. Would you be willing to take part in future surveys? ..................................................................... 22 Outcome ........................................................................................................................... 23 Getting in Touch .............................................................................................................. 25 Accessibility ..................................................................................................................... 25 Copyright .......................................................................................................................... 25 Office for National Statistics 2 Response to users of UK Manufacturers’ Sales by Product Survey Background The PRODCOM branch within Office for National Statistics (ONS) is responsible for producing the UK Manufacturers’ Sales by Product (PRODCOM) survey alongside associated estimates and publications which we publish twice a year, in June (provisional estimates) and December (intermediate and final estimates). We have to engage with users as enshrined in the UK Statistics Authority (UKSA) Code of Practice and emphasised in their 2012 assessment of PRODCOM. This includes to improve or widen user engagement, measure satisfaction on how we disseminate our statistics, better understand and meet, where possible, any changing needs and to notify users of the actions we plan to take. During September and October 2015 we conducted a short user engagement survey for approximately 6 weeks, closing on 26th October. It was available via an online forum ‘Survey Monkey’ and publicised through PRODCOM web pages, Twitter, StatsUserNet, as well as emailed directly to 106 known users on the PRODCOM mailing list, 74 Virtual Microdata Laboratory (VML) and 9 UK Data Service (UKDS) users. The aim of the survey was generally to help us ascertain the key outputs that are used, what users think about the quality of these outputs, recent or proposed improvements and improvements that users would like us to consider. Within this report are the main findings from the survey and the outcome. Both quantitative and qualitative feedback is reported. A link to this report will be included in the PRODCOM Intermediate 2014 and Final 2013 statistical bulletin, due for publication on 17th December 2015. ONS would like to thank all users who responded to the survey. The findings will be used to help improve our products and services and to develop the way we engage and communicate with users. Office for National Statistics 3 Response to users of UK Manufacturers’ Sales by Product Survey Summary of key results Key findings from the survey were as follows: There were 16 responses from a variety of stakeholders including government departments, a devolved administration, consultancy firms, academics, and trade bodies The majority of respondents have used all of the 3 main sets of PRODCOM results although the most used (86.7%) was the final results. The least used was the intermediate results (60.0%) while provisional results had a usage of 73.3%. 87.5% of respondents use other sources of manufacturing statistics. 68.8% of respondents also used manufacturing data sources not produced by ONS The most common use of PRODCOM estimates was for market research (43.8%) while the most popular product or service was the excel reference tables, at 81.3% usage. Majority (83.0%) of users indicated that the removal of the HMRC trade data, which was previously published alongside PRODCOM estimates, had not negatively impacted on their work Overall, those who used the statistical bulletin, excel reference tables and quality measures were generally satisfied with these outputs although over half (58.3%) of users were unaware of the Open data tool Some respondents felt aligning PRODCOM product codes to the classification of products by activity (CPA) and publishing results at 6-digits product level rather than at 8-digit level will be helpful while others indicated that it will not be useful All PRODCOM industrial divisions were of interest to respondents; particularly fabricated metal products (76.9%), motor vehicles, trailers and semi-trailers (69.2%) and machinery and equipment (69.2%). Over 50.0% usage was reported for 18 out of the 25 divisions Suppressing less data, informing them of new releases through direct email and a section in the statistical bulletin that provides extra commentary for a specific industrial division, were improvements users said they would find very or fairly useful. Other improvements mentioned include stratifying the sample by region, better labelling, footnotes and clarity to the reference tables The most frequent way people had heard about PRODCOM was “Word of Mouth” or via “ONS Website”; no respondents access PRODCOM through StatsUserNet, Twitter or Facebook Actions that have been taken or will be taken in response to this feedback is summarised in the ‘Outcome’ section at the end of this report. Office for National Statistics 4 Response to users of UK Manufacturers’ Sales by Product Survey Results in detail All figures in the charts are given as a percentage of the respondents who answered each particular question, rather than as a percentage of the 16 respondents to the survey as a whole. The number of responses to each question is given just beneath the text of the question. For example, 15 of the 16 respondents provided a response to question 1. The bar chart thus contains information on the percentage of these 15 respondents. Q1: Which of the following PRODCOM estimates have you used? Please select all that apply Answered: 15 Non response or Not Applicable (N/A): 1 The responses indicated that the final PRODCOM estimates (published annually in December) were our most popular set of estimates at 86.7% usage. This might be expected, as the final results have been through 2 rounds of revisions so user trust may be higher when compared with provisional or intermediate results. However, this may also reflect on how some users view the timeliness of our statistics (see questions 7 and 8) as our final results are published around 24 months after the end of the reference period. Provisional and intermediate results are published 6 and 12 months respectively after the end of the reference period. High usage was also reported for these estimates (73.3% for provisionals and 60.0% for intermediates). We will investigate posible options to improve the timeliness of the final estimates and consult further with users when this work has been completed. Office for National Statistics 5 Response to users of UK Manufacturers’ Sales by Product Survey Q2: Do you use any other source(s) of manufacturing statistics? Answered: 16 Non response or N/A: 0 The majority of PRODCOM users who responded to the user engagement survey also use other manufacturing statistics including: other ONS sources such as UK Trade in Goods, the Annual Business Survey (ABS), Index of Production, Turnover and Orders in Production and Services Industries manufacturing statistics external to ONS such as European statistics, other National Statistics, HMRC trade data, information from trade associations or from individual companies, and market research reports Office for National Statistics 6 Response to users of UK Manufacturers’ Sales by Product Survey Q3: What do you use PRODCOM estimates for? Please select all that apply Answered: 16 Non response or N/A: 0 The most common use of PRODCOM statistics was Market Research, reported by 43.8% of respondents. The same proportion also reported ‘Other’, indicating that the current uses for PRODCOM are quite diverse. ‘Other’ uses include production of government statistics, presentations to industry, benchmarking, for publications and planned future use for policy purposes. Q4: Please provide further detail for each of your selections above (for example the projects on which you have used PRODCOM data and the impact it has had). Answered: 14 Non response or N/A: 2 From the further detail given by respondents, several of our users seem to make use of PRODCOM estimates to aid with market research or projects, often alongside other market research reports. Our company is interested to grow its market in UK, for this reason we need to know which markets are growing to better understand customers’ needs and approaches to the business. I use PRODCOM when market research reports do not contain specific enough data. Users such as trade associations or research consultancies utilise PRODCOM estimates to prepare reports on specific sectors and aspects of the economy, for example growth or potential future challenges or strategic planning. UK's Textiles industry, challenges and prospects The data are used to compile "production" data (I know it is technically sales of UK made goods) for the industries that we cover as a Trade Association - these are metal working Office for National Statistics 7 Response to users of UK Manufacturers’ Sales by Product Survey machine tools, cutting tools and tool/work-holding equipment. We use the data both at an industry level and at the product level, although the latter is, of course, restricted somewhat by confidentiality. Industry level data is used in policy/planning (including as part of the forecasting process for our industry) and in media announcements; product level data is more relevant to market research, including the use of the data in exchanges and comparisons internationally. Used for internal strategic planning. Summary of key statistics made available to the furniture sector to assist with their own planning (particularly useful to the large number of SMEs who don't have the resource to trawl the data) Use snapshots to support press releases Use data to support published technical output. Finally, some government users require PRODCOM data to either carry out assessments, analysis, help compile official statistics or design their sample. To provide benchmarks to assess the success of applicants to the Queen's Awards for Enterprise. The awards are given to those who can "show that your organisation has achieved outstanding growth in overseas earnings relative to your business size and sector" with regards to international exports. Data feeds Supply and Use tables which determine the definitive annual estimate of GDP (a statutory requirement) . . . PRODCOM data are critical to informing the supply and use balancing process for the manufacturing industries. . . . to augment other datasets to estimate activity and therefore emissions from specific sectors. This feeds into the national submissions of emission estimates for Greenhouse Gases and also Air Quality pollutants, to international reporting mechanisms (to the EU and UN). Typically the PRODCOM data are used to provide insight into the time series of activities in individual economic sectors. The qualitative responses to the use of PRODCOM data are extremely helpful as they could help tailor future improvements to user needs and also targeted to specific products, industries or industrial divisions. Office for National Statistics 8 Response to users of UK Manufacturers’ Sales by Product Survey Q5: Which of the following PRODCOM products or services have you used? Please select all that apply Answered: 16 Non response or N/A: 0 The most popular PRODCOM product or service was the excel reference tables, at 81.3% usage. By comparison, the next highest was the statistical bulletin at 31.3%, then both the open data tables and the methodology information were at 18.8%. PRODCOM outputs are available via the Virtual Microdata Laboratory (VML) and UK Data service (UKDS). However, these services do not appear to be well utilised by respondents. This could partly be due to these users not filling in the user engagement survey, lack of awareness of the usefulness of these services or a future intended use of the VML, as indicated by a respondent. There have been recent improvements to PRODCOM data and metadata that are deposited at the VML and renewed effort will be made to publicise this service. Furthermore, we will continue to improve the products that are most used and engage with users to identify how these products could be improved further to enhance utilisation. Office for National Statistics 9 Response to users of UK Manufacturers’ Sales by Product Survey Q6: How satisfied or dissatisfied are you with the following features of PRODCOM statistical bulletins? Answered: 13 Non response or N/A: 3 Very satisfied Satisfied Main points 15.4 Summary Percentage (%) Very Don’t dissatisfied use Dissatisfied 30.8 Neither satisfied nor dissatisfied 7.7 0.0 0.0 46.2 15.4 30.8 7.7 0.0 0.0 46.2 Results by Products 23.1 15.4 15.4 7.7 0.0 38.5 Results by industrial division 23.1 15.4 7.7 7.7 0.0 46.2 European comparisons 7.7 7.7 23.1 0.0 0.0 61.5 Infographics and charts 0.0 15.4 15.4 0.0 0.0 69.2 Background notes section 7.7 38.5 7.7 0.0 0.0 46.2 The majority of respondents who use the statistical bulletin were either ‘very satisfied’ or ‘satisfied’ with most of its features - 32 of the 45 responses other than ‘Don’t use’ give this indication. The main points, summary and background notes section especially show more users being satisfied with these features compared with the others. Qualitative feedback suggested that the statistical bulletin is . . . . . . a good and concise summary which helps put text to statistics. This enables me to understand what the data says and to help me explain it to others. . . . very good, if I just need a quick summary of the landscape. The 2 features of the statistical bulletin - “Results by Products” and “Results by Industrial Division” where comparatively more users reported being ‘very satisfied’ were also the features that some users expressed dissatisfaction. A respondents’ expression of disapproval was as follows: . . . hard to untangle - and I am a highly experienced user; (It’s) difficult to track down sector and product definitions when they change. This comment provides insight to a specific area of improvement for us to consider, such as providing users, through the PRODCOM webpages, with the annual changes to the PRODCOM product codes and the PRODCOM List. Furthermore, we will consider improving the information and commentary we provide within the results by products and industrial division sections. Office for National Statistics 10 Response to users of UK Manufacturers’ Sales by Product Survey Q7: How satisfied or dissatisfied are you with the following characteristics of PRODCOM statistical bulletins? Answered: 10 Non response or N/A: 6 Very satisfied Satisfied Timeliness of the bulletin 10.0 40.0 Neither satisfied nor dissatisfied 40.0 Ease of access 20.0 30.0 Appearance 30.0 Relevance to your needs Coherence with other data sources Percentage (%) Dissatisfied Very dissatisfied 10.0 0.0 40.0 10.0 0.0 30.0 40.0 0.0 0.0 20.0 50.0 30.0 0.0 0.0 20.0 30.0 40.0 10.0 0.0 Overall, feedback from users of the PRODCOM statistical bulletin is positive across the 5 characteristics but especially with regards to relevance and appearance. Instances of dissatisfaction were reported for timeliness, ease of access and coherence with other data sources as gleaned from this response: Timeliness is much better now that Eurostat requires the data to be lodged by the end of June, but there is always scope for quicker publication . . . I have long had a problem in the coherence of the data from PRODCOM, the Index of Production and the ABI/ABS . . . I know that they are not necessarily collecting the same data, but they rarely give the same order of magnitude and, occasionally, even point in different directions. The number of users who indicated that they were ‘neither satisfied nor dissatisfied’ was almost as high as those who expressed levels of satisfaction, for most of the characteristics. This may be an indication that, overall, we need to do more to improve the statistical bulletin, for example provide more detailed information regarding the coherence of PRODCOM and other related ONS data sources. Office for National Statistics 11 Response to users of UK Manufacturers’ Sales by Product Survey Q8: How satisfied or dissatisfied are you with the following characteristics of PRODCOM reference/data tables? Answered: 10 Non response or N/A: 6 Very satisfied Satisfied 20.0 50.0 Neither satisfied nor dissatisfied 20.0 0.0 70.0 Ease of access 20.0 Appearance Relevance to your needs Level of detail Timeliness Coherence with other data sources Comparability over time Percentage (%) Dissatisfied Very dissatisfied 10.0 0.0 20.0 10.0 0.0 50.0 10.0 10.0 0.0 10.0 70.0 10.0 10.0 0.0 20.0 50.0 20.0 10.0 0.0 0.0 40.0 40.0 20.0 0.0 10.0 40.0 40.0 10.0 0.0 Note: Some rows may not sum to 100% because not all of the 10 respondents gave an answer for each row. The excel reference tables were earlier reported as the most popular PRODCOM product. Although levels of satisfaction were expressed across all 7 characteristics of the tables, the majority of users did so for 5 of the characteristics, with the highest being for appearance. Dissatisfaction was also reported especially for coherence with other data sources. There is always a difference between the figures from Eurostat PRODCOM and ONS PRODCOM figures. I understand the issue could be due to suppression of some of the data and exchange rate conversion of £ to Euro. There have been some instances the Eurostat figures are higher than UK figures. It’s quite hard to sift key data from the list of options . . . and to know which elements make up the headline figures. Volume (weight) data is sometimes difficult to reconcile. Values can be significantly different from ABS (even accounting for different collection times and periods) There were different views regarding the removal of HMRC trade data with some users appreciating the extra clarity gained, while others felt the tables were less useful following the removal (also see question 13). The appearance is much better now that the export/import data has been taken out and we only get the PRODCOM data; this has allowed the time series of the PRODCOM data to be published and is a great improvement. There has been a big improvement to the structure of the data tables recently. However not having the export data has meant that the data is not as useful to us. And not having an easy way to link into the HMRC data means that we can't construct the data we need. We will engage further with users of the trade data to see how best we can meet their needs in addition to improving user awareness to the differences between data sources. Office for National Statistics 12 Response to users of UK Manufacturers’ Sales by Product Survey Q9: Quality measures are published alongside PRODCOM estimates to provide users with an indication of the precision and data quality. How satisfied or dissatisfied are you with the following PRODCOM quality measures? Answered: 11 Non response or N/A: 5 Percentage (%) Very Don't dissatisfied use Very satisfied Satisfied Neither satisfied nor dissatisfied Dissatisfied UK Manufacturer Sales (in £millions) 0.0 63.6 18.2 0.0 0.0 18.2 Standard error (in £millions) 0.0 27.3 18.2 0.0 0.0 45.5 Standard error expressed as a percentage of UK Manufacturer Sales 0.0 18.2 18.2 0.0 0.0 54.5 Number of companies making the product in the sample 9.1 27.3 18.2 0.0 0.0 36.4 Total employment of companies making the product in the sample (in thousands) 9.1 27.3 18.2 0.0 0.0 36.4 Note: Some rows may not sum to 100% because not all of the 11 respondents gave an answer for each row. Users expressed levels of satisfaction with the various aspects of the PRODCOM quality measures with most feedback positive or neutral. However, there were aspects of the quality measures such as the standard error with a high percentage (54.5%) of non usage. The following qualitative feedback provides a rich source of information as to where we could investigate further to improve the relevance of the quality measures to the satisfaction of users. While I understand why it is done, the figure of "<=5" does not really help much and, at the product level, rounding the employment numbers to the nearest 1000 (does "<=1" imply that it is less than 500 because if it was, say 750, it would round-up to 1?) is not really helpful. For employment and number of companies, it would be more useful to have figures at the 4-digit industry level; we get this from the ABI/ABS, but that is for companies classified to the industry, not necessarily the number who are making the products of that industry. The coefficient of variation (the standard error as a percentage of the estimate), in particular, is an important indicator of the reliability of a statistic. A review of PRODCOM quality measures has already been identified by the PRODCOM team as future work, but this will now be brought forward. Office for National Statistics 13 Response to users of UK Manufacturers’ Sales by Product Survey Q10: UK Manufacturers’ Sales by Product survey data is now published in open data format on the ONS website. This tool allows you to tailor datasets to your requirements and download them in a choice of formats (CSV, XLS, XML). Were you aware of this tool? Answered: 12 Non response or N/A: 4 Less than half of respondents (41.7%) indicated that they are aware of the open data tool which was launched in December 2014, to make PRODCOM data available in a user friendly and interactive format. Q11: If yes, how satisfied or dissatisfied are you with the following characteristics of PRODCOM open data tables? Answered: 6 Non response or N/A: 10 Very satisfied Satisfied Level of detail 16.7 16.7 Neither satisfied nor dissatisfied 50.0 Appearance 16.7 33.3 Clarity 0.0 Ease of access Ease of use Relevance to your needs Percentage (%) Dissatisfied Very dissatisfied 16.7 0.0 50.0 0.0 0.0 33.3 50.0 16.7 0.0 0.0 33.3 50.0 16.7 0.0 0.0 16.7 50.0 33.3 0.0 16.7 33.3 50.0 0.0 0.0 Users who were aware of our open data tables, expressed satisfaction, particularly on the appearance of these tables, which we introduced in December 2014, and relevance to their needs. However, there was also some constructive feedback on their ease of use. I find it difficult to use this format at times as I can't always remember how I accessed it the previous time. If I used it more often then I think I would better remember all the various parameters and sub analysis I use. With the introduction of the open data tables, the intention is to eventually phase out excel reference tables rather than use both tools. However there was indication that the excel format is the preference of some users. I have not spent much time with this tool. It is a nice tool if you want a quick info about a specific product and you don’t want to download the whole data. But for in-depth analysis on more than 1 product I still prefer downloading the excel sheet and analysing on my own. The open data tables have been restructured. The tool will be publicised further to increase awareness, and an updated user guide produced with relevant screen shots and detailed guidance to improve user experience. Office for National Statistics 14 Response to users of UK Manufacturers’ Sales by Product Survey Q12: Which of the following industrial divisions are of interest to you in the PRODCOM publications? Please select all that apply Answered: 13 Non response or N/A: 3 Respondents indicated an interest in all 25 PRODCOM industrial divisions. There was over 50.0% interest reported in 18 divisions with at least 38.5% of respondents interested in each division. The most popular divisions seemed to centre around the manufacture of metals and metal products, vehicles and transport equipment, machinery and its repair and installation, and computer and electronic equipment. This information is of interest as it identifies industrial divisions we could possibly focus our commentary on in the statistical bulletin. Office for National Statistics 15 Response to users of UK Manufacturers’ Sales by Product Survey Q13: PRODCOM estimates were previously published together with HMRC trade data on the ONS website. These data are no longer published together as users can access the trade data directly from the HMRC website. Has this change negatively impacted on your work? Answered: 12 Non response or N/A: 4 In November 2014, ONS ceased publishing HMRC trade data together with PRODCOM estimates due to comparability issues and because users could access the former directly from the HMRC website. Prior to removal, a discussion was held with a number of key users. As mentioned earlier at question 8, there were different views, with some users appreciating the extra clarity gained when using the reference tables, while others felt the tables were less useful. When asked directly if the removal of the trade data had negatively impacted on their work, the majority (83.3%) of users suggested that it had not. The combined data often appeared to contradict each other - publishing separately improves the clarity of PRODCOM data. We think this is a positive move . . . it has allowed much better presentation of the PRODCOM time series data . . . For our main industry (metal working machine tools, called metal forming machinery 2841 in PRODCOM), there is a good match between the PRODCOM and HS/CN classifications. We track the export/import data at a quarterly level (occasionally monthly) from the HMRC database and it is easy for us to match this up to the PRODCOM figures. We never used export/import data in the PRODCOM tables. Have always used HMRC data separately Some respondents (16.7%), however, indicated that there had been some impact or potentially there could be a minor impact. It is not possible to match the data . . . We seem to have a list of definitions which include product codes with 3, 5 and 7 digits. Trade data can only be downloaded from the HMRC web site at 2, 4, 6 and 8 digit levels. Office for National Statistics 16 Response to users of UK Manufacturers’ Sales by Product Survey Don't know as I have yet to do the latest analysis. If the sector sub categories are the same, and the data sets between PRODCOM and HMRC are comparable then the impact will be minor. We will engage further with users of the trade data who are unable to match the 2 sets of estimates to see how best we can assist them in comparing the data more easily. Q14: We are trialling or considering the following improvements to how we communicate PRODCOM estimates. How useful, or not useful, are these improvements likely to be to your work? Answered: 13 Non response or N/A: 3 Percentage (%) Not at all Don't useful know Very useful Fairly useful Not very useful 7.7 23.1 30.8 7.7 23.1 Special focus or analysis on a specific manufacturing industry or division within each statistical bulletin 23.1 38.5 7.7 7.7 15.4 Suppressing less data to improve transparency of PRODCOM estimates to users 69.2 7.7 0.0 0.0 23.1 Aligning product codes to the classification of products by activity (CPA) and publishing PRODCOM estimates at 6-digit level rather than at 8-digit product level 23.1 0.0 7.7 30.8 30.8 An annual user event 30.8 15.4 15.4 7.7 23.1 Direct email to users to inform them of new data releases and developments 53.8 7.7 7.7 0.0 23.1 Use of LinkedIn and StatsUserNet to keep users informed of new PRODCOM products / outputs 15.4 30.8 15.4 15.4 15.4 Use of Twitter to keep users informed of new products / outputs 0.0 15.4 38.5 15.4 23.1 A shortened or abridged version of the PRODCOM statistical bulletin Note: Some rows may not sum to 100% because not all of the 13 respondents gave an answer for each row. Generally, there was mixed opinion across the different proposed improvements to the survey. Based on the number of responses, improvements that users would particularly find useful include suppressing less data (76.9%), the specific focus on particular manufacturing divisions (61.6%) and sending emails directly to users regarding new releases and developments (61.5%). Response was also mixed regarding an annual user event, the use of LinkedIn and StatsUserNet, producing a shortened or abridged statistical bulletin and aligning PRODCOM product codes to the classification of products by activity (CPA). Users largely did not think that use of Twitter would be useful in relation to communicating new products or outputs. Qualitative feedback, again gives valuable insight to the perceptions of users. On the proposal to use LinkedIn/StatsUserNet, 46.2% of respondents said they will find it useful while 30.8% would not find it useful. Office for National Statistics 17 Response to users of UK Manufacturers’ Sales by Product Survey How information is communicated depends on different users approaches. Would you be setting up a group in LinkedIn, for example, so that a discussion could take place? Twitter and social media such as LinkedIn really have no place in ONS statistics. LinkedIn is used primarily for sales contacts and promotion and Twitter for keeping abreast mainly of celebrity news. Please do not waste your time in this direction and instead focus on the matter of producing timely and easily accessible statistics. The European Statistical Office is proposing under the PRODCOM package in FRIBS1 to align the product codes to the CPA. Potential benefits include reduced burden on data producers and suppliers, and less data suppression. Whereas 23.1% of respondents felt this would be useful, 38.5% did not think it would, with just under a third (30.8%) of users reporting ‘dont know’. I don't understand CPA and prefer the current 8-digit product level instead. I am used to this and am worried about comparative data if the product code is changed. Aligning product codes to the classification of products by activity (CPA) and publishing PRODCOM estimates at 6-digit level rather than at 8-digit product level will be a very useful. Suppressing less data . . . is always more useful, although confidentiality rules have to be kept to guarantee trust in the system. This could be achieved by the publication of the data at the 6-digit level rather than the 8-digit level . . . it is more useful to have the full data at 6-digit level than some 8-digit data published and some not. Going forward, ONS Statistical Disclosure Control Unit are currently undertaking a project to review the disclosure tools being used by ONS business surveys and PRODCOM branch commenced a project in October 2015 to review the current procedures for improving data transparency at the Eurostat level, UK is supporting the proposal to align PRODCOM with the 6-digit CPA system of classification, under the FRIBS package, because of the potential benefits earlier mentioned. Users will be kept informed of progress through the news section of the PRODCOM web pages proposals that we trailled in December 2014 and June 2015, such as informing users of new releases directly by email will be continued there will be increased efforts to publicise annual events such as the recently formed ONS Business Statistics Microdata User Group, whose inaugural meeting was held in September 2015, in addition to the annual business statistics user event, co- hosted by ONS and the Department for Business, Innovation and Skills (BIS) which focused on ‘The Changing Shape of UK Manufacturing’ in 2014 1 1 The Framework Regulation Integrating Business Statistics (FRIBS) is aimed at integrating regulations and developing a legal framework for the systematic collection, compilation, transmission and dissemination of statistics related to the structure, economic activity, competitiveness, global transactions and performance of the European business sector. Office for National Statistics 18 Response to users of UK Manufacturers’ Sales by Product Survey Q15: Do you have any further comments about PRODCOM products or services? For example, are there any improvements you would like to see? Answered: 6 Non response or N/A: 10 Users detailed a variety of potential improvements, some of which have already been discussed in earlier sections of this report. By repeating them, users were perhaps emphasising the importance of the improvements they would like us to consider. The proposed improvements include: Reducing suppression Much data is suppressed and it is understandable why but could the data perhaps be amalgamated with other data in such a way not to reveal confidential manufacturing data but still help marketing analysts understand general trends? As already mentioned at question 14, there is planned action to improve data transparency More specific products It is a bit of a problem when you are looking for a specific product and it has been grouped together with many other items - which is what I find for medical devices but I do appreciate it would be difficult to code all of them specifically The PRODCOM list currently contains around 3,800 unique product codes and as such capturing more products at a more detailed level may increase data suppression. Regional data In order . . . to make full use of PRODCOM data, the sample needs to be stratified by region so that representative statistics . . . could be produced. Due to the detailed nature of PRODCOM, regional estimates may increase the number of data suppressed in the tables. However, in August 2015, we introduced Government Office Region variable to our data stored on the ONS’ Virtual Microdata Laboratory which should allow approved users to calculate regional totals as required or for regional analysis. Clarity, labelling and footnotes Comments alluded to improving the clarity of the data tables by improving labelling and footnotes. The team will continue to improve quality checks and to explore ways to enhance data clarity, in addition to completing the restructuring of the open data reference tables for the December 2015 release. Flexible publication at 6 or 8 digit level as per confidentiality requirements Perhaps the most useful development would be developing a flexible approach to publication of data at the 6 or 8 digit level, depending on the confidentiality requirements. However, I can see that this could need manual intervention Office for National Statistics 19 Response to users of UK Manufacturers’ Sales by Product Survey which would be more work. Is there scope for involving the trade associations (who will have their own commitments to confidentiality) for the various industries in this work? We already engage with a number of trade associations but also want to widen our engagement with users. We will extend this engagement to cover other trade associations in 2016 to discuss, investigate and consider in more detail any specific requirements. Q16: If you have requested PRODCOM data or information within the last 12 months, did the response you received meet your requirements? Answered: 13 Non response or N/A: 3 Over half (53.8%) of respondents who had requested for data or infomation within the last 12 months had their requirements fully met, while 23.1% reported that their requirements were partially met. Specifically, respondents’ expectation was for a more timely response to their requests. Two areas mentioned were responding to email requests and VML data access. We will ensure all requests are answered promptly. Regarding the VML, work is underway to improve the application process, specifically, the time taken to approve research proposals. Wherever possible, the VML team are looking to remove the administrative burden placed on researchers, whilst at the same time applying appropriate scrutiny during the decision making process. In the last 6 months, access to the new VML environment has grown significantly. Access points within the UK have expanded from the ONS offices in London, Wales and Titchfield, to include other government departments connected to the Public Services Network (PSN), Scotland and Northern Ireland and plans to provide VML access to government Office for National Statistics 20 Response to users of UK Manufacturers’ Sales by Product Survey users in Wales early in 2016 are ahead of schedule. Q17: How did you hear about PRODCOM publications? Please select all that apply Answered: 13 Non response or N/A: 3 The most common ways users heard about PRODCOM was either via the ONS website (38.5%), or through word of mouth (38.5%). None of our users indicated they heard about PRODCOM publications through Face book, Twitter or StatsUserNet nor had they heard about PRODCOM through news outlets, despite our short stories on popular summer products (July 2015) and Christmas products (December 2014) gaining extensive media coverage. A possible explanation is the short stories were attributed to ONS rather than specifically to PRODCOM. The ‘Other (please specify)’ result consisted of users who heard it from their current or former workplace and also from a published journal article. The response to this question is helpful as it guides us to where we need to focus our attention to widen our user base and publicise our outputs, as well as to explore how we can improve the effectiveness of other communication channels (46.2% of users earlier indicated at question 14 that they would find it useful if we used LinkedIn and StatsUserNet to keep them informed of new outputs). Office for National Statistics 21 Response to users of UK Manufacturers’ Sales by Product Survey Q18: What sector do you work in? Answered: 13 Non response or N/A: 3 Respondents worked in a reasonably even spread of sectors, weighted slightly towards Government/public bodies and slightly away from commercial businesses. The ‘Other’ users comprise a mixture of trade associations and not for profit organisations. We plan to increase utilisation across all 4 sectors, and explore different methods of doing so in each sector. Q19: Would you be willing to discuss your responses further? Answered: 13 Non response or N/A: 3 The majority of users (62.0%) said they will be willing to discuss their responses further. We will follow-up on some of the responses to gain further information. Q20: To make improvements on an ongoing basis, we aim to continue collecting feedback from our users. Would you be willing to take part in future surveys? Answered: 13 Non response or N/A: 3 A bigger majority (92.3%) said they are willing to take part in future surveys. Office for National Statistics 22 Response to users of UK Manufacturers’ Sales by Product Survey Outcome A number of actions have already been implemented. 1. PRODCOM open data reference tables have been restructured. Revisions to the PRODCOM data and metadata deposited at the revamped VML were completed in July 2015. These products have been publicised, with the relevant links, through the December 2015 statistical bulletin, through StatsUserNet and via direct emailing to known users to increase awareness. The news section of the PRODCOM web pages has also been updated. We have also revised the text in the notes section of the statistical bulletin to encourage more users to apply to the VML as an approved researcher, as access to microdata gives unparalleled opportunity for users or researchers. Users will continue to be encouraged to become more comfortable with these facilities as a part of the ONS’ “digital by default” agenda and are therefore encouraged to view the open data online, and also download the dataset as a CSV. We will continue to improve the products that are most used and engage with users to identify how these products could be improved further to enhance utilisation. 2. The PRODCOM user interpretation manual has been updated with relevant screen shots and detailed guidance on the effective use of open data tables to improve user experience. In addition, users are encouraged to not only view the open data online, but also download the dataset as a CSV. Although some users expressed a preference for the excel reference tables, these may have to be discontinued at some point due to resource constraints. Further information will be provided to users through the news section of the PRODCOM web pages. 3. A review of the PRODCOM quality measures has been brought forward and will be conducted pending the availability of resources. We will further implement the following: Investigate possible options to improve the timeliness of the final estimates and consult further with users when this work has been completed Publicise annual changes to the PRODCOM product list since 2008 Give a detailed explanation of the lack of coherence between UK PRODCOM and EU PRODCOM estimates, and between PRODCOM and other ONS data sources such as the ABS and Index of Production within the PRODCOM technical report and the notes section of the statistical bulletin, to improve awareness to the differences between data sources Encourage users to apply to the VML as an approved researcher, by providing further information through the statistical bulletin and on the PRODCOM news page - although the VML is by nature a very secure environment which requires all projects be approved in advance, the access to microdata gives unparalleled opportunity for users or researchers Office for National Statistics 23 Response to users of UK Manufacturers’ Sales by Product Survey Complete the 2 ongoing disclosure methods projects which could eventually lead to improved data transparency Explore other avenues of widening our user base such as engagement with trade associations to discuss and consider any specific requirements and work closely with the ONS trade branch to identify potential trade associations or through joint events Engage, through Government User Group meetings or direct contact, with users who are unable to match the trade data and PRODCOM estimates to explore how best we can assist them to compare the data more easily Inform users through Government User Group meetings or via the PRODCOM news page of Eurostat developments regarding the PRODCOM package in FRIBS2, specifically on the proposed alignment with the CPA system of classification and once agreed by EU member states, the PRODCOM technical report will be updated and further information will be shared on products that will be published at 6-digit level and implementation plans Re-evaluate the channels through which we publicise PRODCOM data as it is clear that not all users are in favour of engaging with us through Facebook, Twitter or StatsUserNet and ensure new stories that use PRODCOM data are more easily able to be linked back to PRODCOM, rather than just ONS. Progress against these outcomes will be published in our user engagement report in 2016 which will include the outcome of other strands of the 2015 PRODCOM medium term user engagement strategy. 2 The Framework Regulation Integrating Business Statistics (FRIBS) is aimed at integrating regulations and developing a legal framework for the systematic collection, compilation, transmission and dissemination of statistics related to the structure, economic activity, competitiveness, global transactions and performance of the European business sector. Office for National Statistics 24 Response to users of UK Manufacturers’ Sales by Product Survey Getting in Touch If you have any queries or comments about the survey process, please email Simeon Bowen at [email protected] or call 0845 601 3034. You can also write to us at the following address: Consultation Coordinator, Room 1.101 Office for National Statistics, Government Buildings, Cardiff Road, Newport, South Wales, NP10 8XG. For further information on ONS surveys, please visit http://www.ons.gov.uk/ons/about-ons/getinvolved/consultations/index.html Follow us: Facebook Twitter LinkedIn YouTube Storify Accessibility All material relating to this consultation can be provided in braille, large print or audio formats on request. British Sign Language interpreters can also be requested for any supporting events. Copyright © Crown copyright 2015 You may re-use this document/publication (not including logos) free of charge in any format or medium, under the terms of the Open Government Licence v3.0. Where we have identified any third party copyright information you will need to obtain permission from the copyright holders concerned. To view this licence visit: https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/ email [email protected] Office for National Statistics 25
© Copyright 2026 Paperzz