GS1 Standards Spring Event
18-22 March 2013 – Dallas
Building Standards to Deliver Business Value
Name of Session: The Data Quality Journey
MO DQ Services & Best Practices
Time of Session: Monday 9:00 – 10:00
Who May Attend: Everyone
Speaker names: Mark Widman, GS1 Global Office
Sjoerd Schaper, GS1 Netherlands
Carlos Ramos Aguilar, GS1 Mexico
Robert Besford, GS1 UK
Introductions and the Data Quality Journey
Mark Widman, Director of Data Quality
GS1 Global Office
Sjoerd Schaper, Manager GS1 Data Pool
GS1 Netherlands
Carlos Ramos Aguilar, Innovation Manager
GS1 Mexico
2020
Robert Besford, Solutions Development
GS1 UK
2011
2010
2010
2010
2014
2013
2012
201
0
Simplified DQF Light
B2C Attributes
New DQ KPI’s
Inventory of MO DQ Programs
3rd Party DQ Solution Providers
Data Crunch Reports
MO DQ Tool Kit
DQF 1.0
DQF 2.0
© 2013 GS1
DQF 3.0
Implementation Guide DQF
Started Inventory of DQ Programs
2
GS1 Data Quality Foundation - Documentation and Tools
DQF 3.0
Implementation
Guide
3M
AAFES
ConAgra Foods
Helen of Troy
METRO Group
Nestle
PepsiCo
Procter & Gamble
Royal Ahold
SCA
The J.M. Smucker
Unilever
Wegmans Foods
GS1 Australia
GS1 Columbia
GS1 Global Office
GS1 India
GS1 Italy
GS1 Korea
GS1 Germany
2014
GS1 Mexico
GS1 Netherlands
GS1 South Africa
GS1 Sweden
GS1 UK
AAFES
Bissell Homecare
Campbell Soup
ConAgra Foods
Georgia Pacific
Gladson
Helen of Troy
Kimberly Clark
METRO Group
Nestle
PepsiCo
Procter & Gamble
Royal Ahold
Sara Lee
SCA
Tesco
The J.M. Smucker
Unilever
Wegmans Foods
Capgemini
GMA
GS1 Australia
2013
GS1 Columbia
GS1 Global Office
GS1 India
2012
201
GS1 Italy
Simplified DQF Light
0
GS1 Germany B2C Attributes
2011
MO Tool Kit
2010
GS1 Mexico
New DQ KPI’s
GS1 Netherlands
Inventory of MO DQ Programs
2010
GS1 Australia
2010
GS1 South Africa
3rd Party DQGS1
Solution
Providers
GS1 Canada
Sweden
GS1 Columbia
GS1 UK
Data Crunch Reports
GS1 Global Office
MO DQ Tool Kit
GS1 France
DQF 3.0
GS1 India
Implementation Guide DQF
GS1 Sweden
GS1 UK
Started Inventory of DQ Programs
GS1 US
Inventory Report
GS1 Australia
GS1 Brazil
GS1 Canada
GS1 China
GS1 Croatia
GS1 Columbia
GS1 France
GS1 Germany
GS1 Global Office
GS1 Hong Kong
GS1 Hungry
GS1 India
GS1 Italy
GS1 Japan
GS1 Korea
GS1 Germany
GS1 Mexico
GS1 Netherlands
2020
GS1 New Zealand
GS1 Poland
GS1 Russia
GS1 South Africa
GS1 Spain
GS1 Sweden
GS1 UK
GS1 US
•
•
•
•
GS1 Data Quality Framework 3.0 (DQMS, Self Assessment, KPIs, Product Inspection Procedures)
Implementation Guide for Data Quality Framework (how-to)
GDSN & DQ MO Tool Kit (MO best practices)
GS1 Inventory of Data Quality Program Report (MO survey & Key Takeaways)
•
•
GDSN GTIN Allocation and Packaging Rules
3rd Party DQ Solution Providers
DQF 1.0
DQF 2.0
© 2013 GS1
3
Data Quality Framework 3.0
Adaptable and Customizable Framework

Data Quality Management System
- Organization Capabilities
Plan
- Standards and Policies
Document
Execute
- Business Processes
Monitor
- System Capabilities

Self Assessment Questionnaire

Scoring Model

KPI’s and Product Inspection Procedures

Information for Product Inspectors
- Sampling
- Pre-Inspection documentation requirements
- Inspection Report requirements
- Guidelines of KPIs targets for the industry
- Master Data Quality KPIs
- List of GSDN attributes for product inspections
© 2013 GS1
Implementation Guide for the Data Quality Framework 3.0
Companion guide for the Data Quality Framework
1.
2.
3.
4.
Essential Steps for the Implementation of a Data
Quality Management System
How to Conduct a Self-Assessment
Product Inspections and Data Accuracy KPIs
Ongoing Data Maintenance
3M
AAFES
ConAgra Foods
Helen of Troy
METRO Group
Nestle
PepsiCo
Procter & Gamble
Royal Ahold
SCA
The J.M. Smucker
Unilever
Wegmans Foods
© 2013 GS1
GS1 Australia
GS1 Columbia
GS1 Global Office
GS1 India
GS1 Italy
GS1 Korea
GS1 Germany
GS1 Mexico
GS1 Netherlands
GS1 South Africa
GS1 Sweden
GS1 UK
Implementation Guide for the Data Quality Framework
© 2013 GS1
Implementation Guide for the Data Quality Framework
© 2013 GS1
Implementation Guide for the Data Quality Framework
© 2013 GS1
GDSN & DQ MO Tool Kit
Recommendation of Implementing Best Practices
Step 1:
Engage the Community
Step 2:
Develop the Business Case
Step 3:
Ensure MDM program is in Place
Step 4:
Show how to solve the Business Problem
Step 5:
Enable Customers internal Systems for
Compliance
Step 6:
Measure Market Participation and
Develop Extended Strategy
© 2013 GS1
GS1 MO Inventory of Data Quality Programs (Survey)
Category 1:
Training & Education
Category 2:
Data Quality Awareness & Communication
Category 3:
Community Management
Category 4:
1.
2.
3.
4.
5.
6.
7.
8.
Executive Overview
Grounding for Data Quality
GS1 MO Inventory of DQ Programmes – Structure
GS1 MO Inventory of DQ Programmes – Results
Data Quality Framework
GS1 MO Inventory of DQ Programmes – Key Takeaways
Survey Recommendations
GS1 MO Inventory
Product Inspections
Category 5:
Validations & Integrity Checks
Category 6:
Accreditation & Authentication
Category 7:
On-Boarding Tools
Category 8:
Consulting
© 2013 GS1
Started 2010
Published 2012
GS1 MO Inventory of Data Quality Programs (Survey)
Inventory of DQF Key-Takeaways (as of Feb 2012)
•
There are a substantial number of Data Quality tools & services in use today by MOs with an overall utilization rate of
59.8%
•
Data quality is expected by almost all participating MOs to grow in importance over the next three to five years.
•
MO service offerings show a strong correlation to local country market readiness, priority given to Data Quality, Data
Pool linkage and GDSN adoption levels. The greater the community engagement, the greater the programme
offering.
•
The categories with the highest level of programme offerings are Data Quality Awareness & Communication (87.0%),
Training & Education (69.6%) and Community Management (73.9%). This reflects MO commitment to ensuring their
communities are involved and informed.
•
There is strong MO support of the Data Qualify Framework (DQF) concepts as shown by the high levels of service
offerings for Data Quality Self-assessments, Physical Audits and Audits Scorecards. However, 18% of the surveyed
MOs still recommended that GS1 GO increase communications and training tools for Data Quality.
•
In general, MOs promote the Data Quality Management System (DQMS) component of DQF but leave the
consulting/implementation of technical "back end system" infrastructures to the to the plethora of 3rd Party Solution
Partners that offer Master Data Management (MDM) related solutions.
•
The focus of Data Quality needs to shift from basic DQ elements ("Awareness, "Training & Education", "Community
Management") to driving better Data Quality Management System (DQMS) processes by Data Owners to make
true progress. This is the nucleus of DQ problems.
•
Local Data Quality Programmes serve local needs with virtually no interoperability between MO programmes. 36% of
the MOs expressed GS1 GO help to facilitate knowledge exchange between MOs.
© 2013 GS1
GS1 MO Inventory of Data Quality Programs (Survey)
Inventory of DQF Key-Takeaways (Continued)
•
There is no standard way to analyse and compare Data Quality because it is measured differently across GS1
MOs as well as Member Companies. It was recommended by 14% of the MOs that GS1 GO help the
community develop standardized KPI's for Data Quality so progress can be measured consistently.
•
Growth of GDS in existing and/or to new sectors was stated as an objective by 56.5% of the surveyed MOs. Many
MOs seeking to increase GDS adoption will continue this emphasis and will shift resources/focus to Data Quality
only after GDS usage stabilizes.
•
The community needs to understand the importance of implementing GDS and Data Quality services
simultaneously
•
43% of the surveyed MOs reflect Data Validation checks for local country requirements. An exploratory of
these localize validations may reveal synergies between the MOs, creating an opportunity to globalize the
requirements though the GDSN. It is assumed that MOs not offering or reflecting Validation & Integrity Checks do
not have local country validations and they rely on Data Pools to enforce the GDSN global validation
requirements.
•
B2C Interest and B2C Involvement are sighted by 39.1% of the surveyed MOs as priorities. MOs expressing
only B2C interest recognized the importance of B2C but will remain neutral on programme or service
offerings for the next few years. These MOs also say they will actively follow Industry developments. Many MOs
state they will align themselves to be heavily involved in B2C developments in order to prepare for the future. A
few GS1 MOs say programmes or services are already being established or planned to support B2C.
© 2013 GS1
3Rd Party DQ Solution Providers
© 2013 GS1
3Rd Party DQ Solution Providers
© 2013 GS1
KPI Attributes based on Business Context
Core KPI
Attributes
Weights
Measure
s
Completeness and Accuracy
© 2013 GS1
• Purchasing
• New Product Introductions
• Store Operations
• Replenishment
• Transportation & Logistics
• Warehouse and DC management
• Inventory & Distribution
• Plan-o-graming
• POS
• Consumer Information (B2C)
• Product Recall
• Invoicing
• Advertising
• Trade Promotion Management
• Routing
• Returns & Redemption & Claims
• eCommerse (catalog)
• ASN
• Track and Trace
• Demand Forecasting
• Item Master Alignment
• Payment
• Price and promotion
• Sales tax handling and submission
GS1 Data Quality Foundation – 2013
Category 1:
Category 5:
Training & Education
Validations & Integrity Checks
Category 2:
Category 6:
Data Quality Awareness & Communication
Accreditation & Authentication
Category 3:
Category 7:
Community Management
On-Boarding Tools
Category 4:
Category 8:
Product Inspections
Consulting
2020
2014
2013
2011
2010
2010
2010
2012
201
0
Simplified DQF Light
*B2C Attributes
New DQ KPI’s
Inventory of MO DQ Programs
3rd Party DQ Solution Providers
Data Crunch Reports
MO DQ Tool Kit
DQF 1.0
DQF 2.0
© 2013 GS1
DQF 3.0
Implementation Guide DQF
Started Inventory of DQ Programs
16
Anti-Trust Caution
GS1 and the GSMP operate under the GS1 anti-trust caution. Strict
compliance with anti-trust laws is and always has been the policy of GS1.
The best way to avoid problems is to remember that the purpose of the
committee is to enhance the ability of all industry members to compete more
efficiently.
This means:
• There shall be no discussion of prices, allocation of customers, or
products, etc.
• If any participant believes the group is drifting towards an impermissible
discussion, the topic shall be tabled until the opinion of counsel can be
obtained.
• The full anti-trust caution is available in the Community Room if you
would like to read it in its entirety.
© 2013 GS1
17
GS1 Netherlands
Sjoerd Schaper - Manager, GS1 DataPool
Status GS1 DAS data pool
• > 900 suppliers
• 14 retailers
• 450.000 GTIN’s registered for the Dutch market
• GS1 DAS is based on the former 1SYNC-datapool
•Current DQ program started in 2011
•Previous programs didn’t work
© 2013 GS1
What is a Deltaplan?
1 Feb 1953: huge flooding
© 2013 GS1
20
Data Quality
• Data quality in GS1 DAS was too low
• Retailers couldn’t rely on the data
• Usage was not on the expected level
• A Deltaplan Data Quality was needed!
© 2013 GS1
21
Program Data Quality
Strategy and role GS1
correct
&
secure
© 2013 GS1
services
awareness
communication
insight
monitor and report
22
GS1 DAS Data Quality Checker
The GS1 DAS Data Quality Checker:
- A tool for continuous monitoring of DQ (daily basis)
- Report of logical validations and physical
measurements
- Supplier gets a login to see his KPI’s and the errors
on record level
- Powered by Clavis Technology
© 2013 GS1
23
Dashboard Logical scores
© 2013 GS1
24
Dashboard Physical measurements
© 2013 GS1
25
Certification of new suppliers
New companies directly start using the DQ checker
Requirements before they go live:
• a 100% score on
• logical checks
• a sample of 5-20 items
© 2013 GS1
26
Physical measurements
• In 2012 more than 12.000 measurements at
Retailer Distribution Centers
• > 8000 consumer units
• > 4000 cases
• Outsourced to special company
• Results lower than logical checks (on average
75%)
• Switched dimensions
• Outside tolerances
• ......
© 2013 GS1
Proces Physical measurements
Supplier
A
B C
Retailer
X
Y
Assortment
GLN’s & GTIN’s
Z
Sample 1
10%
OK
satisfies
requirement
© 2013 GS1
NOK
Sample 2
10%
NOK Mandatory
measurement
of all items
OK
satisfies
requirement
28
Retailer involvement is essential
• Weekly KPI-sheet to retail contacts
• Retailer dashboard in DQ checker
• Retailers asked to take action for non-improving
suppliers
• Some are sending letters
• Some are giving fines to the supplier
• DQ must be part of the commercial negotiation
© 2013 GS1
The future
• Much improvement, but
• the goals for 2012 were not reached
• To be continued in 2013
• DQ is not a separate project or action but should
be part of the daily business
© 2013 GS1
30
GS1 UK
Robert Besford
About us
Our members
Sole traders, to SMEs to
multi-nationals
Over 27,000
members
From retail, food service, healthcare and
online industries
© 2013 GS1
Membership breakdown by turnover
64% of membership has an annual turnover of less than £1m
22/08/2012
© 2013 GS1
Our data quality services
© 2013 GS1
GS1 in the Supply Chain
PRODUCT FLOW
RETAILER RDC
FACTORY
WAREHOUSE
SUPPLIER
HEAD OFFICE
CONSOLIDATION
Right
First
Time
RETAILER
HEAD OFFICE
INFORMATION FLOW
© 2013 GS1
STORE
Professional service support
Example: GS1 UK Support Overview
MASTER DATA MANAGEMENT STRATEGY
STRATEGIC ALIGNMENT - BUSINESS VALUE ARTICULATION – ROI – BUSINESS CASE
Discovery
Implement
Rollout
Business
Understanding
Solution Options and
Definition
Implementation Support
• Business process analysis
• Business processes
definition and agreement (tobe)
• To-be data model
• Data governance strategy
• Process re-engineering and
optimisation
• Software selection process:
GDS data pool; MDM
solutions ;DQ solutions
(as-is) – issues, impacts and
root causes
• IT review and impact on
business
• Data model review
• Business case
• Data quality assessment
• MDM Roadmap
© 2013 GS1
• Set-up data pool
• Requirements
documentation : supplier
handbook
• Pilot management
• On-board suppliers
• Internal data management
controls and measures (KPI’s)
• Internal education
• Support with other solution
implementations : MDM and
DQ
Discovery : Business Case For Change
© 2013 GS1
Implement : Plan, Build and Adopt
© 2013 GS1
41
Member training services
•
•
•
•
•
•
•
•
•
•
•
GS1 Identification Keys
Identifying products, cases and pallets
correctly
The rules around when and why GTINs
(bar code numbers) need to change
Including extra information (dates, batch
numbers, etc.)
Coupons
Variable weight items
Bar Codes
The different bar code symbols and their
applications
Bar code size, colour and placement best
practice
Bar code quality and verification
•
•
•
•
•
•
•
•
•
•
•
Automated goods receipt
Pallet labels
SSCCs
Basics of EDI
Order to Cash process
Data Quality
The cost of bad data
Global Data Synchronisation
Package measurement rules – how to
measure products and cases correctly
Product description best practice
•
•
© 2013 GS1
42
Data monitoring services
Data audits
•
Understand the scale of the Data Quality issues and its
potential impact on the business
•
Provide insight so that the customer can begin to build
a plan to mitigate the key issues identified
•
We use a TrueSource (Data Pool) and third party data
quality tools to conduct the analysis
•
Typically brand owners data is compared to that held
by the retailer
© 2013 GS1
44
Data monitoring capabilities
• On-boarding projects
•
•
•
•
Visibility of progress of each supplier in setup of back-catalogue
Manage the timely loading of supplier back-catalogue
Ensure data meets all retailer requirements
Ensure high quality data in data pool
• Detection/prevention of low quality data in
the data pool
• Reporting on suspect/low quality data
• Supplier scoreboards, rankings and trends
• Monitor issues caused by changes to retailer requirements or
industry standards
• Apply data quality checks not possible in data pool / data capture
interface
© 2013 GS1
45
Monitor supplier progress in setup of
back catalogue
• Expected number of GTINs per supplier
• Number of GTINs started in TrueSource
• Number of GTINs meeting retailer requirements
© 2013 GS1
Provide Detailed Reports For Each Supplier
•List of GTINs
expected but not
started
•List of errors per
GTIN
•Summary of
errors per
category
© 2013 GS1
Food Service Validation Service
Example…
•196 Data Values per gtin reviewed
•Core Item
•Food & Beverage Extension
•83 Mandatory/Dependency rules
•57 Core attributes
•10 F&B attributes
•14 allergens
•7 Nutrients
•Standard GS1 Validity Tests for
attributes
•70+ Supplier Reports
© 2013 GS1
Solutions for individual suppliers &
Retailers
• Suppliers
• Monitor data against multiple retailer requirements
• Custom reports (by brand, GLN, product category)
• Check for “suspect data”
• Retailers
• Monitor back-catalogue status
• Monitor ongoing data quality across all suppliers
© 2013 GS1
Onsite physical inspections
– GS1 UK Product Inspector App
•
Product Inspector is a native, stand-alone
application that operates in both a networked and
offline environment.
•
The App has an embedded file management and
communications system that allows the user to
import product inspection sets in a variety of
formats, including Microsoft Excel, from either a
server or as email attachments.
•
This data can then be consumed by a Product
Information Management (PIM) system or Business
Intelligence (BI) System to initiate workflow
activities or generate GS1 Compliant Data Quality
reports following the principals defined in the GS1
Data Quality Framework.
© 2013 GS1
50
GS1 Mexico
Carlos Ramos Aguilar
Background on DS
• 1999 - First Data Sinchronisation (DS) iniciative
•
Cat@logalo data pool, owned and developed by GS1 Mexico
• 2002 – First massive adoption effort
• 2005 – Creation & adoption of the Measurement Service
(inspection) in Mexico, fully integrated with the local data
synchronization process
• 2006-2007 a new strategy needed, in-depth study of DS activity and
expectatives from the whole Industry, regarding the interest of
adopting a global model of GDS
• 2008 – launch of GS1 Mexico DP (Syncfonia)
© 2013 GS1
2008-2011,
implementation strategy
• 8 major retailers on-board
• Comercial Mexicana, Chedraui,
Corvi (Wholesaler), Diconsa, HEB,
Soriana, Super Kompras, WalMart
• +75% of the retail market
• Initial categories
• Grocery (food & non-food)
• Health and beauty
• Beverages
• Initial focus
• New item process
© 2013 GS1
Our Services
Data Validation
Data & Photo
Capture
Membership
Data Quality
Framework
© 2013 GS1
Training +
Knowledge Center
DATA VALIDATION
The verification is done on 22 fields.
The main rejections are in:
Variant
Gross Weight
Functional Name
Width
Depth
Height
Net Content
Others
22%
17%
12%
11%
10%
7%
7%
14%
The 60% of the products tested,
do not pass at the first validation
© 2013 GS1
DATA & PHOTO CAPTURE
Over 1,285 companies have selected GS1 Mexico service, to
capture more than 155,500 items
© 2013 GS1
56
TRAINING
Data Quality Training Program: a 4 modules
4hrs training program where companies from all
sizes are able to learn & experience about GS1
Data Quality Standards (GDSN, GS1 ID, GS1
Measurement
Rules),
getting
ready
for
synchronizing master data through GDSN.
© 2013 GS1
57
DATA QUALITY FRAMEWORK

Data Quality Framework (compliance):
based on large companies needs, this
service is composed by a whole training
program and allows companies to show
compliance
against
Data
Quality
Framework, by providing with a self
assessment report (up to 80% of the
score). GS1 Mexico, defines a sample
(taking into account the whole amount of
items from that company). If the whole
inspection goes all right, there´s a report
provided to the company that enables
them to prove consistency within their
processes, if not they are expected to go
for Measurement Service Inspection item
per item.
© 2013 GS1
58
SERVICES FOR RETAILERS
Professional Services
• Project Management Leader
• Internal development support
connectivity between catalogs
• Support in supplier integration
• Advice to businesses
for
Data capture at Store and Distribution
Center
• Measurement Service
• Data Capture
• Photo Capture
Education and Training
• Training the team on concepts Bar
Code and Rules of Measurement
• Training companies in the Data Quality
Model
© 2013 GS1
NUMBERS
2011 (Groceries, Beverages,
Health & Beauty)
•
2,640 Suppliers
• 232,490 GTIN’s
•
53% Data Quality
•
4,361 products with photo
2012 (Hardware, Toys, Apparel,
Pharmacy, Electronics)
•
3,245 Suppliers
• 317,468 GTIN’s
•
66% Data Quality
• 32,897 products with photo
© 2013 GS1
BARRIERS AND LEARNINGS
The companies have
separated processes
in generating product
data.
In the information input
process should be a
model that ensures
data quality.
Data quality is affected
by the way data is
entered, stored and
managed.
Data quality is not
one-time effort, it
requires frequent
maintenance.
The systems do not
guarantee the
accuracy of the data.
The information is
basic to improve in
business, operational,
logistical and financial
processes.
Data quality minimizes
errors, reduces risk
and add a value in
time along the supply
chain.
© 2013 GS1
“Confidence and efficiency in the exchange of information with trading
partners”
•CERVECERIA CUAUTHEMOC MOCTEZUMA
“Processes are simplified because the information is stored in a
centralized repository, where data are taken for other processes or
business documents”
•WAL-MART MEXICO Y CENTROAMERICA
“The information is in the same language (standards) and allows easy
distribution and understanding”
•KRAFT FOODS / MONDELEZ INTERNATIONAL
“Quick cataloging process. Only with entering a barcode can be
extracted product information at different levels”
•CHEDRAUI
© 2013 GS1
NEXT STEPS 2013-2015
1) New categories
2) New retailers & wholesalers
3) New attributtes (nutritional,
additional file information, etc)
4) Image pool (under analysis)
5) New process
© 2013 GS1