Operational Insight for MDM

Operational Insight for
MDM
Introducing the MDM Hub Analyzer
Presented By:
Jeff Klagenberg
VP, Products & Solutions; GlobalSoft.
Hosted By:
Webinar Agenda
Introduction to GlobalSoft
Challenges for Operational Reporting for MDM
Overview of Key Metrics
Hub Analyzer Introduction and Demo
Q&A
2
© 2012 GlobalSoft - Proprietary and Confidential
About GlobalSoft
Vendor-focused
! 
! 
! 
! 
!  Integration & data
management
15+ years
5+ years with Siperian
MDM …. and more
Architects & Product Spec.
Training partner
Solutions Program
!  Product & Service Offerings
!  Complementary to vendor
products
Range of Services
!  Project delivery
!  Training (development &
delivery)
!  Engineering
!  Support
Informatica Partner
Locations
!  San Jose
!  London
!  Bangalore
3
© 2012 GlobalSoft - Proprietary and Confidential
Operational MDM
MDM Hub is an Essential Operational Repository
!  Connecting many data sources
!  A repository for critical business applications
!  Integrated with data warehouses
!  Any data or performance issues affect many systems
!  Issues detected system wide
•  Cause could be in integrated systems or in the hub
MDM has a Distributed / 3 Tier Architecture
!  Performance characteristics can be affected by any tier
!  Tier issues could be software or hardware related
4
© 2012 GlobalSoft - Proprietary and Confidential
Typical MDM Deployments
Underlying Infrastructure
Application
Server(s)
Database
Server(s)
Storage
Client Desktops
6
© 2012 GlobalSoft - Proprietary and Confidential
Typical MDM Deployments
MDM Software
Real-Time APIs
Security
Enforcement
Data Matching
Data Cleansing
Application
Applic
Server(s)
Batch Data Processing
Data Merging
History Retention
Database
Server(s)
Storage
Client Desktops
Data Stewardship
7
© 2012 GlobalSoft - Proprietary and Confidential
Typical MDM Deployments
Complete System
Data sources
MDM Hub
``
Fully integrated
Applications
End Users
Data
Warehouses
8
© 2012 GlobalSoft - Proprietary and Confidential
Typical MDM Deployments
Issues
ssues Can Occur Anywhere in the System
Data sources
MDM Hub
```
Data
Warehouses
9
© 2012 GlobalSoft - Proprietary and Confidential
Fully integrated
Applications
End Users
Operational MDM – Needed Insight
Need to Monitor and Understand the State of the Hub
! 
! 
! 
! 
Is the data throughput high enough?
Are SLAs being met?
How effective are the match rules?
Is data growing within planned capacity?
Quickly Isolate Hub versus System Wide Issues
And If there are Issues, Where Should Analysis Focus
! 
! 
! 
! 
Isolate quickly to appropriate layer
How does system IO look?
What specific process are effected?
Which match rules are most productive?
10
© 2012 GlobalSoft - Proprietary and Confidential
Understanding Some Key Metrics
Throughput
!  The volume of data passed per unit time by key MDM
processes
!  Key measurement for data movement and transformation
!  Need baseline measurements to detect changes
Match Productivity
!  Number of matches detected by a rule
!  Number of matches ending in a merge (unless un merged
later)
Clock Time vs. Processing Time (for SLAs)
!  Clock time refers to time of workday needed to complete a
task
!  Processing varies depending on number of processors /
threads
!  Service levels typically measured in Clock Time
11
© 2012 GlobalSoft - Proprietary and Confidential
Hub Analyzer Intro
Issues are detected within the overall system
Hub Analyzer gives ability to isolate issues
Presents KPIs grouped in dashboard formats
Stand alone web app or as IDD tab
12
© 2012 GlobalSoft - Proprietary and Confidential
Operational Insight key areas
Managing a Hub Environment Requires Key Insights
!  Understand throughput over time
•  Isolate bottlenecks if / where they exist
!  See if system is keeping within SLAs
•  Understand on average how system is doing
•  See if there are day of week issues
!  Understand match productivity
•  See if there are reasons to review / update match rules
•  Determine if auto / manual rule settings should be changed
!  See system growth over time
•  Predict when system should be allocated more capacity
13
© 2012 GlobalSoft - Proprietary and Confidential
Hub Analyzer Architecture
Hub Analyzer
Hub
Store /
ORSs
DB Server
Data Aggregators
Data
Collectors
Scheduler
Data Visualization
Security
Data
Retention
Policy
MDM Hub Server
Analyzer IDD Console
Analyzer Web Console
Analyzer Store
• Fact Tables
• Aggregate Tables
14
© 2012 GlobalSoft - Proprietary and Confidential
Deployment Options
Shared Server
• 
Fewer servers
Application Server
MDM Server
Separate Server
• 
• 
Increased availability
Lower load
Application Server 1
Application Server 2
Analyzer
Server
MDM Server
Analyzer
Server
Database Server
Database Server
ORS Schemas
ORS Schemas
Analyzer Schema
Analyzer Schema
15
© 2012 GlobalSoft - Proprietary and Confidential
Throughput Dashboard
Quickly see if slow throughput is an issue and if so determine which operations are
affected. This dashboard also includes graphs of key system IO metrics to see if
throughput is isolated to MDM functions or related to system wide issue.
Included KPIs
Records Loaded per second
Matches per second
Database IO
Records Cleansed per second
Merges per second
File system IO
Records Tokenized per second
Slowest Jobs by job type
Average rate Load & Merge
16
© 2012 GlobalSoft - Proprietary and Confidential
SLA Dashboard
Determine if hub processing has exceeded windows. Shows average processing
time per each day of the week to quickly determine if there is a dependency on a
specific process. Processing times are shown by each operation type allowing the
operations team to quickly focus on the area of most benefit.
Included KPIs
Daily System Usage
Processing Time by Day of Week
17
© 2012 GlobalSoft - Proprietary and Confidential
Long Running Jobs
Match and Data Quality Dashboard
Understanding the productiveness and success of data matching is very valuable to
ongoing MDM Hub operations. This dashboard will allow operators to see which
match rules to modify, potentially drop or change their auto / manual merge status.
Included KPIs
Match count per match rule
Unmerge count per match rule
Manual matches merged count
Validated Address Count
18
© 2012 GlobalSoft - Proprietary and Confidential
Rejected Record Count
Data Capacity Dashboard
During the lifetime of the hub projecting data growth is essential to keeping the
system sized correctly. This dashboard shows how the system is growing and gives
provides insight about any unanticipated changes in growth, which can be further
reviewed.
Included KPIs
Consolidated Object count by object and state
History Record Count
Cross Reference count by object and state
Table space Used over time
19
© 2012 GlobalSoft - Proprietary and Confidential
Possible Analyzer Customization Options
As a service offering other capabilities that can be added
!  Business services data collection and reporting
!  Monitoring system integration
•  Custom JMX / SNMP traps
!  Other Custom data collection
•  Include stats from data cleansing
•  Include stats from data transport
!  Custom KPIs
•  Add KPIs from existing data
20
© 2012 GlobalSoft - Proprietary and Confidential
MDM Hub Analyzer Demo
21
© 2012 GlobalSoft - Proprietary and Confidential
Availability
Inquire about beta / trial availability
•  [email protected]
Product GA – April / May 2012
22
© 2012 GlobalSoft - Proprietary and Confidential
Find us on Informatica Marketplace
Informatica Marketplace
!  500 Apps.
!  15,000 monthly visitors.
!  2,000 downloads every month.
Have you been to the Informatica Marketplace yet?
With everything you need to augment, extend, and enhance your
Informatica investment, the Marketplace is your one-stop shop for
innovative solutions that improve productivity, speed time to
implementation, and lower total cost of ownership.
Visit www.marketplace.informatica.com and get started today!
For more details, write to [email protected]
23
© 2012 GlobalSoft - Proprietary and Confidential
GlobalSoft Solutions
GlobalSoft Enterprise Apps
!  Plugin Products extending Informatica Products
!  Data Augmentation Adapters – Available Today
• 
Add third party data into the MDM Hub
!  MDM Hub Analyzer – Available April
• 
Give MDM customers insight into Hub Operations
!  MDM Business Services Manager – Available TBD
• 
Quickly deploy and maintain course grained services for the SIF
GlobalSoft Services
!  Independent MDM Performance Assessment
• 
When a neutral party is desired to assess MDM performance
24
© 2012 GlobalSoft - Proprietary and Confidential
GlobalSoft - Data Enrichment Adapters
Native interface into MDM Cleanse Mapping
!  Bring data in from 3rd party web service into the MDM Hub
!  Support WSDL of REST based web services
!  Allows the creation of associated IDD tasks
!  Appropriate for real-time or daily batch processing
!  Customer live on D&B adapter
Future Development Plans
!  Extending to Informatica Platform
25
© 2012 GlobalSoft - Proprietary and Confidential
Q&A
Contact details
!  Speaker
•  [email protected]
!  GlobalSoft, Inc.
•  [email protected]
Solution / product inquiries
•  [email protected]
26
© 2012 GlobalSoft - Proprietary and Confidential