EDW Webinar: Designing Master Data Services for Application Integration
15
Designing Master Data Services for Application Integration David Loshin Knowledge Integrity, Inc. www.knowledge-integrity.com 1 © 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com (301)754-6350
-
Upload
dataversity -
Category
Technology
-
view
588 -
download
4
description
Although in general the presumption of “MDM success” is predicted on the population of a master repository, the real challenge lies in establishing the ways that the master data asset can be integrated and used across the enterprise. For any master data environment to be a true success, once real customers have been identified you must provide an integration strategy for using MDM to meet specific application needs. In many cases, though, even if a business area wanted to use the system, the application layer for providing access and utilization of the master data asset is poorly-defined and implemented, often requiring a design and development effort from scratch. The perceived delay in accessibility then discourages the potential consumer, who will defer using the MDM system and instead select a different alternative. In this webinar, I will discuss how anticipating typical master data usage scenarios and understanding how to enable ways of interfacing with the master repository, you can devise and design the components of a solution architecture template to be used as the starting point for master data integration.
Transcript of EDW Webinar: Designing Master Data Services for Application Integration
Designing Master Data Services forApplication Integration
David Loshin
Knowledge Integrity, Inc.
www.knowledge-integrity.com
1© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
Consolidation: The Typical Approach to MDM
Motivating factors have largely focused on consolidation of data into a single repository rather than how shared master data is to be used
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
2
Finance
Sales
Marketing
Financial
Data
Sales
Data
Marketing
Data
Customer
Service
Customer
Data
H/R
Data
Legal
Data
Fulfillment
Data
Human
Resources
Legal
Fulfillment
CentralizedRepository ?
Why Consolidation Should Not Drive MDM Integration
Master Data Consolidation
“YADS”
Missing User Input
No Migration Plan
Loss of Knowledge
Loss of Meaning
Organizational Misalignment
No Process Governance
Cloud Issues
Shadow IT
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
3
Master Data
Migration Strategy for Sharing Master Data
As the master registry/hub are brought online, there must be plans for migrating functional applications to the MDM environment to benefit
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
4
Finance
Financial
Data
Sales
Sales
Data
Marketing
Marketing
Data
Service
Service
Data
H/R
H/R
Data
Transactions
Transaction
Data
Compliance
Compliance
Data
Consider Typical Master Data Use Cases
Presumes the existence of a master data repository, index, and identity resolution capability
Support for operational and analytical activities, such as:
Managed assignment of unique identifiers
Search and retrieve unified views of entity information
Managing relationships
Managing identifier cross-reference
Satisfy data management and governance policies, such as:
Batch matching services
Duplicate analysis and elimination
Data standardization/cleansing
Enable Queries, Reporting, Analysis
Direct queries
JOINs against other resources
Feeding analytics applications
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
5
Master Data Services Stack
Entity Indexes
Entity Repositories Entity Relationships
Data Management
Search Retrieve Update DeactivateCreate
Relationship Management
Find Relate Break
Governance
Merge Split
Identity Services
Generate EIDs ID X-Ref
6
Matching/Identity Resolution
EnrichmentReconcile Identities
Standardize/Cleanse
Bulk/BatchBulk Cross-Reference
Bulk Match/Resol
ution
Bulk Update
Search/Retrieve Entity
Assign EID
Relationship Management
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
Data Access
Master Entity Repositories
Instantiated repositories
Profiles
Relationships
Index
Consider typical data interactions supporting enterprise use of master data:
Ingestion
Profiling
Probabilistic matching
Internal master data services for management of repository
Entity Indexes
Entity Repositories Entity Relationships
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
7
Data Access
Enable access to shared master data transparently to service layers
Direct access to physical data repository
Virtualized/federated access to conceptual master repository
Query access
SELECTs
JOINs
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
8
Data Access
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
9
Matching/Identity Resolution Algorithms for probabilistic matching
Data management Identity search (probabilistic search, key-based search, similarity scoring) Register/create a new master entity record Access master entity record Update master entity record Deactivate a master entity record
Identity Services Guarantee the generation of unique identifiers Manage cross-reference of internal and external identifiers
Core Services
Data Management
Search Retrieve Update DeactivateCreate
Relationship Management
Find Relate Break
Governance
Merge Split
Identity Services
Generate EIDs ID X-Ref
Matching/Identity Resolution
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
10
Relationship management
Find all relationships associated with an entity
Relate two or more entities and associate nature of relationship
Break/deactivate a relationship
Governance
Merge two records when they can be determined to represent the same entity
Split a record into multiple records when it can be determined that there is a false positive
Core Services
Data Management
Search Retrieve Update DeactivateCreate
Relationship Management
Find Relate Break
Governance
Merge Split
Identity Services
Generate EIDs ID X-Ref
Matching/Identity Resolution
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
11
Search/Retrieve Entity Invokes core search, retrieve, or create
Assign EID Provide unique entity identifiers
Enrichment Data standardization Alignment of otherwise-assigned identifiers for cross-referencing Cleansing
Batch Services Deliver result set of master records matching a provided set of candidate identities Apply batch updates Batch identity resolution
Relationship Management Find all relationships associated with an entity Relate two or more entities and associate nature of relationship (e.g. household) Break/deactivate a relationship
Application Services
EnrichmentReconcile Identities
Standardize/Cleanse
Bulk/Batch
Bulk Cross-Reference
Bulk Match/Resol
ution
Bulk Update
Search/Retrieve Entity
Assign EID
Relationship Management
Delivering a Unified View Based on Consumer Rules
The master index maps the canonical representation of a specific entity (beneficiary, providers, etc.) to the locations in the original sources (or replicas of those source) holding data instances that have been linked via the identity resolution processes
The accessibility of the different sources and the ability to apply those business rules at the data user’s discretion will provide a consolidated view that best meets the data users’ requirements at the time the data is reused
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
12
Virtualized presentation of federated data
Data Source 1
Data Source 2
Master DataIndex
Data Source N
…
Collection & Assembly
Master Data Facilitated via Federation/Virtualization
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
13
Federated/VirtualizedData Access
Master IndexTransform and Map
Master Data Services
Standardized Canonical Relational Views
Parse and Standardize, Normalize, Cleanse
1
2
3
4
5 7
8
Summary
Review the business process to understand uses of shared master data
Identify integration points within business processes
Characterize usage scenarios
Determine required functionality
Assess existing systemic support for required functionality
Design application integration service APIs
Design and implement application integration services
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
14
Questions and Open Discussion
www.knowledge-integrity.com
If you have questions, comments, or suggestions, please contact me
David Loshin
301-754-6350
© 2014 Knowledge Integrity, Inc. www.knowledge-integrity.com
(301)754-6350
15
www.dataqualitybook.com
www.mdmbook.com
![[Webinar] 5 Steps to Designing Psychologically Powerful Landing Pages](https://static.fdocuments.us/doc/165x107/55a755591a28abb15d8b4705/webinar-5-steps-to-designing-psychologically-powerful-landing-pages.jpg)
