Journey to a Centralized Hub: Customer Cases Studies

MIT CDO IQ Symposium 2016July 13, 2016

Agenda

› Case Study 1: City Government MDM implementation

› Case Study 2: Passenger Airline RDM implementation

› Q&A

Case StudyCITY GOVERNMET

CITY | Project Highlights

Primary drivers:

› Data Sharing hub to serve all of the City’s systems and departments (Transactional MDM shared entities – Party and Location – ensuring consistency and completeness)

› Tax / Revenue collection and Business register are the main beneficiaries

Resulting in:

› Single view of legal entities (both companies and entrepreneurs)

› SOA architecture via standard set of online services providing master data

Solution live since 2013, currently being upgraded to make use of the new Matching algorithms and stewardship interface for visual hierarchy browsing editing the Master data entities.

Customer MDM and DQ

Operational / Consolidation style

Manual EditingVisual Hierarchy browsing

Online Integration / SOA

Identity Management Access Control

CITY | Project Challenges

Application/function/business logic duplication

Data duplication

Lack of formal data governance

Ineffective Data Sharing

Distributed IT governance

Complicated service structure

Corporate applications

Complex organization

Data

Organizational

ManualRemediation

Interface

CITY | High-Level Architecture

Inte

grat

ion

Laye

r (E

SB)

Tax / Revenue System

City Business Register Data Sharing Hub

[MDC]

Federal Business Register

MDM Interface

EXTERNAL SYSTEMS

MDM IDE

MDM Stewardship Interface

Manual Resolution Interface

› Manage and resolve DQ exceptions

› Cleansing

› Match & Merge

› Drill-down to source level

› Complete workflow for data stewards

› DQ Firewall to prevent new errors

› Progress reports for managers

CITY | Solution Benefits

Compatibility with legacy systems

Central data model

Easy management of MDM repository

Automatic cleansing and consolidation

Scalability

Application integrations

Manual issue resolution

Service-oriented architecture

Case StudyPASSENGER AIRLINE

AIRLINE | Project Highlights

Primary drivers:

› The EDW’s mission is to provide integrated business information

› Reference Data Management is identified as critical factor to the EDW’s success

› Simplify Code Maintenance support to alleviate load on EDW cycle

› Improve Business buy-in by allowing direct interaction with the solution

Resulting in:

› Single consolidated hub for enterprise reference data.

› Reduced IT costs

› Faster response to changes and additions to reference data

Solution live since 2014, currently being upgraded to make use of Online Web-services. In production with over 40 entities.

Centralized Reference Data Repository

Back Propagation to Original Source Systems

Data Governance Centric Implementation

Built-in Data Quality

Identity Management Access Control

Challenges of User Managed Reference Data

› Manually maintained reference data drive company analytics

› Lack of standard change management process

› Business rules/validations are not supported, leading to faulty published data

› No audit trail, review or approval

› Sometimes ownership is not clear

Challenges of User Managed Reference Data

› Difficult to automate› Difficult for systems to access/consume› Difficult to implement a security policy› Not all systems are consistently informed of the latest changes, resulting in discrepancies

› Stored in multiple places› Leads to duplication› Introduces inconsistency› Difficult to manage reference data at the enterprise level› No process for agreeing on changes to reference data across the enterprise

AIRLINE | High-Level Architecture

RDM DatabaseReference Master Data

EXTERNAL SYSTEMSProviders

EXTERNAL SYSTEMSConsumers

Exportscsv, txt, xls

IMPORT

PUBLISH

RDM Users

RDM Admin

Inte

grat

ion

Laye

r (E

SB)

LDAP / Active Directory

SMTP Server

RDM Metadata

External Sourcescsv, txt, xls

RDM Application ServerRDM Engine + Web Application

Flight Range Reference Data Before

› Data Steward manually maintained flight range data via spreadsheet

› Not formally versioned

› Distributed via email

› Everyone ended up with their own copy

› Did not handle merger

Flight Range Reference Data Now

› Easy to see who is maintaining the data

› Unpublished records easily identified

› Invalid records are easy to spot

Flight Range Reference Data Now

› Instant validation› Pick list support

AIRLINE | Today and Beyond

In Production with over 40 entities

› Flight Range Codes

› Flight Delays Codes

› Seating Charts

› Cargo

› Flight Crew

› Operations Planning

› Operations Research

› Revenue Management

› Sales

› Tech Ops

Current Development

› Customer Planning

› Merchandising

Future Product Feature Adoptions

› Web Services

› Operational Support Automation

AIRLINE | Features & Benefits

Data Governance

› Standard maintenance process and workflow

› Support auditing and data ‘versioning’

› Improved data quality (business rules enforced before the data is published)

UI Designed with Data Steward in Mind

› Allows the business to directly manage their data!

› Role-based UIs for review, approval, and publishing of changes

The Business and IT are Both Happy!

› Reduced IT costs

› Faster response to changes and additions to reference data

Ataccama Integrated Platform

ATACCAMA INTEGRATED PLATFORM

DATA MANAGEMENT| Engines

Big Data Engine (BDE)

DATA GOVERNANCE PORTAL| Web Applications

AdministrationWeb Console

SHARED PLATFORM COMPONENTS

Common Metadata Layer

Metadata Editor

Batch Interfaces

Online Interfaces

Adapters

Workflow

HighAvailability

Master Data Center (MDC)

Data Quality Center (DQC)

DQ Analyzer (DQA)

DQ Issue Tracker(DQIT)

DQ Dashboard(DQD)

Reference Data Manager (RDM)

Master Data Admin (MDA)

CITY GOVERNMENT PRODUCT STACK

DATA MANAGEMENT| Engines

Big Data Engine (BDE)

DATA GOVERNANCE PORTAL| Web Applications

AdministrationWeb Console

SHARED PLATFORM COMPONENTS

Common Metadata Layer

Metadata Editor

Batch Interfaces

Online Interfaces

Adapters

Workflow

HighAvailability

Master Data Center (MDC)

Data Quality Center (DQC)

DQ Analyzer (DQA)

DQ Issue Tracker(DQIT)

DQ Dashboard(DQD)

Reference Data Manager (RDM)

Master Data Admin (MDA)

AIRLINE PRODUCT STACK

DATA MANAGEMENT| Engines

Big Data Engine (BDE)

DATA GOVERNANCE PORTAL| Web Applications

AdministrationWeb Console

SHARED PLATFORM COMPONENTS

Common Metadata Layer

Metadata Editor

Batch Interfaces

Online Interfaces

Adapters

Workflow

HighAvailability

Master Data Center (MDC)

Data Quality Center (DQC)

DQ Analyzer (DQA)

DQ Issue Tracker(DQIT)

DQ Dashboard(DQD)

Reference Data Manager (RDM)

Master Data Admin (MDA)

Key Differentiators

Key Differentiators

Business Centric UI

Truly Integrated Platform

Reusable Components

EASE OF DEPLOYMENT

Data Model Driven

Key Differentiators

Service Oriented Architecture

Performance “White Box” Approach

STRONG TECHNOLOGY

Easy Installation and Maintenance