Collibra ServicesMay 2019

Advisory Services

Pilots & POCs

Implementation

Integration &Automation

Migration Services

• Use case identification• Identifying best fit

implementation option• Current State Assessment• Implementation Roadmap

• Collibra platform capabilities• Integration Trials using Lucid’s

subscriptions on Docker Containers

• Collibra Marketplace accelerators

• Fit-Gap Analysis

• Environment setup /verification• Operating / Asset model customization• Platform Customization• Custom workflows• User Training & Rollout Assistance• Configure Marketplace accelerators

• Integrations as Subscriptions [Marketplace Certified]

• Custom Integrations• E2E Process Automation with

custom workflows & integrations

• Assessment, sizing and planning • Migrate Operating Model and

Content• Post Migration Verification• “Enhance & migrate” as opposed

to “lift and shift”

Our Collibra Service Offerings

Who we are …..

• Wide range of Collibra Implementation experience • Fortune 10 Enterprises to Charter Schools • Manufacturing, Financial Services, Healthcare, Oil & Gas, Education, ….• Diverse engagements : 3 week PoCs, 8 – 10 week prototypes, migrations, complex use-cases over 3 months

• Most implementations complex • 100% with custom workflows • > 85% with Connect based integrations

• ~ 30 different metadata source systems across Analytics/BI, ETL, Data Modeling and DQ• Custom Applications as metadata sources• Data from Custom Applications used as part of bespoke end to end integrations

• Learnings from each engagement add to the collective practical experience of our core team and has been distilled into standard practices, reusable design patterns, code components

• Working closely with Collibra Product Management, CoE and pre-sales teams helps us validate/refine our approach to what is best suited for the platform

• Working on early stage PoCs with Collibra pre-sales has given us a lot of unique client perspectives and asks, which have translated into solutions or conceptual prototypes

Our implementations are based on practical experience combined with a lot of brainstorming with clients to help develop a phased approach with incremental

value delivered in each iteration3

Technical expertise showcased by a strong partnership and IP

▪ Premier partner with deep skills in integration, end-to-end implementation capabilities using a global delivery model

▪ Easy Connections : A library of downloadable Integrations for Collibra delivered as subscriptions▪ Work closely with Collibra pre-sales teams on pilots and POCs▪ Work closely with product management teams and are involved in many Beta programs▪ Delivered Collibra Coaching Services as white-labeled services▪ Setup as a sub-contractor to Collibra Professional Services▪ Implementation partner for Collibra resellers in Singapore, South Africa and Latin America▪ Sub-contractor for Global Collibra partners : Accenture▪ Implementation partner for Collibra Strategy partners : First San Francisco Partners▪ Close relationships with Collibra Technology partners : Manta, Silwood

Maturing experience in Data Governance

2016

• Developed DataStage

to Collibra

integration for

Collibra CoE

• Showcased

bi-directional

integration with

Information

Analyzer @ DC’16

• Focus on building

skills and delivering

services for Collibra

Connect based

integrations

Collibra Partnership

signed

2017

• Setup to deliver

Collibra Migration

Services

• Multiple Collibra

implementations &

prototypes delivered

• Showcased Tableau,

SAP HANA and

Cognos integrations

@ DC’17 and released

them as subscriptions

• Implementation

partner for Collibra

Resellers in Asia and

South Africa

• Featured by IBM as 1

of 6 preferred

partners for

Governance

• Governance Solutions

listed on IBM Global

Solutions Directory

Integrations as

Subscriptions

2018

• Collibra Preferred

Partner

• Invited to present a

Lightning Talk at

Collibra’s first Under

the Hood Day

• Showcased Solution

Concepts for

leveraging Collibra as

a Platform @DC’18

• Integrations for INFA

PowerCenter, IGC as

subscriptions

• Ver 2.0 of

Subscriptions,

undergoing

Marketplace

Certification

• Collibra now resells

integration

subscriptions

Collibra as a Platform

2010-15

• Exposure to

Enterprise-scale

Information

management

implementations and

challenges

• IBM Partnership

• Delivered services and

developed solutions

around Data Quality

& MDM

• Gained a good

understanding of

Data Governance

drivers

• 2013 : Started

delivering services in

Data Governance on

the IBM platform

Information

Management focus

5

Proven Global Delivery Capabilities in every service that we offer

HAVE BUILT STRONG AND TRUSTED RELATIONSHIPS ACROSS PARTNERS AND CLIENTS

▪ Strong lead generation through referrals

▪ Two Fortune 10 clients

▪ One Fortune 50 client

▪ Supporting Collibra in pilots at Fortune 50 cos

Ability to identify product/platform gaps

and build point solutions

IP led ServicesListed in Collibra

Marketplace & IBM Global Solutions Directory

Solutioning Capability

Ability to quickly ramp up in new technologies to not

just deliver services but also develop solutions

with vendor

RECOGNIZABLE BRAND

▪ Collibra Product Management, Pre-Sales, Professional Services, Partner eco-system

▪ IBM Unified Governance Offering Management, US Sales Leadership, US & Worldwide Technical Sales, Lab Services

What makes us different

Collibra Services

Proof of Concept• Demonstrate Collibra

platform capabilities to support desired use cases, esp. around ability of metadata interchange using Collibra Connect, end to end process automation using workflows and DGC customizations for ease of use

• Leverage Trial versions of Lucid integrations

• PoCs / Pilots are meant to be quick wins in 2 to 3 weeks

Implementation• Install and config/

Validation of Collibra DGC (in case of on-prem) and Collibra Connect (for integration) environment

• Customization of Collibra Asset model and Operating model

• Configuration of Communities, Domains, user permissions and roles

• Initial asset seeding• Customization of DGC

look-and-feel, dashboards, lineage/asset views, search filters

• Configure/extend Collibra marketplace accelerators like Governance Scorecard

Integration / End to end process

automation• Define Data Governance

use cases• Identify/Understand

current business processes that can be supported by DGC

• Map DGC capabilities to Governance requirements

• Build/Configure Connect-based integrations to move IM platform metadata to DGC

• Build/Configure workflows to enable the process automation

Advisory Services• Guidance on best

practices around product configuration, development

• Operating Model Review and Design

• Defining use cases and product implementation options

Migration Services• Overall assessment, sizing

and planning of migration• Target environment

readiness check• Migrate Organization and

Content• Post Migration Verification• Delivering enhancements

as part of migration as opposed to “lift and shift”

7

A• DGC Dashboard as Enterprise Portal• Complex Workflows with Custom UI

Enhancing User Experience

B• Cloud, Messaging, Data Lakes, Big Data platforms, Custom APIs

Integrating with several Enterprise platforms

C• Enabling Active Governance (real-time bi-directional integrations)

• Customized Search based on metadata

Leveraging Collibra as a Platform

D• Credential Vault integration• AWS SQS as an alternate to Collibra gateway

Aligning to Security Standards

E• Automated provisioning using AWS

CloudFormation Scripts• Jenkins build pipelines

• Docker containers

Enabling Agility through DevOps

B C

D E

Complex Enterprise Implementation Experience

Easy Connections: Integration Library

Extensions

• Qlik Sense• MicroStrategy• IMM• IDQ• Denodo• Glue• Salesforce

Collibra Connect / Collibra API

Plug & Play

✓ Fully Supported✓ Subscriptions

• PowerBI• Tableau#

• Cognos#

• OBIEE

• IBM IGC#

• Cloudera Navigator

• SAP HANA• MS SSAS

• Teradata• Netezza• DB2 on zOS• Other RDBMS

• Informatica PowerCenter

Custom Build

• Oracle DRM• Erwin• IDERA• IBM IA#

• Talend DQ• Elastic #

• Apache Atlas#

• Neo4j• ServiceNow#

• Confluence

# Write-back supported from Collibra DGC to the source platform

• Propose assets• Event-driven asset ingestion

Create / Ingest

• Certification & Watermarking• Redundancy checks

• DQ score & Linkage check• Issue management – DQ tools,

Ticketing systems

Manage: Curate

• Rule-based asset matching and linking• Link to Source platforms• Create custom Complex Relations

Manage: Enrich

• Access control based on Data Category, on privacy / sensitivity attributes

• Data sharing agreements

Manage: Access Control• Asset changes as event triggers• Publish/Provision to source

platforms

Publish

• Mark for DeprecationArchive

Custom Workflows across Asset Life Cycle

Services for Collibra Proof of Concept

11

Lucid supports Collibra Proof-Of-Concept(POC) engagements that demonstrate capabilities / use cases of the Collibra platform such as

(a) Collibra DGC customizations to demonstrate its ease of use

(b) Ability to harvest metadata from data platforms into Collibra using Collibra Connect

(c) End-to-end process automation using workflows

Following are the typical set of activities in a POC:

• Define the Scope / Use cases to be demonstrated in the POC

• Agree on Cost and Schedule (typically this is 2-3 weeks)

• Define the success criteria for the POC – to determine if the approach used is a Go/No-Go from an implementation perspective

• Environment setup / validation – Setup/validation of the DGC environment, setup of Connect templates, setup/validate access to metadata source platforms, setup of any other marketplace accelerators in scope etc. – Pre-reqs / checklists shared with customer

• If the Connect template is part of Lucid’s library of pre-built Connectors (refer: http://www.lucidtechsol.com/downloads/), leverage the trial subscription. Similarly if the template is part of free accelerators in Collibra marketplace, leverage the same. If neither, then plan custom development

• Demonstrate the use cases to the stakeholders –lineage/traceability for metadata integration, end-to-end process flow , DGC dashboard customizations, marketplace accelerators etc.

• Perform a Fit-Gap analysis – Understand gaps between the use case requirements versus the features available and agree on the priority with stakeholders, to plan the fixes / customizations needed to address the gaps

• Agree on Next steps and POC Closure – Plan for actual implementation, fix/customization of identified gaps etc.; Share deliverables and get sign-off from stakeholders

Collibra Implementation Services

12

Lucid supports the following activities as part of the Collibra platform implementation:

• Collibra DGC installation (in case of on-prem) and configuration; Collibra Connect Installation and Configuration (for integration)

• Collibra Asset model and Operating model Customization

• Configuration of Communities, Domains, user permissions and roles – this will drive the organization of the assets loaded into DGC and their access privileges

• Customize Collibra Asset Model – includes review of the metadata to be loaded into Data Governance Center (DGC), mapping them to the Collibra asset model, addition of attributes/assets/relation types if not present in the out-of-the-box asset model

• Initial asset seeding for assets not loaded through automated methods (connectors) such as Business Terms, Acronyms etc

• Creation of using excel templates for Initial seeding of Business Terms, Acronyms etc and also those where lineage gaps need to be addressed –the templates will be created based on the asset types and their attributes/relations to be loaded into DGC

• One-time bulk load of assets and relations

• Customization of Data Governance Center

• DGC Dashboards, Asset Views, Lineage Views, Search Filters – which are the primary interface for end users to search and view the assets in DGC

• DGC look-and-feel – customization of the colors, fonts, logo and stylesheet

• Configure/extend Collibra marketplace accelerators like Governance Scorecard

• Build Workflows – High-level set of workflows suggested. This needs to be firmed up during detailed requirements / scoping exercise

• Stewardship workflows – This can be the basic Out-of-the-box(OOTB) workflows in DGC extended / customized for GM’s needs. These could be workflows for Business Glossary or data assets proposal (such as reports, tables, columns) and approval; Linkage of Business Glossary assets to the data assets etc

• Workflows to support Certification Process – This would be a one ore more to support the asset certification process, which could be a customization of existing OOTB workflows

• Metadata Integration between technical platforms and Collibra DGC – Apart from Lucid’s pre-built Connectors (refer: http://www.lucidtechsol.com/downloads/) , Lucid can also build custom integrations between any data / metadata source and Collibra

Collibra Advisory Services

13

Lucid Advisory Services are meant to provide customers with guidance on any technical or advisory topics related to Collibra DGC. The service can be purchased as retainer for a fixed number of hours per month or quarter. The customers then have the flexibility to use the hours any time during the period. However, each of the sessions would need to be scheduled through prior appointment.

Advisory services are relevant for customers who are looking for:

• Advice on best practices to customize or implement the product

• Help in mentoring their team members in specific topics related to the product

• Help with troubleshooting complex configuration and customizations of the product

What it covers:

• Advisory topics around defining use cases and product implementation options

• Technical topics around product features and configuration with focus on mentoring

• Guidance on best practices around product configuration, development (if relevant) and any product administration topics such asoperating procedures, upgrades etc

• Troubleshooting product specific configuration – including review of logs, code, wherever necessary

What it does not cover:

• This does not include delivery of any code or documentation. There will not be any deliverable from Lucid other than session itself

• These sessions cannot be used as triage sessions involving multiple client and product vendor teams

• These sessions do not guarantee that the fix suggested will work. The suggestion is based on prior experience of Lucid’s Architects in similar environments and the inputs/context provided by the customer prior to / during the meeting

A packaged migration solution that can provide:

• Overall assessment, sizing and planning of migration

• Impact analysis utilities – based on product versions migrated, org and metamodel variations between source and target

• Target environment Readiness check – checks prior to migration

• Migrate Org and Content given the mapping between source and target Org and metamodel

• Post-migration Verification utilities and Reports

• Utilities to rename and align the existing asset nomenclature to that of catalog naming standards

• Utilities to verify metamodel if some of the custom assets from previous versions are now brought into OOTB and hence the right asset ids are used without duplication

Collibra Migration Services

14

Organizations that implement Collibra DGC (or any product so to say) invariably have to tackle the challenge of migrating one or all of DGC’s Metamodel, Organization and Content* across platforms. This could be driven by one or more of the following:

(a) Need to upgrade to newer version of DGC to leverage its newer features

(b) Need to introduce specific modules/features into the current platform such as bring in Reference Data module, Policy manager, etc.

(c) Need to expand the current platform to include newer Business divisions/groups

All of the above typically need changes to the metamodel/organization/content to be first made and tested in the Dev/QA environment and then migrate the changes incrementally into an active Production environment.

The current toolsets and approaches available from Collibra are not sufficient to enable a seamless and error-free migration.

Lucid, based on its substantial experience in implementing Collibra across large enterprises, has identified approaches/solutions that can address the migration challenge.

* Metamodel – Asset types, attribute types, relation types, statuses, roles and permissionsOrganization – Communities, Domains, Dashboards, Diagrams, Views, Workflows and Workflow configContent – Assets, attributes, relations and tags

Collibra Implementations : Sample Use Cases

15

• Standardize definitions and enable a searchable Enterprise dictionary of definitions, reference data lists, systems and reports

• Create a catalog of Report assets linked to KPIs and their definitions

• Create a custom Collibra dashboard, to replace the current paradigm of reviewing Operations using a custom SharePoint/PowerPoint based solution to navigate to Tableau Dashboards using a representation of the Gartner Operations Metric Hierarchy

Stand-up platform for Data Governance

• Integration of metadata from Data platforms to enable traceability of information on Reports to their System-of-Record (Oracle, Informatica PowerCenter, Cognos)

• Loading technical metadata from IBM InfoSphere Information Server (IGC) to Collibra DGC, enriching it with business metadata and pushing related business metadata from Collibra into IBM IGC

• Technical metadata integration (Custom REST API interfaces, AWS Relational Data Service, Amazon SQS, AWS S3, etc. ) to support lineage views in Collibra DGC and supporting custom metadata services based on business enriched technical metadata from Collibra DGC

Metadata Integration and Lineage

• Governed Business Reference Data Management

• Integration of Data Quality metadata from IBM Info Analyzer into Collibra DGC for managing DQ exceptions as issues in Collibra

• Detect asset modifications based on new metadata and /or asset approvals and push content from Collibra DGC to metadata services for consumption by downstream applications

End-to-end Process Automation

Custom Workflows : Some Sample Use Cases

16

•Propose/Modify assets interactively – save draft, view impact on lineage diagram

•Trigger Integration/connect templates to enhance assets

•Approve assets by evaluating DQ scores, Open Issues for linked assets

•Conditional Approval of assets

•Asset Certification

•Control publication of Assets based on status

•Trigger periodic re-certification based on asset changes

Asset Lifecycle Management

•Govern & publish Reference data to data platforms

•Certify Datasets using asset completeness

•Manage Dataset access and provisioning

Dataset and Reference Data Management

•Data Governance issues from external ticketing systems

•Log and manage issues based on metrics / DQ exceptions from DQ tools

•Manage privacy / sensitivity requirements around DQ exception content linked to Issues

Issue Management

Catalog of Sample Collibra Case Studies (1 of 3)

17

Use Case Client Focus Areas

Enabling traceability of data from Dashboard to System-of-Record with intelligent linking of business and technical metadata (DGC ver. 5.2)

Multi-National Oil & Gas Corporation

• Business Glossary Management• Metadata Integration and Lineage

Integrate IBM Information Server with Collibra by ingesting Data integration (ETL) and Data quality metadata into Collibra and pushing related business metadata from Collibra into IBM IGC (DGC ver. 5.2.1)

Large US Savings Bank and Mortgage Lender

• Collibra Asset and Operating Model customization• Customization of Dashboard, Lineage/Asset views,

Email templates• Version/Asset migration• Metadata Integration and Lineage• Custom workflow development

Integration of metadata from Data platforms to enable traceability of information on Reports to System-of-Record (Oracle, Informatica PowerCenter, Cognos) (DGC ver. 5.0.3)

Large Healthcare Company in the US

• Collibra Asset and Operating Model customization• Customization of Dashboard, Lineage/Asset views,

Email templates• Business Reference Data management• Metadata Integration and Lineage• Custom workflow development

IBM InfoSphere Information Server (IGC) to Collibra DGC Integration (DGC ver. 4.6)

Leading US Regional Bank

• Technical metadata Integration and Lineage

Enable Asset certification processes (DGC ver. 5.1.2) Insurance Group of Canadian Government

• Collibra Asset and Operating Model customization• Custom workflow development

Note : Detailed case studies can be shared on request

Catalog of Sample Collibra Case Studies (2 of 3)

18

Use Case Client Focus Areas

Enable Active Data Governance with a Universal Metadata Repository (DGC ver. 5.1.2)

Technology Major • Metadata Integration and Lineage• Custom workflow development

Dynamic ETL generation using metadata from Collibra DGC (DGC ver. 5.2.1)

Large Bank in Asia • Collibra Asset and Operating Model customization

• Metadata Integration and Lineage

Enable a searchable dictionary of Business Terms, Reference Data lists and build workflows for managing the asset lifecycle (DGC ver. 5.2.2)

US-based Pharma Company • Collibra Asset and Operating Model customization

• Customization of Dashboard, Lineage/Asset views, Email templates

• Custom workflow development

Standardize definitions and enable a searchable Enterprise dictionary of definitions, systems and reports (DGC ver. 5.3.1)

US-based Network of Public, Charter Schools

• Collibra Asset and Operating Model customization

• Customization of Dashboard, Lineage/Asset views, Email templates

• Custom workflow development

Technical metadata ingestion (Cloudera – HDFS( Parquet) Teradata and DB2) into Collibra (DGC ver. 5.3.2)

South American division of a global Consumer Credit-reporting agency

• Collibra Asset and Operating Model customization

• Metadata Integration and Lineage

Catalog of Sample Collibra Case Studies (3 of 3)

19

Use Case Client Focus Areas

Create a catalog of Tableau assets linked to their KPIs and their definitions. Create a custom Collibra dashboard, to navigate the Tableau report catalog, based on Gartner Operations Metric Hierarchy (DGC ver. 5.4.3)

A leading US-based clinical robotic products manufacturer

• Collibra Asset and Operating Model customization

• Custom Dashboard Development to provide a custom interface to navigate to underlying Tableau content

• Custom workflow development

Technical metadata integration (Custom REST API interfaces, AWS Relational Data Service, Amazon SQS ) and custom workflows for approval of business assets & technical asset linkage (DGC ver. 5.5.1)

A Leading US-based investment management firm

• Collibra Asset and Operating Model customization

• Metadata Integration and Lineage• Custom workflow development

Technical metadata integration (PowerBI, SSAS, MS SQL) and custom workflows for custom mapping spec creation, issue management, auto-generation of asset linkages and asset changes as attachments.

An American multinational independent investment bank and financial services company

• Collibra Asset and Operating Model customization

• Metadata Integration and Lineage• Custom workflow development• Configuration of Catalog and Marketplace

accelerator

Technical metadata integration (PowerBI, SSAS, SAP HANA) and custom workflows for Data source certification, Report watermarking, auto-linking Data element to Business Term, asset redundancy checks and marking assets for Deprecation. Complex workflow screens that uses HTML grids

An American multinational corporation and technology company, headquartered in the Silicon Valley

• Collibra Asset and Operating Model customization

• Metadata Integration and Lineage• Custom workflow development

Enables management of Data quality across EIM platforms using Collibra’s collaborative and business friendly interfaces

Watch the video: https://www.youtube.com/watch?v=AfHMbqNz3e0&width=640&height=480Datasheet and more information: http://www.lucidtechsol.com/harness-the-power-of-both-platforms-data-governance-and-information-management/

Solutions : Leveraging Collibra as a platform

Data Quality Management

20

Conceptual Solutions: Leveraging Collibra as a platform

Governed Automated Provisioning

Watch the video: https://youtu.be/KxQWR4RBbng

21

Conceptual Solutions: Leveraging Collibra as a platform

Metadata-driven Asset Browser

No direct access to Collibra needed

Ability to configure view based on role

Delivered as an Embeddable widget

RES

T A

PI

DGC Users

On-the-Go Users

DGC Asset Extractor

Metadata to drive asset extraction

RES

T A

PIR

EST AP

I Any User

Watch the video: https://youtu.be/__WyrDuPXRs

22

Conceptual Solutions: Leveraging Collibra as a platform

Active Governance : ATLAS Integration

Real-time capture of asset changes

Writeback enriched metadata to Atlas

Leverage the Atlas Eco-system

Data platforms

RES

T A

PI

Metadata Repository

Collibra Atlas Integration

DGC (logo)

Metadata Repository

Create Task

Approve / Enhance Assets

Enriched Metadata

Enriched Metadata

Asset Metadata Changes

Watch the video: https://youtu.be/y8-WlokmXBc

23

Governance : Designed & Deliveredwww.lucidtechsol.com

Kalyani Jagannathan | kalyanij@lucidtechsol.com | 610 849 0789