Intelligent Data Governance - Informatica

23
` Intelligent Data Governance Using Axon, EDC, IDQ Srinivasa Gopal Jan 14, 2019 Principal Technologist – Customer Success

Transcript of Intelligent Data Governance - Informatica

Page 1: Intelligent Data Governance - Informatica

`

Intelligent Data GovernanceUsing Axon, EDC, IDQSrinivasa Gopal

Jan 14, 2019

Principal Technologist – Customer Success

Page 2: Intelligent Data Governance - Informatica

2 © Informatica. Proprietary and Confidential.

Housekeeping Tips

Todays Webinar is scheduled to last 1 hour including Q&A

All dial-in participants will be muted to enable the speakers to present without interruption

Questions can be submitted to “All Panelists" via the Chat option and we will respond at the end of the presentation

The webinar is being recorded and will be available to view on our INFASupport YouTube channel. The link will be emailed as well.

Please take time to complete the post-webinar survey and provide your feedback and suggestions for upcoming topics.

Page 3: Intelligent Data Governance - Informatica

Success Portal https://success.informatica.com

Learn. Adopt. Succeed.

© Informatica. Proprietary and Confidential.

Product Learning Paths and weekly Expert sessions

Bootstrap product trial experience

InformaticaConcierge with

Chatbot integrations

Enriched Onboarding experience

Tailored training and content

recommendations

Page 4: Intelligent Data Governance - Informatica

4 © Informatica. Proprietary and Confidential.

Safe Harbor

The information being provided today is for informational purposes only. The

development, release and timing of any Informatica product or functionality

described today remain at the sole discretion of Informatica and should not be

relied upon in making a purchasing decision. Statements made today are

based on currently available information, which is subject to change. Such

statements should not be relied upon as a representation, warranty

or commitment to deliver specific products or functionality in the future.

Page 5: Intelligent Data Governance - Informatica

5 © Informatica. Proprietary and Confidential.

Agenda

• UseCases & Overview of Axon – Data Governance

• Automatic Data Discovery, Cataloging using EDC

• Automate Fit for purpose Data Quality using IDQ

• Demo

• Q&A

Page 6: Intelligent Data Governance - Informatica

6 © Informatica. Proprietary and Confidential.

Portfolio of use cases

Data Governance

HealthcarePatient Data AnalyticsReal time case prioritizationPregnancy ManagementPersonalized Medications and CarePopulation Health ManagementIDMP Compliance

Medical

Gene AnalyticsMedical Imaging InsightsDevice and Drug Comparative EffectivenessDiagnostic Error Prevention

Public Sector

Citizen ServicesIdentity Resolution for Fraud and AbuseCrime and Disorder AnalysisCity Planning

Digital TransformationMarketing Analytics

Demographics AnalyticsRisk Evaluation and Optimization

Retail

Insurance

Channel AnalysisMarketing AnalysisProduct DevelopmentSupply Chain Management

Financial Services

Compliance (GDPR,, CCPA, BCBS 239 etc.)Marketing Analytics

Risk Assessment and Fraud DetectionData Security and Deidentification

Portfolio AnalyticsPersonalized Financial Planning

Customer Operations Automation

Automotive and Transportation

Smart MeteringSupply Chain and Production Optimization

Predictive Infrastructure Maintenance

Energy and Manufacturing

Engine Monitoring and Autonomous MaintenanceRide Sharing Analytics and Optimization

Route Optimization

Page 7: Intelligent Data Governance - Informatica

7 © Informatica. Proprietary and Confidential.

Business ProblemAlignment across Policy and Organization tiers

Ope

ratio

nsPo

licy

CDO, CDGO or Executive Sponsor

Governance Program Office

Working Group Leads

Enterprise Stewards (Options)

Data Owner / Stewards (BUs)

Data Delivery (IT + BU)

InformaticaED

C

AXON

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 8: Intelligent Data Governance - Informatica

8 © Informatica. Proprietary and Confidential.

Connected Data Governance – Information Architecture

Information Architecture

Business Architecture

System Landscape Architecture

Data Architecture

Business ArchitectureUnderstanding the business needBusiness groups, processes, controls, connections

System Landscape ArchitectureUnderstanding how applications enable business processes, record and transport informationSystems, Interfaces

Data ArchitectureUnderstanding our information and how it binds business and IT togetherData, definitions, standards, quality stewardship

Information Architecture is the relationship between business, systems and data

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 9: Intelligent Data Governance - Informatica

9 © Informatica. Proprietary and Confidential.

Axon EDG Management Concept

Stakeholder Accountability

Remove silos

Centralize Inventories

Business facetsGlossaryPolicies

Data QualityProcess

Business Stakeholders

Technical facetsSystem

InterfaceDataset

AttributesTechnical Stakeholders

Common Definitions &

Processes

Business Rule

Transparency

Business-driven global vision defined in partnership with

Technology and enforced via Data Governance

Capabilities Business Areas

Projects

Glossary Policies DQ Rules

Processes People Systems

Interfaces Datasets Attributes

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 10: Intelligent Data Governance - Informatica

10 © Informatica. Proprietary and Confidential.

Automate Data Discovery, Cataloging, and Context

Leverage ML and AI to find critical data across structured and unstructured sources

Onboard discovered data automatically with oversight and control

Automatically tag data with business context to help users assess relevance

Page 11: Intelligent Data Governance - Informatica

11 © Informatica. Proprietary and Confidential.

Intelligent Glossary AssociationCLAIRE Match

Column Name Business Name (Actual Auto Associations done by the system)

FIN_OPS_CNTCT_CD Financial Operations Contact Code

IC_RATE_PCT Indirect Cost Rate Percent

AR_ITEM Accounts Receivable Item

AR_ITEM_ACT_ENTRY_AMT Accounts Receivable Item Activity Entry Amount

EXTRACT_DT Extract Date

BILL_ACCT_RECON_FLG Bill Account Reconciliation Flag

PYRLL_TRANS_UNALLW_IND Payroll Transaction Unallowed Indicator

CLASS_EFFDT Class Effective Date

CLM_SOR_CD Claim System of Record Code

• Match English phrases with technical names using sequence alignment

• Sequence Alignment / Delete-only Edit Distance : The business term names that align well with asset names are sought. This approach can capture obvious abbreviations of business terms.

• HEALTH PROGRAM CONSULTATION (Business Term Title)

• H- - LTH P - - G - - M C- NS - LT- T- -N (Asset name)

• Synonym dictionary : If available, user provides a dictionary of commonly used synonyms/abbreviations in technical asset names within the organization. This dictionary is used to improve glossary matching

• Additionally, prefix ignore options for discarding common technical prefixes(like TBL, VW etc for better matches)

• Name match is in tech preview in 10.2.2 and will not be available to customers by default

Page 12: Intelligent Data Governance - Informatica

12 © Informatica. Proprietary and Confidential.

Intelligent Business Glossary Associations

Score (Domain Conformance)

Score (Similarity Confidence)

Score (Name Match)

Total Score=3*Domain Conformance +

2*Name Match + Similarity Confidence

Threshold > 80

{YES}: Auto Accept

{NO, Is Threshold>60} =>

Recommend

Page 13: Intelligent Data Governance - Informatica

13 © Informatica. Proprietary and Confidential.

Business Glossary Assignment Report

• Users can go to the Business Term Assignment Report at the resource level to look at all business term recommendations in bulk and curating them.

• Includes filters for asset names, associated items and recommended terms.

Understand glossary association coverage for a resource in one place. Curate recommendations directly from the report

Data Steward

Page 14: Intelligent Data Governance - Informatica

14 © Informatica. Proprietary and Confidential.

Axon integration with EDCConfiguration

Axon REST API

EDC

REST API

AxonScanner

ExternalReference

EDC Bundle(Search)

Axon Glossaries

Resources, Columns etcREST API Request

REST API Response

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 15: Intelligent Data Governance - Informatica

15 © Informatica. Proprietary and Confidential.

Automate Fit for Purpose Data Quality

Automate rule generation from technical descriptions of standard measures and metadata

Automate rule enforcement in systems and business processes

Monitor quality improvement across systems and processes over time

Page 16: Intelligent Data Governance - Informatica

16 © Informatica. Proprietary and Confidential.

Automating Data Quality for Data Governance

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 17: Intelligent Data Governance - Informatica

17 © Informatica. Proprietary and Confidential.

Rule generation based on Business Context and Definition

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 18: Intelligent Data Governance - Informatica

18 © Informatica. Proprietary and Confidential.

Automation Quality for Data GovernanceEnd to End Process Automation

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 19: Intelligent Data Governance - Informatica

19 © Informatica. Proprietary and Confidential.

Axon integration with IDQConfiguration

IDQ (Co-Located)

Axon

REST API

AGENT

DIS

ProfilingService

MRS

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 20: Intelligent Data Governance - Informatica

Demo

Page 21: Intelligent Data Governance - Informatica

21 © Informatica. Proprietary and Confidential.

Business Outcome

Building Data Management Capability

ARE WE READY FOR THE ORGANIZATIONAL CHANGE?

Data Management

Policy

Data Management

Board

Data Management

Tools

Information Strategy

Critical Data Element Process

Data Architecture

Data Governance Framework

Business Data Model

Data Quality Framework

Critical Data Element Process

Data Quality Framework

Data Governance Framework

Data Management

Policy

FROM TO

Data Architecture

Data Management

Board

Data Management

Tools

Business Data Model

Information Strategy

Presenter
Presentation Notes
This is not only a text box. You can also place a table, chart or smart art graphic within a content box. You can only place one or the other.
Page 22: Intelligent Data Governance - Informatica

Thank You!

Page 23: Intelligent Data Governance - Informatica

23 © Informatica. Proprietary and Confidential.

References

• Axon Playbook https://kb.informatica.com/whitepapers/4/PublishingImages/Informatica%20Axon%20-%20The%20Data%20Governance%20Playbook%20(6.2%20Release).pdf

• Using Axon with Enterprise Data Catalog https://kb.informatica.com/h2l/HowTo%20Library/1/1150-UsingAxonDataGovernancewithEnterpriseDataCatalog-H2L.pdf

• Axon Checklist to Automate Data Quality Rules https://docs.informatica.com/data-quality-and-governance/axon-data-governance/h2l/checklist-to-automate-data-quality-rules-in-axon-data-governance/abstract.html

• 7 Best Practices to Drive Data Catalog Adoption https://www.informatica.com/lp/7-best-practices-to-drive-data-catalog-adoption_3712.html#fbid=PYYnGF22B9T

• Data Quality Accelerator https://kb.informatica.com/faq/7/Pages/21/534447.aspx?myk=data%20quality%20accelerator%20guide

• New Features in Axon 6.3 https://docs.informatica.com/data-quality-and-governance/axon-data-governance/6-3/release-guide/axon-6-3/new-features-in-version-6-3.html