Anzo Smart Data Integration

©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential.

Anzo Smart Data Integration

Cambridge Semantics Contact:Marty LoughlinVice President, Financial ServicesCambridge Semantics141 Tremont St., 6th Floor, Boston, [email protected](o) 617.855.9565

http://www.cambridgesemantics.com/

mailto:[email protected]

©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential

Anzo Smart Data Integration Overview

Anzo Smart Data Integration uses common, conceptual models with existing ETL tools to increase the speed and decrease the cost of completing high-quality, governed data integration

projects by 10 times or more.


The Data Integration Challenge

Customer 360

EnterpriseWarehouse

BusinessData Marts

Compliance andRegulatory Reporting

Source Systems

Lead(SFA system)

Quote(Quote system)

Order(OMS system)

Contract(CMS system)

Target SystemsS x T

ETL Jobs

Each Job

DefineMapping

Requirements

Code ETL Job

Test & Deploy

Business Analyst Developers QA & OpsEach ETL Project:• Manually coded• Requires source

& target SMEs• Many hand-offs


The Common Model is “Data Glue”

Lead(SFA system)

Quote(Quote system)

Order(OMS system)


Common Model(“Data Glue”)

Source Systems

• Many common concepts across disparate systems

• Semantic data science connects these common concepts

• Data is “glued” together by its underlying business meaning

• Potential to use industry standard models, e.g., FIBO, CDISC, HL7

Business Analysts and IT can use conceptual models to:• Create data services• Understand the data landscape• Track data lineage• Conduct downstream analytics



Compliance andRegulatory Reporting

Each ETL Job:• Generated from map• Only source SME

required• Hours, not months

Customer 360

EnterpriseWarehouse

BusinessData Marts

Source Systems

Lead(SFA system)

Quote(Quote system)

Order(OMS system)


Target Systems

Each Job

Map Source toConceptual Model

Business Analyst

S + T Maps

Automatically Generate ETL

Anzo SDI

Common Model(“Data Glue”)


Map to/from conceptual

models

Combine maps &

automatically generate ETL

jobs

Create data marts and extracts

on-demand

Explore data provenance

Anzo Smart Data Integration Capabilities


Anzo Smart Data Integration Components

Model Manager

Data Connections

Schema Manager

Project Manager

Mapping Manager

Provenance Explorer


Anzo Smart Data Integration Demo

MySQL

Source System

HoldingsTable

Target SystemConceptualAsset

Model

• Map Holdings database to Conceptual Asset Model• Map Conceptual Asset Model to MySQL target database• Publish and run Pentaho job• Demonstrate Lineage

Scenario


Appendix

Ap

plic

atio

ns

Mid

dle

war

eEn

terp

rise

Dat

a Fa

bri

c

Anzo Server

Reasoning& Rules

WorkflowSemanticServices

Anzo Connect

Enterprise Directory Connect

Anzo Unstructured

Data Marts & Warehouses

EnterpriseApplications

Directory(LDAP, AD)

………

3rd Party Databases & Applications

Anzo Architecture & Capabilities

Exte

rnal

So

urc

es• User self-serve• Interactive• Conceptual model• Search, filter, BI

analytics, forms, alerts,…

• Cache or virtualize data based on W3C semantic standards

• Based on real-time event based architecture

• Embedded graph database

• Two-way integration to existing systems

• Anzo Unstructured pipeline allows easy plug-in of 3rd Party NLP and crawlers


Anzo Smart Data Integration Architecture

Smart Data Integrator(web application)

…includes:• Project manager• Schema manager• Model manager• Data feed manager• Governance dashboards

Data Mapper(Excel-based)

Conceptual Model Editor

Anzo Smart EDM Server

ETL Compiler

MappingRegistry

ConceptualModel Registry

Schema & Sample Data Registry

Data SourceRegistry

Data Feeds Catalog

Services:

• Sample data service• Data feed persistence service• Revision & audit service• Access control service

ETL Engine

• SQL• CSV/TSV• XML• Proprietary

• SQL• CSV/TSV• XML• Proprietary


ASDI User Roles

•Defines projects and mappings

•Configures data sources & schemas

•Publishes projects to ETL tools

•Populates Data Catalog with Data Feeds

Full User

•Search and browse Data Catalog

•Creates on-demand data marts and extracts from Data Catalog

Data Consumer

•Manage models

•Browse and search projects

•Browse and search data lineage

Governance User

•Configures users and roles

•Configures dashboards and templates

Administrator


ASDI Use Case: Creating a Data Lake

DataLake

Common Conceptual Model

Self-service Analytics

Self-service Data Extracts & Marts

Sources


Anzo provides a platform –wide

common conceptual model

Anzo enables end-user self-service

using models

ASDI streamlines and automates data

ingestion

Anzo Smart Data Integration

Data & Analytics

Transcript of Anzo Smart Data Integration