VIRTUALIZACIÓN DE DATOS Y BIG DATA - AGILIDAD EN ENTORNOS DISTRIBUIDOS DE DATOS

CDAO, America Central– Enero 2017

Angel Viña – Denodo CEO

Agenda1. Introduction

2. Hybrid Data Architectures: From EDW to LDW

3. Denodo Data Layer

4. Hot Use Cases

5. About Denodo

3

Be all talk (and no action)?Data Management solutions for the Chief Data and Chief Analytics Officer to take control of the enterprise data assets & the corporate data strategy

From EDW to LDWorHow the Data Lake fits in the Enterprise Information Ecosystem

5

Hybrid Data ArchitecturesReal-TimeDecision

Management

Alerts

Scorecards Dashboards

Reporting

Data DiscoverySelf-Service

Search

Predictive Analytics

Statistical Analytics (R)

Text Analytics

Data MiningData Warehouse

Sensor Data

Machine Data (Logs)

Social Data

Clickstream Data

Internet Data

Image and Video

Enterprise Content (Unstructured)

Big Data

Enterprise Applications

Traditional Enterprise

Data

CloudCloud

Applications

Metadata Management, Data Governance, Data Security

NoSQL

EDW In-Memory(SAP Hana, …)

Analytical Appliances

Cloud DW(Redshift,..)

ODS

Big Data ETL

CDC

Sqoop

(Flume, Kafka, …)

Real-Time Data Access (On-Demand / Streaming)

Batch

YARN / Workload Management

HDFS

HiveSparkDrill

Impala

Storm HBase SolrHunk

DW Streams NoSQL SearchSQL

Hadoop

TezMapRed.

6

Source: “The Big Data Warehouse Deal: The Future of Data Management Solutions for Analytics”

Through 2018, 80% of Logical Data Warehouses and Data Lakes would not include effective metadata management capabilities, making them ineffective for analytics.”

7

How can I combine data from several systems ensuring good performance?

How can I abstract consuming applications from technology change and requirements evolution?

How can I enforce consistent security and governance policies across all data sources?

How do you offload your Data Warehouse to Hadoop or other cheaper storage?

Questions for the Logical Data Warehouse:

The Logical Data WarehouseIntegrated View of a Plurality of systems: Hadoop, EDW, Streaming, In-memory,...

8

What Companies are doing today

Source:

Data Warehouse Architectural Options

Denodo Data Virtualization

DV in the the Logical Data WarehouseReal-TimeDecision

Management

Alerts

Scorecards Dashboards

Reporting

Data DiscoverySelf-Service

Search

Predictive Analytics

Statistical Analytics (R)

Text Analytics

Data MiningData Warehouse

Sensor Data

Machine Data (Logs)

Social Data

Clickstream Data

Internet Data

Image and Video

Enterprise Content (Unstructured)

Big Data

Enterprise Applications

Traditional Enterprise

Data

Cloud

Cloud Applications

NoSQL

EDW In-Memory(SAP Hana, …)

Analytical Appliances

Cloud DW(Redshift,..)

ODS

Big Data ETL

CDC

Sqoop

(Flume, Kafka, …)

Data Virtualization

Real-Time Data Access (On-Demand / Streaming)

Data Caching

Data

Ser

vice

s

Data Search & Discovery

GovernanceSecurity

Optimization

Data

Abs

tract

ion

Data

Tran

sfor

mat

ion

Data

Fede

ratio

nBatch

YARN / Workload Management

HDFS

HiveSparkDrill

Impala

Storm HBase SolrHunk

DW Streams NoSQL SearchSQL

Hadoop

TezMapRed.

11

The SolutionData Abstraction Layer

Abstracts access to disparate data sources

Acts as a single repository (virtual)

Makes data available in real-time to consumers

DATA ABSTRACTION LAYER

“Enterprise architects must revise their data architecture to meet the demand for fast data.”

– Create a Road Map For A Real-time, Agile, Self-Service Data Platform, Forrester Research, Dec 16, 2015

12

Data VirtualizationReal-time data integration

“Data virtualization integrates disparate data sources in real time or near-real time to meet demands for analytics and transactional data.”

– Create a Road Map For A Real-time, Agile, Self-Service Data Platform, Forrester Research, Dec 16, 2015

Publishes the data to applications

Combines related data into views

Connects to disparate data sources

2

3

1

13

Data Virtualization – 3 Simple Steps

Data virtualization combines disparate data sources into a single “virtual” data abstraction layer (aka information fabric) that provides unified access and integrated data services to consuming applications in real-time (right-time).

Connect &

Virtualize

Combine &

Integrate

Publishas a Data Service

Local Database XML Documents

Name | Description | Price Name | Description | Price

U

∞Name | Manufacturer | Score

Name | Description | Manufacturer | Price | Score

Application

Browser

ResultsSQL Query

Base View Base View

Base View

Derived View Data Service(SQL, SOAP, REST, Widgets…)

14

Source: “Predicts 2017: Data Distribution and Complexity Drive Information Infrastructure Modernization”

By 2018, organizations with data virtualization capabilities will spend 40% less on building and managing data integration processes for connecting distributed data assets.”

15

Source: “Predicts 2017: Data Distribution and Complexity Drive Information Infrastructure Modernization”

Modern information infrastructure will include data virtualization, separation of storage and compute, and cloud-based data persistence. Data and analytics leaders must evolve their technology capabilities for digital transformation.”

16

Source: “Forrester Wave™: Big Data Fabric Q4 2016”

Denodo’s key strength is delivering a unified and centralized data services fabric with security and real-time integration across multiple traditional and big data sources, including Hadoop, NoSQL, cloud, and software-as-a-service (SaaS).”

Hot Use Cases

Enterprise DV @ Confluence of Ecosystems

18

Key Enabler to Large Projects in an Increasingly Data-Driven World

Logical Data Warehouses

For agile BI

Single Viewsfor operational efficiency

Big Data LakesFor advanced analytics

Data Services & Data MarketplacesFor digital transformation and legacy modernization

Data Virtualization

“You Need A Data Virtualization Strategy To Succeed; Without One, You Risk Falling Behind. Without data virtualization, you risk knowing less about your customers. You’ll get fewer real-time business insights, lose your competitive advantage, and spend more to address data challenges. Firms that invest in data virtualization technologies will respond more quickly, deliver more and better products, and grow faster than their competitors.”

Forrester: Information Fabric 3.0

CONFIDENTIAL

19

Common Data Virtualization Use Cases

BIG DATA, CLOUD INTEGRATION

▪Data Lake Semantic Layer▪Data Warehouse Offloading IoT & Predictive Analytics▪Cloud / SaaS Integration

AGILE BUSINESS INTELLIGENCE

▪Logical Data Warehouse▪Virtual Data Marts▪Self-Service BI▪Operational BI / Analytics

SINGLE VIEW APPLICATIONS

▪Single Customer View - Call Centers, Portals▪Single Product View - Catalogs▪Sales/Inventory Reconciliation▪Vertical Specific - Single View of Well, Network, …

DATA SERVICES

▪Unified Data Services Layer▪Legacy Modernization and Migrations▪Micro Data Services▪Linked Data Services

20

Successful Customer Use CasesAGILE BUSINESS INTELLIGENCE

Replaced traditional operational BI with the logical data warehouse.

More than 500 developers creating business views to support better decision making with fast response to business demands

AGILE SINGLE VIEW APPLICATIONS

Created ‘Unified Customer View ’ that provides integrated customer information.

Unified desktops to address access heterogeneous data systems

BIG DATA, CLOUD INTEGRATION

Created virtual layer to abstract data access creating data lake abstraction.

Achieved easy integration of big data and modernization of legacy infrastructure

DATA SERVICES

Delivered commercial products developed using data services.

Achieved faster time-to-market with high impact on supply chain and aircraft production processes

21

Marquee Customers Across Multiple Verticals350+ customers across 30+ industries

Public Sector

Financial Services

Telecommunications

Healthcare

Technology

Manufacturing

Insurance

Retail

Pharma / Biotech

Energy

CONFIDENTIAL

22

Leading BFSI Clients use Denodo beyond LDW# Use Case1 Risk Reporting and Analytics (Regulatory

reporting and Capital Markets) 2 Liquidity Management (Risk management)3 Client Reporting (BFS General) and Customer

Relationship Management(BFS)4 Customer Propensity /Upselling (BFS

General)5 Multi Channel usage integration and

analytics (Banking/Capital markets)6 Internal Data Marketplaces

7 Single View of a Customer

8 Financial aggregation

9 Fraud Detection (Risk management)

10 Legacy Replacement, Consolidation & Modernization

About Denodo

24

HEADQUARTERSPalo Alto, CA.

DENODO OFFICES, CUSTOMERS, PARTNERSGlobal presence throughout North America, EMEA, APAC, and Latin America.

CUSTOMERS

350+ customers, including many F500 and G2000 companies across every major industry have gained significant business agility and ROI.

LEADERSHIP Longest continuous focus on data

virtualization and data services. Product leadership. Solutions expertise.

24

THE LEADER IN DATA VIRTUALIZATION

Denodo provides agile, high performance data integration and data abstraction across the broadest range of enterprise, cloud, big data and unstructured data sources, and real-time data services at half the cost of traditional approaches.

25

Denodo #1 in DV – Everyone Agrees!By Analysts ; By Press / Customer Awards; By Customers Themselves

2016 Magic Quadrant for Data Integration

ToolsVisionary

2015 Leader in Forrester Wave: Enterprise Data

Virtualization.

2015 Technology Innovation Award for

Information Management

2015 #1 Readers Choice Awards For Data

Virtualization Platforms

Leadership Award For Denodo Customers Autodesk – 2015

Seacoast Bank- 2016

Analyst Recognition Press / Customer Awards

CIO 100 Award2015 – Amgen

2016 – CIT Bank

Denodo’s scores exceed those of all other data integration vendors in all categories: overall experience, evaluation & contracting, integration & deployment, Product Capabilities, and service & support

26

All Hadoop Vendor’s Recommend DenodoPreferred DV Based on Performance Testing & Certification

Thanks!

www.denodo.com info@denodo.com© Copyright Denodo Technologies. All rights reservedUnless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.