SnapLogic Live: Big Data Integration

9
SnapLogic Live: Big Data Integration

Transcript of SnapLogic Live: Big Data Integration

Page 1: SnapLogic Live: Big Data Integration

SnapLogic Live: Big Data Integration

Page 2: SnapLogic Live: Big Data Integration

Welcome to SnapLogic Live

In 30 minutes we’ll:• Review specific topics and the role SnapLogic plays• Dive into demonstrations of our Elastic Integration

Platform• Open it up for questions and discussion

Today’s featured presenter: Rich Dill

Today’s featured topic: Big Data Integration

Page 3: SnapLogic Live: Big Data Integration

Anythingapps | APIs | things | data

SnapLogic: Unified Platform for Data and Application Integration

Anytime batch | streaming | real-

time

Anywhereon premises | in the cloud

Page 4: SnapLogic Live: Big Data Integration

Common SnapLogic Elastic Integration Use Cases

Hybrid Application Integration

Cloud Data Warehouse/An

alytics

Big Data Ingest-

Transform-Deliver

RESTful

Retire Legacy Integration Platforms

Page 5: SnapLogic Live: Big Data Integration

z

Data Acquisition

Data Access

z

Data Management

Add information and improve

data

SparkPythonScalaJava

RPig

Collect and integrate data from multiple sources

HDFSAWS S3

MS Azure Blob

On Prem Apps and

Data• ERP• CRM• RDBMS

Cloud Apps and Data• CRM• HCM• Social

IoT Data• Sensors• Wearable

s• Devices

LakeshoreData Mart• MS Azure• AWS

Redshift

BI / Analytics

• Tableau• MS

PowerBI / Azure

• AWS QuickSight

Organize and prepare

data for visualizatio

n

HDFSAWS S3

MS Azure BlobHive

Batch

Streaming

Schedule and manage: Oozie, Ambari

Kafka, Sqoop, Flume

Real-time

Impala, HiveSQL, SparkSQL

Data Lake Components without SnapLogic

Page 6: SnapLogic Live: Big Data Integration

z

Data Acquisition

Data Access

z

Data Management

The Modern Data LakePowered by SnapLogic

On Prem Apps and

Data• ERP• CRM• RDBMS

Cloud Apps and Data• CRM• HCM• Social

IoT Data

• Sensors• Wearable

s• Devices

LakeshoreData Mart• MS Azure• AWS

Redshift

BI / Analytics• Tableau• MS

PowerBI / Azure

• AWS QuickSight

Batch

Streaming

Schedule and manage: SnapLogic

Real-time

Sort,Aggregate,Join, Merge,Transform

SnapLogicabstracts and

operationalizes with

SnapReduce or Spark pipelines

Collect and integrate data from multiple sources

SnapLogicpipelines with

standard mode

execution

Organize and prepare

data for visualizatio

n

SnapLogicpipelines with

standard mode

execution

Pipeline

Pipeline

Pipeline

Pipeline

Pipeline

SnapLogic and the Data Lake

Page 7: SnapLogic Live: Big Data Integration

SnapLogic’s Modern Architecture: Hybrid and ElasticStreams: No data is stored/cachedSecure: 100% standards-basedElastic: Scales out & handles data and app integration use cases

MetadataData

Databases On Prem Apps

Big Data

Cloud Apps and DataCloud-Based Designer,

Manager, Dashboard

Cloudplex

Groundplex

HadooplexSparkplex

Firewall

Page 9: SnapLogic Live: Big Data Integration

Discussion

snaplogic

Unified Platform Self-Service UX

Modern Architecture Connected: 350+ Snaps