SnapLogic Live: Big Data Integration
-
Upload
snaplogic -
Category
Data & Analytics
-
view
246 -
download
6
Transcript of SnapLogic Live: Big Data Integration
SnapLogic Live: Big Data Integration
Welcome to SnapLogic Live
In 30 minutes we’ll:• Review specific topics and the role SnapLogic plays• Dive into demonstrations of our Elastic Integration
Platform• Open it up for questions and discussion
Today’s featured presenter: Rich Dill
Today’s featured topic: Big Data Integration
Anythingapps | APIs | things | data
SnapLogic: Unified Platform for Data and Application Integration
Anytime batch | streaming | real-
time
Anywhereon premises | in the cloud
Common SnapLogic Elastic Integration Use Cases
Hybrid Application Integration
Cloud Data Warehouse/An
alytics
Big Data Ingest-
Transform-Deliver
RESTful
Retire Legacy Integration Platforms
z
Data Acquisition
Data Access
z
Data Management
Add information and improve
data
SparkPythonScalaJava
RPig
Collect and integrate data from multiple sources
HDFSAWS S3
MS Azure Blob
On Prem Apps and
Data• ERP• CRM• RDBMS
Cloud Apps and Data• CRM• HCM• Social
IoT Data• Sensors• Wearable
s• Devices
LakeshoreData Mart• MS Azure• AWS
Redshift
BI / Analytics
• Tableau• MS
PowerBI / Azure
• AWS QuickSight
Organize and prepare
data for visualizatio
n
HDFSAWS S3
MS Azure BlobHive
Batch
Streaming
Schedule and manage: Oozie, Ambari
Kafka, Sqoop, Flume
Real-time
Impala, HiveSQL, SparkSQL
Data Lake Components without SnapLogic
z
Data Acquisition
Data Access
z
Data Management
The Modern Data LakePowered by SnapLogic
On Prem Apps and
Data• ERP• CRM• RDBMS
Cloud Apps and Data• CRM• HCM• Social
IoT Data
• Sensors• Wearable
s• Devices
LakeshoreData Mart• MS Azure• AWS
Redshift
BI / Analytics• Tableau• MS
PowerBI / Azure
• AWS QuickSight
Batch
Streaming
Schedule and manage: SnapLogic
Real-time
Sort,Aggregate,Join, Merge,Transform
SnapLogicabstracts and
operationalizes with
SnapReduce or Spark pipelines
Collect and integrate data from multiple sources
SnapLogicpipelines with
standard mode
execution
Organize and prepare
data for visualizatio
n
SnapLogicpipelines with
standard mode
execution
Pipeline
Pipeline
Pipeline
Pipeline
Pipeline
SnapLogic and the Data Lake
SnapLogic’s Modern Architecture: Hybrid and ElasticStreams: No data is stored/cachedSecure: 100% standards-basedElastic: Scales out & handles data and app integration use cases
MetadataData
Databases On Prem Apps
Big Data
Cloud Apps and DataCloud-Based Designer,
Manager, Dashboard
Cloudplex
Groundplex
HadooplexSparkplex
Firewall
Demonstration:Snaplogic.com/live
Discussion
snaplogic
Unified Platform Self-Service UX
Modern Architecture Connected: 350+ Snaps