FME Desktop Tutorial 2011: Introduction - FME Data Transformation
FME Server Meets the Challenge of Real-time
-
Upload
safe-software -
Category
Technology
-
view
229 -
download
5
description
Transcript of FME Server Meets the Challenge of Real-time
CONNECT. TRANSFORM. AUTOMATE.
FME Server Meets the Challenge of Real-Time
What Generates Real-Time Data?
Challenges of Real-Time Data
Data Volume
Amount of data to be
processed
Challenges of Real-Time Data
Data Velocity
Rate at which
Data isproduced
What is Real-Time Data?
Data is delivered for processing as it is collected.
2 Classifications
On-Demand Real-TimeComplex Event ProcessingLow Data Velocity, Low-Mid Data Volume
Notification Based Technology
Continuous Real-TimeContinuous stream of dataHigh Data Velocity, Low-High Data Volume
Dedicated Engine Technology
What is Real-time Analytics?
Dec
isio
ns
=+
Event Based Real-Time(Publishers/Triggers)
Amazon SQS
Java Messaging
Service(JMS)
UDPAmazon SNSWeb Sockets
EmailREST APIscheduler
Directory Watcher
TO
PIC
Notification Based Technology
Event Based Real-Time (Publishers/Triggers)
Amazon SQS
Amazon SNSWeb Sockets Email
REST API
scheduler
Directory Watcher
Java Messaging
Service(JMS)
UDP
Event Based Real-Time(Actions/Subscribers)
TO
PIC
Amazon SNS
Amazon SQS
Amazon S3
EmailFTP
Java Messaging
Service(JMS)REST APIWeb Sockets
Event Based Real-Time(Actions/Subscribers)
Amazon SNS
Amazon SQS
Amazon S3
FTPJava
MessagingService(JMS)
REST API
Web Sockets
Success Story
Fighting Australian Bushfires with FME Cloud
Fighting Australian Bushfires with FME Cloud
1. Mobile App sends location to FME Server via REST API
2. FME Server performs slope and vegetation analysis
3. FME Server sends information to Mobile App
Event Based Real-Time
DEMO
Stream Based Real-Time(High Velocity Data)
EngineData
Stream
Web SocketTCP/IP
TweetStreamerJMS
AmazonSQS
Engine
Engine
Engine dedicated to processing data stream
Engine for other servertasks
Engine for other servertasks
FME Server Engines
Dedicated Engine
Technology
Success Story – Pelmorex(The Weather Network)
Success Story – Pelmorex(The Weather Network)
8,000 lightning strikes/minute
Data Stream
TCP/IP
Rules determine when to generate
notifications
Google Earth
Update every20-30 seconds
Java Messaging
Service(JMS)
Engine
Stream Based Real-Time
Demo
Summary
2 Classifications of Real-Time data defined by:
Data Volume
Data Velocity
FME Server technology meets the needs of both
On-Demand Real-TimeComplex Event Processing
Continuous Real-Timehigh velocity data stream