Smart Data Webinar: Getting Started with Streaming Analytics and the IoT
-
Upload
dataversity -
Category
Technology
-
view
668 -
download
0
Transcript of Smart Data Webinar: Getting Started with Streaming Analytics and the IoT
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
April 14, 2016
Adrian Bowles, PhDFounder, STORM Insights, Inc.
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
“The Internet of Things is the new Industrial Revolution.”
Dr. John Bates, 11/17/2015
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
When everything is connected…New sources of data emergeNew sources of value emergeOld assumptions must be challenged
The Impact of the IOT
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
IOT enables
New technologiesNew modelsNew ecosystems
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Intelligence can be
Local to the deviceDistributedAggregated
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Streaming Solutions:On-Demand Access
Images courtesy of Wikipedia
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2014 by Umbrellium Ltd.
The data are there…
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Attributes of a Stream“You could not step twice into the same river.”
Heraclitus 535BC-474BC
To understand the contents (analyze)…Divert the flow?Pool the data?Evaluate everything without changing the flow?
(ask Heisenberg about that one) Sample? (catch and release?)
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Evolution of Data Management Solutions
Images courtesy of Wikipedia
Today:Delta Airlines processes 5,000,000 business events per dayPratt & Whitney jet engine: 5,000 sensors producing 10GB/s/per engine. Formula 1 car sensors produce about 1.2GB/s
and we need to predict the future…
Perform Operations on Data at Rest
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Speed
VolumeLow
High
High
StreamingData
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Conventional Data ArchitectureDa
ta S
ourc
es Store
Process/Transform
Key
Data Flows on the Edges, Queries on the Vertices
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Streaming Data ArchitectureDa
ta S
ourc
es Store
Process/Transform
Observe
Key
Data Flows on the Edges, Queries Everywhere
Sampling vs Monitoring Everything…
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
The Problem With Sampling…
440
880
440
880
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
The Problem With Sampling…
440
880
440
880
440
880
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Courtesy of STRIIM
The Open Source Ecosystem for Analytics Infrastructure
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
A Role for Collaboration and Standards
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
IoT Platforms
Predix
Jasper Control Center
Watson IoT
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Streaming Analytics
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Key Trend:Streaming Analytics for IOTas a Service
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Key Trend:Streaming Analytics for IOTas a Service
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Key Trend:Streaming Analytics for IOTas a Service
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Streaming Analytics - Emerging Vendors to Watch
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Data Sharpening (Zoomdata)
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Do you have or can you capture streaming data that can increase your value proposition?
Data about your product that can improve performance, reliability, predictability…
Can you create value from new analysis of open data? Adding your own data/algorithms to open data creates value.
Tip: Choose an infrastructure that allows you to evaluate live streaming data in the context of relevant historical data.
Getting Started…It’s All About the Data
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
What will you do with itto create value?
For more information:
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Twitter @ajbowlesSkype ajbowles
If you would like to connect on LinkedIn, please let me know that you that you found me via the Smart Data webinar series.
Upcoming Webinar Dates & Topics
May 12 Emerging Data Management Options: Graph Databases June 9 Advances in Natural Language Processing (NLP)
July Modern AI and The Future of Work (With Steve Ardire)