Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

41
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved. Getting Started with Streaming Analytics and the IoT April 14, 2016 Adrian Bowles, PhD Founder, STORM Insights, Inc. [email protected]

Transcript of Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Page 1: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started with Streaming Analytics and the IoT

April 14, 2016

Adrian Bowles, PhDFounder, STORM Insights, Inc.

[email protected]

Page 2: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started with Streaming Analytics and the IoT

Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions

Page 3: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started with Streaming Analytics and the IoT

Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions

Page 4: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

“The Internet of Things is the new Industrial Revolution.”

Dr. John Bates, 11/17/2015

Page 5: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

When everything is connected…New sources of data emergeNew sources of value emergeOld assumptions must be challenged

The Impact of the IOT

Page 6: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

IOT enables

New technologiesNew modelsNew ecosystems

Page 7: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Intelligence can be

Local to the deviceDistributedAggregated

Page 8: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

New Data, New Demands, New Opportunities!

Page 9: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

New Data, New Demands, New Opportunities!

Page 10: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

New Data, New Demands, New Opportunities!

Page 11: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

New Data, New Demands, New Opportunities!

Page 12: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Streaming Solutions:On-Demand Access

Images courtesy of Wikipedia

Page 13: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

New Data, New Demands, New Opportunities!

Page 14: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Copyright (c) 2014 by Umbrellium Ltd.

The data are there…

Page 15: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started with Streaming Analytics and the IoT

Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions

Page 16: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Attributes of a Stream“You could not step twice into the same river.”

Heraclitus 535BC-474BC

To understand the contents (analyze)…Divert the flow?Pool the data?Evaluate everything without changing the flow?

(ask Heisenberg about that one) Sample? (catch and release?)

Page 17: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Evolution of Data Management Solutions

Images courtesy of Wikipedia

Today:Delta Airlines processes 5,000,000 business events per dayPratt & Whitney jet engine: 5,000 sensors producing 10GB/s/per engine. Formula 1 car sensors produce about 1.2GB/s

and we need to predict the future…

Perform Operations on Data at Rest

Page 18: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Speed

VolumeLow

High

High

StreamingData

Page 19: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Conventional Data ArchitectureDa

ta S

ourc

es Store

Process/Transform

Key

Data Flows on the Edges, Queries on the Vertices

Page 20: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Streaming Data ArchitectureDa

ta S

ourc

es Store

Process/Transform

Observe

Key

Data Flows on the Edges, Queries Everywhere

Sampling vs Monitoring Everything…

Page 21: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

The Problem With Sampling…

440

880

440

880

Page 22: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

The Problem With Sampling…

440

880

440

880

440

880

Page 23: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started with Streaming Analytics and the IoT

Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions

Page 24: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Courtesy of STRIIM

The Open Source Ecosystem for Analytics Infrastructure

Page 25: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

A Role for Collaboration and Standards

Page 26: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started with Streaming Analytics and the IoT

Context - New Data, New Demands Streaming Analytics - What, and Why Now?Open Source StrategiesVendor Solutions

Page 27: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

IoT Platforms

Predix

Jasper Control Center

Watson IoT

Page 28: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Page 29: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Page 30: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Streaming Analytics

Page 31: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:Streaming Analytics for IOTas a Service

Page 32: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:Streaming Analytics for IOTas a Service

Page 33: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:Streaming Analytics for IOTas a Service

Page 34: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Streaming Analytics - Emerging Vendors to Watch

Page 35: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Page 36: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Page 37: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Page 38: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Data Sharpening (Zoomdata)

Page 39: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Do you have or can you capture streaming data that can increase your value proposition?

Data about your product that can improve performance, reliability, predictability…

Can you create value from new analysis of open data? Adding your own data/algorithms to open data creates value.

Tip: Choose an infrastructure that allows you to evaluate live streaming data in the context of relevant historical data.

Getting Started…It’s All About the Data

Page 40: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

What will you do with itto create value?

Page 41: Smart Data Webinar: Getting Started with Streaming Analytics and the IoT

For more information:

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

[email protected]

Twitter @ajbowlesSkype ajbowles

If you would like to connect on LinkedIn, please let me know that you that you found me via the Smart Data webinar series.

Upcoming Webinar Dates & Topics

May 12 Emerging Data Management Options: Graph Databases June 9 Advances in Natural Language Processing (NLP)

July Modern AI and The Future of Work (With Steve Ardire)