[WSO2Con EU 2017] Building Smart, Connected Products with WSO2 IoT Platform
[WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform
-
Upload
wso2-inc -
Category
Technology
-
view
141 -
download
3
Transcript of [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform
![Page 1: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/1.jpg)
Director - Solutions Architecture, WSO2
Open Interoperability of WSO2’sAnalytics Platform
Shiroshica Kulatilake
![Page 2: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/2.jpg)
Let’s Meet a Few Everyday Characters...
![Page 3: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/3.jpg)
● Senior Operations Manager at a sports equipment manufacturing factory
● Should○ Make sure floor operations are
complete○ Be aware of any outages in stocks ○ Project raw material needs○ Decide on improving efficiencies
● Uses○ Dashboards for monitoring
operations○ Email and SMS alerts for urgent
notifications
Agnes
Informed & Proactive
![Page 4: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/4.jpg)
Connected & Taken Care Of
Patrick● Retired School Master who’s had a fall apart from usual health concerns
● Requires to○ Know when his next appointment
will be in advance ○ Monitor daily blood sugar and
notify his doctor○ Get monthly prescription of
medicine
● Uses○ SMS alerts for appointment
reminders○ A connected device to measure
and view updates
Agnes
![Page 5: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/5.jpg)
David● Senior Business Executive who travels
frequently to meet business counterparts
● Needs information on○ Possible delays at the airport○ Average predicted waiting time before
boarding○ Changes to latest boarding gates
● Uses○ A travel application that provides a
personalized set of data ○ SMS and email notifications
Updated & Punctual
![Page 6: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/6.jpg)
What’s Common Among All of Them?
![Page 7: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/7.jpg)
They are Exposed to Relevant and Contextual data
![Page 8: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/8.jpg)
How has this been made possible ?
![Page 9: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/9.jpg)
They are Connected to a “System” that’s Driven by Analytics
![Page 10: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/10.jpg)
What Does this Mean?
![Page 11: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/11.jpg)
Analytics is part and parcel of your Life
Analytics is part and parcel of your Business
![Page 12: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/12.jpg)
Is this Aligned with what Analysts say?
![Page 13: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/13.jpg)
2018: 50% of large organizations will compete using Advanced Analytics
causing disruption in entire industries- - Gartner
2021: Insight Driven Businesses will earn $1.8 trillion - Forrester
The Big Data Tech Market will grow 3 times more than Overall Tech Market
- Forrester
![Page 14: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/14.jpg)
How is this relevant to YOU ?
![Page 15: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/15.jpg)
Your Business Provides such ‘Systems’ which are Driven by
Analytics
![Page 16: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/16.jpg)
What are the Prerequisites to do so?
![Page 17: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/17.jpg)
Your Business should have a State-of-the-art Analytics
Component
1
![Page 18: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/18.jpg)
This Analytics Component Should be Easy to Integrate and be
Interoperable
2
![Page 19: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/19.jpg)
• Key expectations from an analytics platform• Meeting those expectations with WSO2
technology• Interoperability in real-world use cases
Discussion Outline
![Page 20: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/20.jpg)
Identifying Your Expectations
![Page 21: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/21.jpg)
• To make better decisions– Operational and business monitoring
• Effectively communicate information– Visualization – Alerting mechanisms
• Offer new value propositions– Insight driven products and services
Business Perspective
![Page 22: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/22.jpg)
• Non-intrusive integration– Pull data from heterogeneous data sources and
analyze– Push results to existing flows with no
interruptions
• Intrusive integration– Receive input from multiple flows, systems and
sources of data– Push results to existing flows and systems
Solution Perspective
![Page 23: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/23.jpg)
• Interoperability in receiving data to analyze– Multiple protocols and formats– Pre-process before analyzing
• Interoperability in communicating results– Multiple protocols and formats
• Interoperability in data analysis– Integration with existing metadata and models– Extend with new analysis capabilities
Product Perspective
![Page 24: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/24.jpg)
Meeting Those Expectations
![Page 25: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/25.jpg)
Steps of an Analytics SolutionThe Typical Components
- Define data model- Specify Schema- Pick a protocol- Transform as needed- Ingest events
Analyze Data
- Select type of analysis needed
- Configure relevant analytics components
- Analyze received Events
- Define result schema definition
- Pick communication mode
- Communicate Results
Collect Data Communicate Results
![Page 26: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/26.jpg)
To Be “Interoperable,” Each Step Should Be Easy to Integrate
![Page 27: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/27.jpg)
Interoperability in Data ReceivingSupporting Multiple Transports and Formats
XMLJSONTextMap
Binary
Custom WSO2 Data Agent
JVM Based Systems
JMX Agent
File Systems
Log Agent
WSO2 Analytics
Event Receivers
WSO2 products
WSO2 Event Data Agent
WSO2 Enterprise Integrator
Publish Event Mediator
Connectors
...
Other Systems
Standard Protocols
Collect
![Page 28: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/28.jpg)
Interoperability in Data ReceivingPre-Process Incoming Data Before Analysis
JVM Based Systems
JMX Agent
File Systems
Log Agent
WSO2 Analytics
Receive and Transform
WSO2 products
WSO2 Event Data Agent
Other Systems
Standard Protocols
Custom WSO2 Data Agent
WSO2 Enterprise Integrator
Publish Event Mediator
Connectors
...
Collect
![Page 29: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/29.jpg)
File and Database
Interoperability in Data ReceivingPre-Process Incoming Data Before Analysis
WSO2 Analytics
Receive
WSO2 products
WSO2EventConnector
WSO2 Integration
Transform
Legacy SaaS products
Connectors
Other Systems
Standard Protocols
Publish Event Mediator
Connectors
...
Collect
![Page 30: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/30.jpg)
• Lookup metadata stores as Event Tables• Join event tables while processing• Update data stores while processing
Interoperability in Data AnalysisIntegration with Existing Data Stores
Analyze
![Page 31: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/31.jpg)
Interoperability in Data AnalysisIntegration with Existing Models
• Import prediction models in PMML form• Load prediction models and use these while
processing• Import Spark scripts for batch processing
Analyze
![Page 32: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/32.jpg)
Interoperability in Data AnalysisExtend Additional Analysis Capabilities
• Add new functional capabilities as extensions to the underlying processing engine
• Add the ability to run external scripts through integration extensions
Analyze
![Page 33: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/33.jpg)
Interoperability in Result CommunicationMultiple Transports & Formats, Alerting and Storage
Custom WSO2 Data publisher
RDBMS / Cassandra
Data store
JMS / Kafka message bus
JMS / Kafka
WSO2 Analytics
Event Publishers
Email Alerts / Notifications
SMTP server
WSO2 Enterprise Integrator
Proxy or http endpoint
Connectors
...
Communicate
![Page 34: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/34.jpg)
• Ability to build and deploy custom gadgets for existing dashboards
• Ability to integrate with third-party visualization tools
• Ability to integrate with third-party reporting tools
Interoperability in Result VisualizationIntegration with Existing Systems and Dashboards
Communicate
![Page 35: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/35.jpg)
A Peek into The Real World
![Page 36: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/36.jpg)
Use Case: “How Are My Patients Doing Today?”
• Interoperability in receiving data
• Interoperability through adapting to existing deployment pattern
![Page 37: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/37.jpg)
Use Case: “Would You Also Like to Order This?”
• Interoperability in receiving and communicating
• Interoperability through integrating with existing data stores
![Page 38: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/38.jpg)
Use Case: “Will I Be On Time For My Flight?”
• Interoperability through receiving data
• Interoperability through integrating with existing data stores
![Page 39: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/39.jpg)
Use Case: “Am I Subjected to Fraud?”
• Interoperability in the real-time engine to be used as an embedded library
![Page 40: [WSO2Con EU 2017] Open Interoperability of WSO2 Analytics Platform](https://reader034.fdocuments.us/reader034/viewer/2022051710/5a64907a7f8b9a27568b6891/html5/thumbnails/40.jpg)
Use Case: “Are We Lagging Behind in Ops?”
• Interoperability in data receiving through multiple formats and pre-processing
• Interoperability in building visualization extensions