TIBCO Data Science Team July 2019 TIBCO Analytics Meetup · TIBCO Analytics Meetup opportunities to...
Transcript of TIBCO Data Science Team July 2019 TIBCO Analytics Meetup · TIBCO Analytics Meetup opportunities to...
TIBCO Analytics Meetup
July 2019
TIBCO Data Science Team
The following information is confidential information of TIBCO Software Inc. Use, duplication, transmission, or republication for any purpose without the prior written consent of TIBCO is expressly prohibited.
CONFIDENTIALITY
© Copyright 2000-2019 TIBCO Software Inc.
This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. This document is provided for informational purposes only and its contents are subject to change without notice. TIBCO makes no warranties, express or implied, in or relating to this document or any information in it, including, without limitation, that this document, or any information in it, is error-free or meets any conditions of merchantability or fitness for a particular purpose. This document may not be reproduced or transmitted in any form or by any means without our prior written permission.
The material provided is for informational purposes only, and should not be relied on in making a purchasing decision. The information is not a commitment, promise or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for our products remains at our sole discretion.
During the course of this presentation TIBCO or its representatives may make forward-looking statements regarding future events, TIBCO’s future results or our future financial performance. These statements are based on management’s current expectations. Although we believe that the expectations reflected in the forward-looking statements contained in this presentation are reasonable, these expectations or any of the forward-looking statements could prove to be incorrect and actual results or financial performance could differ materially from those stated herein. TIBCO does not undertake to update any forward-looking statement that may be made from time to time or on its behalf.
DISCLAIMER
© Copyright 2000-2019 TIBCO Software Inc.
4
TIBCO Analytics Meetupopportunities to learn and network
Meetup group keeps growing and now has 765+ members!
Join this TIBCO Analytics Meetup group and receive automatic invites to future TIBCO Analytics Meetups
And you’ll get the links to slides Youtube recordings!
http://www.meetup.com/TIBCOSpotfireOnlineusergroup/
https://bit.ly/2Jm4iOn
5
Agenda
• Welcome and TIBCO update by Michael O’Connell
• AutoML and Spotfire Data Function for TIBCO Data Science by Dan Rope
• Image Recognition Demo by Colin Gray
• TIBCO Community update by Heleen Snelting
• Live Q&A
Please submit your questions at any time via Q&A option
We will answer at the end or will get back to you via email
6
Analytics & Data Science
TIBCO Update
Michael O’ConnellChief Analytics Officer
7
TIBCO: Turn your data into innovation
Event-driven Applications
API-led Integration
InformationManagement
DataFabric
Data Science
AnalyticsAUGMENT
CONNECT UNIFY
8
Digital Transformation platform
Enterprise Application 1
Enterprise Application n
Streaming Sources
In-memoryData Grid
...
REPORTING/VIZDATA SCIENCEANALYTICS
Data Science(Model/Algo Dev)
Dashboards, Reports, Visualizations, etc
INFORMATION MANAGEMENT
Metadata (Data Governance, Data Catalog)
MDM/RDM
DATA OPERATIONS
Data Virtualization Master and Reference Data Management
Data Store 1 Data Store n EDW/Lake
Metadata
Master & Reference Data
Transactional Data
Legend
Powered by shared data assets
EVENTS
Streaming / Events
INTEGRATION
Hybrid Integration
APIManagement
Spark Compute & Store
9
Spotfire Analytics Experience
AugmentedAI-Powered Insights
Start in seconds, instant insights
AutomatedAutomagical Dataflows
Author & audit with automatically recorded dataflow steps
AgileReimagined User Interface
Agile exploration made even easier
AcceleratedReal-time Insights
Real-time awareness and action
© Copyright 2000-2019 TIBCO Software Inc.
10
We’ve been busy
CHICAGO DENVER SAN FRANCISCO
© Copyright 2000-2019 TIBCO Software Inc.
Blog - https://bit.ly/2OwRpYjnow.tibco.com Summary of presentation - https://bit.ly/322qG8q
11
Coming soon
WESTIN GALLERIA, HOUSTON, OCT 28-29
© Copyright 2000-2019 TIBCO Software Inc.
TIBCO ANALYTICS FORUM - analyticsforum.tibco.com
TIBCO NOW LONDON - now.tibco.com
12
SOM on Multivariate Seismic Data
© Copyright 2000-2019 TIBCO Software Inc.
13
GeoAnalytics – Current Well Spacing
© Copyright 2000-2019 TIBCO Software Inc.
14
GeoAnalytics – Petrophysical
15
GeoAnalytics – Current Well Spacing
© Copyright 2000-2019 TIBCO Software Inc.
16
GeoAnalytics – Optimal Drill Region
© Copyright 2000-2019 TIBCO Software Inc.
17
Today’s MeetupAutoML in TIBCO Data Science
Spotfire + AWS for Image Recognition
© Copyright 2000-2019 TIBCO Software Inc.
18
Real-Tim
e (BW
)
Data Sources
Data Marts
Streaming
Transactional Stores
External Sources
Manage
Execute
EDWs & Analytics
Sandboxes
TIBCO Data Science
Analytics Platform
Visual Analytics
TIBCO Spotfire
AP
Is and
Microservices
Operational Systems
TIBCO Live Apps
Con
tainers/
Cod
e
AWS Deployments
Federated Services
TIBCO Streaming
AWS SageMaker
TIBCO Flogo
Model Management
TIBCO Analytics and Amazon
ComputeDB
Visual UI / Notebook
Batch
(TIBC
O D
V)
Collaboration / Project Mgt
Automation
Spark
Python Boto3 SDK
Amazon Redshift
Amazon EMR
Amazon Simple Storage Service (S3)
© Copyright 2000-2019 TIBCO Software Inc.
SageMaker
19
Dan RopeDirector, Data Science
AutoML and Spotfire Data function for TIBCO Data Science - Demo
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
© Copyright 2000-2019 TIBCO Software Inc.
Automation and optimization of common steps to train a machine learning model
Efficiency for Data Scientists• Rapid start using auto-generated workflows
• Improve productivity by automating common steps
• Easily try feature engineering and ML algorithms
AutoML: Benefits
Self-Service for Citizen Data Scientists• Get started with feature engineering and ML faster
• Guidance on the best practices
• Rapidly try out different models
• Quickly explore wider range of use cases
Swap Logoif neededIn master slide
© Copyright 2000-2019 TIBCO Software Inc.
Automation and optimization of common steps to train a machine learning model
Algorithm Characteristics• Automatically generate features from the data via techniques used by data scientists• Automatically select candidate features for modeling• Automatically execute a variety of modeling algorithms with hyper-parameter search for ‘best’
performing model
Project Goals• Transparency: Visibility, modification, and collaboration across data science process• Scalability: AutoML execution in-db and at-scale• Understanding: Visual model interpretability & explainability
AutoML
Swap Logoif neededIn master slide
AutoML for TIBCO Data Science - Team StudioFoundation• New nodes: feature engineering--including
separate encoding nodes, variable selection and automated model selection
• Meta-learning step that determines how to engineer features and assemble the nodes into a workflow
• Workflow generation fully parameterized and ready-to-run, only need data source and target variable
Primary Differentiation• Lego blocks vs black box • Editable workflow allows for refinement and
optimization by a data scientist• Everything runs at-scale, in-database
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
Demo
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
Spotfire Data Function for TIBCO Data Science - Team Studio
© Copyright 2000-2019 TIBCO Software Inc.
• Spotfire data function that executes Team Studio workflows
• Data function input parameters supply Team Studio workflow variables
• Spotfire and Team Studio share the same big data source
• Support long running workflow executions
• Import of Team Studio ‘result tables’ as Spotfire data tables
• Available now on TIBCO Community Exchange
https://bit.ly/2GGraIl
25
Image Recognition with Spotfire, Python and AWS Rekognition - Demo
© Copyright 2000-2019 TIBCO Software Inc.
Colin GrayData Scientist
blog: https://bit.ly/2OyjqhU
26
Image recognition is the ability for machines to identify objects and patterns in imagery. The imagery could be photographs, satellite imagery, medical screens, video footage for example.
Machine Learning algorithms are taught to detect labels of interest, and then applied to new images.
Image Recognition
Sectors:
● Security and intelligence
● Medical and healthcare
● Retail
● Insurance
● Manufacturing
● Environmental and
agriculture
© Copyright 2000-2019 TIBCO Software Inc.
27
All the major cloud providers have pre built image recognition models:
• Amazon (AWS) - Rekognize• Microsoft (Azure) - Computer Vision API• Google Cloud - Vision AI
Possible to build your own custom models in Python, SageMaker (AWS) etc.
Image Recognition Models
© Copyright 2000-2019 TIBCO Software Inc.
28
TIBCO Community Update
© Copyright 2000-2019 TIBCO Software Inc.
Heleen SneltingDirector Data Science
Swap Logoif neededIn master slide
29
Spotfire Customer Success
https://www.linkedin.com/groups/12253057/
Get updates on new videos, Dr Spotfire Quick Tips Vlogs and more
Post your own Tips&Tricks as well
Reddit https://www.reddit.com/r/spotfire/
Facebookhttps://www.facebook.com/groups/651751391967838/
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
30
Spotfire Youtube
https://bit.ly/2fyknq6
Make sure to subscribe!
Includes the TIBCO Analytics Meetup recordings
And this new series: Dr. Spotfire Quick Tips - https://bit.ly/2Yuis64
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
31© Copyright 2000-2019 TIBCO Software Inc.
TIBCO Community the platform for our users! community.tibco.com
Swap Logoif neededIn master slide
32© Copyright 2000-2019 TIBCO Software Inc.
https://community.tibco.com/blog
Swap Logoif neededIn master slide
33
Learn: TIBCO Community Blog by Steven Hillion
https://bit.ly/2ZiPtU0
Get started NOW: Download on TIBCO Community Exchange
https://bit.ly/333A9gz
Get Involved: on TIBCO LABS
https://community.tibco.com/wiki/tibco-labs
AutoML: more info
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
34
TIBCO Community Exchangehttps://community.tibco.com/exchangeuse filters on page to help select items
© Copyright 2000-2019 TIBCO Software Inc.
https://bit.ly/2GGraIl
https://bit.ly/333A9gz
https://bit.ly/2EPx4Z8
Swap Logoif neededIn master slide
35
1. Guidance on getting access to your products and setting them up.
2. Recommendations and best practices for starting usage.
3. Awareness of the many additional resources available to help you and your
organization achieve your goals.
Spotfire Customer Orientation
https://community.tibco.com/wiki/tibco-spotfire-customer-orientation
© Copyright 2000-2019 TIBCO Software Inc.
Swap Logoif neededIn master slide
36
Dr. Spotfire - Hands-on with Analytics
© Copyright 2000-2019 TIBCO Software Inc.
● Free 30-minute webinar● For all Spotfire users ● Includes Feature Demonstration and User Q&A● Hosted by our top Data Scientists and Spotfire
Expertshttps://community.tibco.com/wiki/doctor-spotfire-office-hours
1st Tuesday of every month at 9AM PT
37
What’s new in… for example TIBCO Data Virtualization
https://community.tibco.com/wiki/whats-new-tibco-data-virtualization
Customer Orientation and Customer Success Center - ideal for on-boarding and staying up to date
https://community.tibco.com/wiki/tibco-spotfire-customer-orientation https://community.tibco.com/wiki/tibco-spotfire-customer-success-center
AI on Demand: Data Science in Operations - TIBCO Data Science latest work and Meetup Tour 2019
https://community.tibco.com/wiki/ai-demand-data-science-operations
Dr Spotfire
https://community.tibco.com/wiki/doctor-spotfire-office-hours
TIBCO Geo-Analytics capabilities
https://community.tibco.com/wiki/tibco-spotfire-location-analytics-mapping-geoanalytics-and-spatial-statistics
TIBCO Analytics Meetup pages with recordings and presentations
https://community.tibco.com/wiki/tibco-analytics-meetup
Data Literacy
https://community.tibco.com/wiki/data-literacy
Top TIBCO Community links to bookmark
© Copyright 2000-2019 TIBCO Software Inc. © Copyright 2000-2019 TIBCO Software Inc.
38
Questions & Contact
Thank you!Michael O’[email protected]
@MichOConnellH
Heleen Snelting [email protected]@HeleenSnelting
TIBCO Communitycommunity.tibco.com
TIBCO Exchangecommunity.tibco.com/exchange
Spotfire Trialspotfire.tibco.com/trial
© Copyright 2000-2019 TIBCO Software Inc.