Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson...

29
Access to IBM Cloud AI through the Mendix - IBM Partnership Zdravko Angelov AI & Cloud @IBM Financial Services & Government [ Conclusion BAM MeetUp, 18-09-2018 ]

Transcript of Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson...

Page 1: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Access to IBM Cloud AIthroughthe Mendix - IBM Partnership

Zdravko AngelovAI & Cloud @IBMFinancial Services & Government

[ Conclusion BAM MeetUp, 18-09-2018 ]

Page 2: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Smart Apps – The New Application Wave

Make your apps intelligent, contextual, and proactive

IntelligentAlgorithms &

Big Data

Context-AwareIOT, Sensor & Device Data

ProactivePush Notifications

to Drive Action

Page 3: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

The role of the smart app and Mendix with IBM Cloud.

3

Cloud InfrastructureA highly scalable, security enabled infrastructure

DataTools to prepare data for cognitive

AICognitive building blocks for developers

Applications, solutions and servicesTargeted solutions for enterprise businesses

Ingestion

Conversation

Storage Analytics Deployment Governance

Visual Recognition

Discovery

Speech

Compare and Comply

Document Conversion

DLaaS

Nat Language Understanding

Nat Language Classifier

ToneAnalyzer

PersonalInsight

…more

Cloud Integration

Networking Compute Security CognitiveSystems

Virtual Servers …moreObject

Storage

Cognitive Micro-services DevOps Tooling

WatsonIoT

Services

Mobile Services

Weather & …more

Public Hybrid Private

Connectors

DevicesAPIsMobile &

Web Apps

Mendix Platform (Low Code)

Cloud Apps (Web, APIs)

Mobile Foundation

Page 4: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

AI and ML on IBM Cloud

4

Model Lifecycle Management

Machine Learning Runtimes Deep Learning Runtimes

Authoring Tools

Cloud Infrastructure as a Service

2. Data Exploration1. AI Components

Page 5: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Mendix and IBM support the entire app lifecycle of a low code app

Bring Biz & IT Together

• Low Code / No Code environment• Social collaboration• Agile Project management • Feedback management

Create Apps 10X Faster

• Any device, any channel• Easily integrate with any existing

systems, services and data sources • Application Lifecycle Management

Easy Deployment to IBM Cloud

• Cloud-native• DevOps• Monitoring

Governance & Control

• Open, extensible, portable• Quality Management• Enterprise-grade Security

Page 6: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

The Role of the Smart App

Behavior

Decisions

Mendix for Algorithmic

Business

MX Watson ML Plugin

Core platform servicesDeploymentResource managementMonitoringBig Data

Elastic scalingBackup managementAudit managementAutomation

Mobile DevicesWeb API’s

Smart App

InsightsContext

Connectors

Analytics

EventsSubscribe

Devices

Mendix for IoT

MX IBM IoTPlugin

Page 7: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

IBM Cloud integration

• Mendix Apps run on both Cloud Foundry and Kubernetes.

• Have autoscaling support

• Running on Public, Dedicated and Private cloud

• Fully integrated with IBM Toolchain and Delivery pipeline.

https://www.mendix.com/blog/new-mendix-support-kubernetes-brings-choice-control/

Page 8: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Low-code development as a native feature of IBM Cloud• From each starter kit

category (Web, Mobile, Watson) it will be possible to start a Low-code project delivered by Mendix Platform

Page 9: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

IBM Service integration for Mobile and Watson

• Mendix Connectors for • SSO using APPID• IBM Analytics• IBM Gateway• Watson services• Push Notifications• …..

Page 10: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Fully integrated with Mendix Cloud

• The IBM Cloud is fully integrated within the Mendix Development portal.

• Allow you to start new project which automatically will run on IBM Cloud

• Have 1 click deployment capability for your app.

Page 11: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

11

Mendix customers are building…

Innovation Apps

Smart Apps (IoT, AI)

Rapid Experimentation

New Products New Channels

Operational Efficiency Apps

B2E Apps Workflow / Case Mgmt.

Compliance & Quality

Mgmt.

Departmental Apps

Legacy Migration Apps

Lotus Notes

Access / Excel Replacement

4GL Apps

Core System Extensions

Customer Engagement Apps

B2B Portals B2B Apps

B2C Portals B2C Apps

Page 12: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Erie Insurance using Mendix with Watson.

Reducing the learning curve for new underwritersIntelligent knowledge base for junior underwriters to learn faster

Easy access for rapid autonomyDeveloped by autonomous team without the help of IT with the Help of Mendix with drag and drop Watson integration

https://www.ibm.com/blogs/internet-of-things/underwriters-tap-value/

12

Page 13: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

- Push Notification- Secure Gateway- Mobile Foundation Servicer

Mendix Modeling Integrations

- Watson Services- Weather Company Data- APP ID- Mobile Analytics- IBM UI - App Launch

13

Page 14: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Starter Kits

14

1. Web2. Mobile3. Web & Mobile with Watson

Page 15: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Getting Started …

Page 16: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

AI and ML on IBM Cloud

16

Model Lifecycle Management

Machine Learning Runtimes Deep Learning Runtimes

Authoring Tools

Cloud Infrastructure as a Service

2. Data Exploration1. AI Components

Page 17: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

3

Watson Studio

Open Source tools – Jupyter and RStudio

Watson Visual Recognition – retrain Watson

Elastic and customizable compute environments

Create ML flows and design Neural Networks visually

Page 18: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

3

Watson Machine LearningSimplifying deployment & management of ML models in production apps

Train neural networks in parallel across NVIDIA GPUs. Pay only for what you use. Auto-deallocation means no more remembering to shutdown your cloud training instances.

Monitor batch training experiments then compare cross-model performance without worrying about log transfers and scripts to visualize results. You focus on designing your neural networks. We’ll manage and track your assets.

Python client, command line interface (CLI) or UI? You choose the tooling that best fits your existing workflows. Training history and assets are tracked then automatically transferred to the customer’s Object Storage for quick access.

Deploy models into production then monitor them to evaluate performance. Capture new data for continuous learning and retrain models so they continually adapt to changing conditions.

Page 19: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

19

Watson AI ServicesAll accessible through the “Light” (Free) subscription for IBM Cloud

Page 20: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition is An image recognitionservice that enables users to quickly and accurately tag, classify, and train visual content using machine learning.

BASILLEAFHERBPLANT STEM

GREEN

What is Watson Visual Recognition?

Page 21: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition focuses on

AssessmentWatson Visual Recognition assesses for better problem-solving.

What is Watson Visual Recognition?

IdentificationWatson Visual Recognition identifies objects and people.

CategorizationWatson Visual Recognition categorizes for easy organization.

RecommendationWatson Visual Recognition recommends for faster decision-making.

hatchbackcompact carvehicleclaret red color

vintage

modern

Fender bender, 87% confident

Historically, we’ve paid $7,500 for similar types of damage

Page 22: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition is trained onWhat is Watson Visual Recognition?

General Faces Custom

Food Text Explicit

Quickly understand the contents, scenes, and actions within an image.

Locate faces within an image and receive age and gender estimates.

Determine if an image contains inappropriate content that may be unsuitable for general audiences.

Train Watson to understand and classify your own custom content.

Recognize foods and meals with enhanced accuracy.

Extract full words from natural scene images (i.e. billboards, street signs)

Page 23: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition providesWhat is Watson Visual Recognition?

Tooling and API

We provide an API to make building apps easy in your preferred language.

Not a developer? No problem! Use our Watson Studio tooling to create, evaluate, and manage your custom models and test our prebuilt one.

Privacy and Security

IBM ensures that images and data passed through our services remain secure. Your data is never used to train IBM models.

Accessibility and flexibility

Whether you’re looking to get started right away with IBM’s models or custom train your own, we offer options for every user.

You can even build apps that leverage Watson models on iOS devices with Core ML, even when offline.

Page 24: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition is used forHow is Watson Visual Recognition used?

Visual InspectionsAn Insurance company builds an image recognition solution to automate visual inspections for damage, defects, and quality assurance.

Resource IdentificationA Mining & Minerals company uses image recognition to automatically identify assets and sites in satellite imagery.

Social Media ListeningAn Advertising agency analyzes visual content in social media posts to understand content, sentiment, and trends.

Content EnrichmentA Media company uses image recognition to automatically append metadata to visual content, turning dark data into searchable content.

DemographicsA Retailer uses face detection capabilities to gather age and gender estimates of its shoppers.

Calorie CountingA Health & Nutrition company automatically identifies foods and meals in order to more quickly return nutrition facts.

Page 25: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Available today:• Watson Visual Recognition for Core ML

• Watson SDK for Core ML

• Watson Studio + Watson Visual Recognition

• Starter Kits & Code Patterns

Watson Visual Recognition is used for Core ML

How is Watson Visual Recognition used?

Page 26: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition is used byWho is using Watson Visual Recognition?

One of tennis’ biggest tournaments, the US Open used Watson to identify exciting moments in a match. Watson was trained on players performing actions that typically mark an exciting moment - celebrating, waving to the crowd, fist pumps, etc.

The number three player in the Brazilian market, Volkswagen Brasiluses Watson Visual Recognition to enable their application to recognize up to 30 lights from the car’s dashboard. As a result, customers can easily take a picture of a light on their dashboard (e.g., the gas light or ABS light) and send it through the app for a quick explanation of the light’s meaning and a recommendation for how to address it.

One of the largest soft drink providers, Coca-Cola is testing Watson Services for Core ML to see if it helps its field technicians better inspect vending machines.

Page 27: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Watson Visual Recognition is used byWho is using Watson Visual Recognition?

Netherlands-based drone manufacturer Aerialtronics uses Watson Visual Recognition to automate aerial visual inspections, speeding up the process while reducing cost and increasing safety.

Digital development company BlueChasm uses Watson Visual Recognition to analyze video data streams and recognize specific objects, themes, or events—converting a simple video camera into an intelligent analytics tool.

‘Music’s Biggest Night’, The Grammy Awards uses Watson Visual Recognition to analyze hours of video and close to 125,000 photographs taken during the red carpet show.

Page 28: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

Use caseWho is using Watson Visual Recognition?

Company DescriptionBased in London, Belron S.A. provides vehicle glass repair and replacement services to 15 million consumers annually, generating revenue of EUR 3.3 billion in 2016 and employing some 26,300 people across 35 countries. Belronoperates through more than 10 major brands, including Carglass, Safelite and Autoglass.

Belron uses Watson Visual Recognition to automatically generate estimates of repair costs based on customer-provided images of superficial car damage.

Business SolutionWorking with IBM, Belron built the world’s first automated vehicle body damage assessment and quote generation system. Using the IBM Watson Visual Recognition service, the system analyzes the photos that customers upload when they submit a body damage claim, applying the same classification logic as Belron’s highly experienced damage assessment advisors, or DAs. By using trained algorithms to recognize the extent of the damage (e.g. Is it a scratch, a minor dent or a major dent? What kind of technician would be needed to fix it?) the system creates a process flow that, in the right situations, cuts the DA review stage out and goes straight to payment.

Business Benefits• Shortens the claims cycle for certain damage

assessments by more than 95 percent• Enriches client experience through

personalized conversation flows and real-time answers

• Enables damage assessment advisors to focus on more complex damage claims

Page 29: Access to IBM Cloud AI - Conclusion BAM...Watson Visual Recognition is trained on What is Watson Visual Recognition? General Faces Custom Food Text Explicit Quickly understand the

IBM Watson