1© 2015 The MathWorks, Inc.

Are you ready for AI?

Is AI ready for you?

Gareth Thomas

Technical Computing

Camp 2018

2

Alexa –

Write my TCC

keynote for me

3

Alexa –

Play soothing jazz

4

Source: Gartner, Real Truth of Artificial Intelligence by Whit Andrews

Presented at Gartner Data & Analytics Summit 2018, March 2018

5

Source: Gartner, Real Truth of Artificial Intelligence by Whit Andrews

Presented at Gartner Data & Analytics Summit 2018, March 2018

6

7

8

Artificial Intelligence

The capability of a machine to imitate

intelligent human behavior

9

Artificial Intelligence

The capability of a machine to match or exceed

intelligent human behavior

10

Artificial Intelligence Today

The capability of a machine to match or exceed

intelligent human behavior

by training a machine to learn the desired behavior

11

There are two ways to get a computer to do what you want

Traditional Programming

COMPUTER

Program

Output

Data

Program

Data

12

There are two ways to get a computer to do what you want

Machine Learning

COMPUTERProgram

Output

Data

13

There are two ways to get a computer to do what you want

Machine Learning

COMPUTERModel

Output

Data

Artificial Intelligence Machine Learning

14

Are you ready for AI?

Data

Model

Output

15

Are you ready for AI?

Data

Model

Output

16

Are you ready for AI?

Data

Model

Output

Access Data

Analyze Data

17

Are you ready for AI?

Data

Model

Output

Access Data

Analyze Data

Develop

Deploy

18

Are you ready for AI?

EVERYTHING

ELSE

Data

Model

Output

Access Data

Analyze Data

Develop

Deploy

19

Are you ready for AI?

DevelopAnalyze DataAccess Data Deploy

Data

Model

Output

AI model

Modeling &

simulation

Algorithm

development

20

Develop

AI model

Modeling &

simulation

Algorithm

development

Are you ready for AI?

Data

exploration

Preprocessing

Analyze Data

Domain-specific

algorithms

Sensors

Files

Access Data

Databases

Deploy

21

Are you ready for AI?

Develop

Data

exploration

Preprocessing

Analyze Data

Domain-specific

algorithms

Sensors

Files

Access Data

Databases

Desktop apps

Enterprise

systems

Deploy

Embedded

devices

AI model

Modeling &

simulation

Algorithm

development

22

Do you need AI?

23

24

AI for Predictive Maintenance

• Measure the wear of each robot

• Predict and fix failures before they happen

• AI handles uncertainty and variability

25

Are you ready for AI if …

You’ve never used machine learning?

26

27

What is crispiness?

Crispy

Crushing Sound

+Crispy Enough

Soggy

=Crushing Force

28

Replicating human perception with machine learning

Technical University of Munich

Feature extraction Classification

Crispy

Crispy enough

Soggy

Data

Machine Learning Workflow

29

Replicating human perception with machine learning

Technical University of Munich

Classification Learner

30

Fresh

Soggy

SoggyFresh

Tru

e C

las

s

Predicted Class

93%

91%

91%

91%

89%

95%

31

Are you ready for AI if you’ve never used machine learning?

No experience required

Use apps to try out all possible models

Use domain expertise and familiar tools to prepare data

32

Are you ready for AI if …

You can’t identify features in your data?

33

Use deep learning to identify features automatically

Feature extraction Classification

Crispy

Crispy enough

Soggy

Data

Machine Learning Workflow

34

Use deep learning to identify features automatically

Feature extraction Classification

Crispy

Crispy enough

Soggy

Data

Machine Learning Workflow

Crispy

Crispy enough

Soggy

Deep neural network

95%

3%

2%

..

.…

Data

Deep Learning Workflow

35

36

37

Traditional Approach

• Geologists assess seven different metrics

• Can take hours to analyze one site

• Critical shortage of geologists

New Approach

• Use deep learning to automatically

recognize metrics based on images

• On-site evaluators decide with support

from deep learning

38

Efficient tunnel drilling with deep learning

Obayashi Corporation

Label each

sub-image

Split into

sub-images

Image

Weathering

Alteration

(1-4)

Fracture

Spacing

(1-5)

Fracture

State

(1-5)

3 3 2

4 1 1

2 3 2

3 3 2

⋮ ⋮ ⋮ ⋮

39

Efficient tunnel drilling with deep learning

Obayashi Corporation

AlexNetPRETRAINED MODEL

Ice cream Teapot Goose

Transfer learning

Custom Network

40

MATLAB Production Server

Efficient tunnel drilling with deep learning

Obayashi Corporation

Weathering alteration: 4

Fracture spacing: 3

Fracture state: 2

AlexNetPRETRAINED MODEL

Ice cream Teapot Goose

Transfer learning

87%

69%

89%

Custom Network

41

Are you ready for AI if you can’t identify features in your data?

Deep learningDeep learning in 5 lines of code

nnet = alexnet;

cam = webcam;

picture = snapshot(cam);

picture = imresize(picture,[227 227]);

label = classify(nnet, picture)

42

Are you ready for AI if you can’t identify features in your data?

Deep learning

Transfer learning

43

Are you ready for AI if you can’t identify features in your data?

Deep learning

Transfer learning

Automation and AI to label data

Point cloud semantic segmentation

Classification

Car

Truck

Ground

Background

44

Are you ready for AI if you can’t identify features in your data?

Deep learning

Transfer learning

Automation and AI to label data

Point cloud semantic segmentation

Classification

Car

Truck

Ground

Background

45

Are you ready for AI if …

If you don’t have the right data?

46

AI for Predictive Maintenance

• Measure the wear of each blade

• Predict and fix failures before they happen

• Can’t rely on failures in the field

47

Predictive maintenance with synthetic failure data with

MATLAB & Simulink

Simulink model

48

Predictive maintenance with synthetic failure data with

MATLAB & Simulink

Measured data

Inject failures

Refine model

Simulink model

Failure data

Failure conditions

49

Are you ready for AI if you don’t have the right data?

Generate data with simulations

Simulation environment for

reinforcement learning

50

Low-carbon homes

• Generate power with fuel cell and solar panels

• Store power in battery

• Buy power when needed; sell when extra

• Record data on environment and energy usage

51

Low-carbon homes

• Generate power with fuel cell and solar panels

• Store power in battery

• Buy power when needed; sell when extra

• Record data on environment and energy usage

Goals

• Minimize energy cost

• Use EV battery for additional storage

52

Optimizing home energy management system

Denso

HomeHome Energy Controller

Battery

command

Generated and consumed power

Stored energy

53

Optimizing home energy management system

Denso

HomeHome Energy Controller

Battery

command

Generated and consumed power

Stored energy

Electricity prices

Predicted

vehicle use

¥

Simscape Power SystemsModel predictive control

Mixed integer linear programming

54

Optimizing home energy management system

Denso

Develop

Data

Parallel

computing

1000 CSV Files

Access Data Deploy

PreprocessingClassification

Learner

Analyze Data

55

Optimizing home energy management system

Denso

Develop

Data

Simulink

Control

algorithms

Deploy

Optimization

Embedded

devices

Classification

Learner

Simscape Power

Systems

Parallel

computing

1000 CSV Files

Access Data

Preprocessing

Analyze Data

56

Optimizing home energy management system

Denso

Develop

Data

Simulink

Control

algorithms

Parallel

computing

1000 CSV Files

Access Data Deploy

Optimization

Preprocessing Embedded

devices

Classification

Learner

Analyze Data

Simscape Power

Systems

“The effort would have taken significantly longer if we had

used disparate tools.

[MATLAB] enabled our team of domain experts, who

lacked formal training in data science, machine learning,

and parallel computing, to incorporate all these areas in

our design process.”

Akira Ito and Ryu Matsumoto

57

Autonomous

Primary

58

59

Autonomous

Primary

60

++

Host computer ProsthesisProcessing laptop

EMG

Drummer

Music

Exceeding human capabilities with a robotic drumming prosthesis

Georgia Tech Center for Music Technology

PID controller

AI algorithms

61

++

Host computer ProsthesisProcessing laptop

Microphone

EMG

Drummer

Music

Exceeding human capabilities with a robotic drumming prosthesis

Georgia Tech Center for Music Technology

PID controller

AI algorithms

62

63

Are you ready for AI if …

You’ve never used machine learning? Easy programming

Apps

Domain expertise to prepare data

64

Are you ready for AI if …

You’ve never used machine learning?

You can’t identify features in your data?

Easy programming

Apps

Domain expertise to prepare data

Deep learning identifies features for you

Transfer learning works with less data

Use AI to label data

65

Are you ready for AI if …

You’ve never used machine learning?

You can’t identify features in your data?

You don’t have the right data?

Easy programming

Apps

Domain expertise to prepare data

Deep learning identifies features for you

Transfer learning works with less data

Use AI to label data

Generate failure data with simulations

Simulate environment for reinforcement learning

66

With MATLAB and Simulink, you ARE ready for AI!

67