How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance...

54
1 © 2015 The MathWorks, Inc. How to build an autonomous anything Jason Ghidella Simulink Platform Marketing Manager MathWorks

Transcript of How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance...

Page 1: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

1© 2015 The MathWorks, Inc.

How to build an autonomous anything

Jason Ghidella

Simulink Platform Marketing Manager

MathWorks

Page 2: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

2

Page 3: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

3

Page 4: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

4

Page 5: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

5

Page 6: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

6

Page 7: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

7

Page 8: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

8

Autonomous Technology

Page 9: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

9

Autonomous Technology

Having the power for self-governance

Page 10: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

10

Autonomous Technology

Provides the ability of a system to act

independently of direct human control

under unrehearsed conditions

Page 11: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

11

Page 12: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

12

Capabilities of an Autonomous System

Sense

Page 13: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

13

Capabilities of an Autonomous System

Sense

Perceive

Page 14: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

14

Capabilities of an Autonomous System

Learning Algorithms

Optimization

Sense

Perceive

Decide

& Plan

Page 15: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

15

Capabilities of an Autonomous System

Control Algorithms

Sense

Perceive

Decide

& Plan

Act

Page 16: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

16

Autonomous Technology Transfers Responsibility to Computers

Human

Computer

Resp

on

sib

ilit

y

Degree of Autonomy

Page 17: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

17

Bazille’s Studio

Bazille 1870Shuffleton’s Barbershop

Rockwell 1950

Page 18: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

18

Autonomous Artistic Style Classification

Rutgers University

Image

Feature

Extraction

Visual Features

Genre

Classifier

(SVM)

Artist

Classifier

(SVM)

Style

Classifier

(SVM)

Style:

Regionalism

Genre:

Interior

Artist:

Rockwell

Machine

Learning

Classification

Sense

Perceive

Decide

& Plan

Act

Page 19: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

19

Where to add autonomy with perception?

Analyze more data

Reduce bias

Reduce variability

Save time

Improve performance

Determine

Loudspeaker

Quality

Virtual Semiconductor

Manufacturing Calibration

Page 20: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

20

Where to add autonomy with perception?

Analyze more data

Reduce bias

Reduce variability

Save time

Improve performance

Page 21: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

21

Where to add autonomy with perception?

Analyze more data

Reduce bias

Reduce variability

Save time

Improve performance

Find out more:

딥러닝기반응용프로그램작성기법

엄준상과장 Joseph Eom

Track 2 13:10-13:40

Page 22: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

22

Page 23: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

23

Page 24: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

24

Page 25: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

25

Page 26: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

26

Autonomous Service for Predictive Maintenance

Which sensor values should they use?

Decide

& Plan

Act

Perceive

Sense

Pressure

Other

variables

Vibration Timing

Temperature

Page 27: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

27

Normal Operation Maintenance NeededMonitor Closely

Autonomous Service for Predictive Maintenance

Sense

Act

Perceive

Decide

& Plan

Page 28: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

28

What are the best predictors?

Data

Models

Jet Engine Monitoring

Name of Presenter

Time and Location

Page 29: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

29

What are the best predictors?

Data

Models

Jet Engine Monitoring

Find out more:

[고객사례](반도체분야)

MATLAB을이용한계측공정분석시스템구축

SK하이닉스

Track 2 15:40 – 16:10

Page 30: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

30

Autonomous Glucose Level Management

Page 31: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

31

Autonomous Glucose Level Management

Bigfoot Biomedical

Sense

Perceive

Decide

& Plan

Act

Continuous

Glucose Monitor

Target

Glucose

Level

+ -

Insulin PumpPerson

Page 32: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

32

Autonomous Glucose Level Management

Bigfoot Biomedical

Continuous

Glucose Monitor

Target

Glucose

Level

+ -

Insulin PumpPerson

+ +

Mobile App

Sense

Act

Perceive

Decide

& Plan

Page 33: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

33

Autonomous Glucose Level Management

Bigfoot Biomedical

Continuous

Glucose Monitor

Target

Glucose

Level

+ -

Insulin Pump

+ +

Mobile App

Sense

Act

Decide

& Plan

Perceive

Person

Virtual Lab

Simulink, Stateflow

Polyspace

Page 34: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

34

Autonomous Glucose Level Management

Bigfoot Biomedical

Continuous

Glucose Monitor

Target

Glucose

Level

+ -

Insulin Pump

+ +

Mobile App

Person

Perceive

Decide

& Plan

Act

Sense

Page 35: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

35

Autonomous Glucose Level Management

Bigfoot Biomedical

Continuous

Glucose Monitor

Target

Glucose

Level

+ -

Insulin Pump

+ +

Mobile App

Person

Perceive

Decide

& Plan

Act

Sense

Virtual Clinic

MATLAB, Toolboxes

Page 36: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

36

Virtual Clinic

Generating data through simulation

Page 37: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

37

Virtual Clinic

Scaling computations to simulate 50 million patients a day

Page 38: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

38

Where will you get your data?

Simulation

Public repositories

In the lab

In the field

Internet of Things (IoT)

Page 39: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

39

Where will you get your data?

Simulation

Public repositories

In the lab

In the field

Internet of Things (IoT)

Find out more:

[고객사례]통계및기계학습을이용한생체물리정보기반퇴행성신경계질환예측

(주)제이어스전진홍박사

Track 1 16:20 – 16:50

Page 40: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

40

CNH Develops Intelligent Filling System for Forage Harvesters

Page 41: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

41

Page 42: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

42

Autonomous Trailer Filling

Control Algorithms

Perceive

Act

Sense

Decide

& Plan

Page 43: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

43

Autonomous Trailer Filling

Control AlgorithmsAct

Decide

& Plan

Perceive

Sense

Page 44: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

44

Page 45: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

45

Autonomous Trailer Filling

Control Algorithms

3D Camera

Computer vision and

controls algorithms

• User Input

• Visualization

Embedded Platform

MPC5121e

CANActuators

ECUAct

Perceive

Decide

& Plan

Sense

Page 46: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

46

Autonomous Trailer Filling

Control AlgorithmsMonitoring

CANEmbedded Coder

3D Camera

Actuators

ECU

• User Input

• Visualization

• Computer

Vision

• Controls

Embedded Platform

MPC5121e

Act

Perceive

Decide

& Plan

Sense

Page 47: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

47

How will you put it into production?

Embedded Systems

IT Systems

Desktop Apps

Page 48: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

49

Page 49: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

50

Page 50: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

51

Page 51: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

52

How to build an autonomous anything

Focus on Perception

• Data-driven

• Model-driven

• Reduce to actionable data

• Take advantage of Big Data

• Use simulation to supplement available data

• Address the architecture

• Leverage Model-Based Design for embedded

• Automate integration with enterprise IT systems

• Look for autonomy in creative places

• Do more than manually possible

Use the Best Predictors

Get the Right Data

Flow to Production

Page 52: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

54

What is your

autonomous anything?

Page 53: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

55

MATLAB

Expo 2017

시간 일정

09:40-09:50 (10)환영사

매스웍스코리아이종민대표이사

09:50-10:20 (30)고객기조연설 : 제4차산업혁명과 MATLAB을통한대학교육의혁신

수원대학교이남식제2창학위원장

10:20-10:50 (30)MathWorks 기조연설 : How to Build an Autonomous Anything

Jason Ghidella 이사

10:50-11:20 (30)R2016b와 R2017a를 중심으로한새로운기능

이영준부장

11:20-11:40 (20) 휴식및부스관람

Track 1 Track 2 Track 3 Subtrack 1 Subtrack 2

신호처리, 컴퓨터비전그리고무선기술

엔지니어링데이터분석및애널리틱스솔루션

모델기반설계를통한임베디드시스템개발

Tech Talk Special 1 Tech Talk Special 2

11:40-12:10 (30)

컴퓨터비전의최신기술(Deep Learning, 3D Vision,

Embedded Vision)

빅데이터처리및머신러닝기법

다중센서기반자율시스템의모델기반설계및개발

김종남차장 엄준상과장 이제훈차장

12:10-13:10 (60) Lunch

13:10-13:40 (30)

위상배열레이더를위한시스템설계

딥러닝기반응용프로그램작성기법

[고객사례]Active Seat Belt

제어로직을이용한 AEB

제동시나리오승객거동해석

Simscape Power

Systems를이용한전력전자설계및시뮬레이션

MATLAB 라이브에디터소개

Rick Gentile 엄준상과장 현대모비스 강효석과장 송완빈대리13:40-13:50 (10)

13:50-14:20 (30)

[고객사례]신호분석시스템개발사례

엔터프라이즈시스템에서의빅데이터

애널리틱 애플리케이션구축을위한 MATLAB 기능

Simscape를이용한메케니컬설계와멀티도메인시뮬레이션통합

Polyspace제품군을활용한 MISRA C:2012

가이드라인및실행시간오류검사

Simulink를이용한손쉬운 AUTOSAR 코드

구현

LIG넥스원 성호현차장 강효석과장 유용출과장 김종헌부장

14:20-14:30 (10)

14:30-15:00 (30)

신호처리어플리케이션을위한전처리설계및특징추출

방법

Internet of Things(IoT) 를위한애널리틱개발및적용

고신뢰성시스템을위한모델기반설계에서의검증

Automated Driving

툴박스소개

비디오프로세싱서브시스템의설계및하드웨어타겟팅기법

Rick Gentile 성호현차장 이영준부장 이제훈차장 정승혁과장

15:00-15:40 (40) 휴식및부스관람

15:40-16:10 (30)5G 무선통신시스템설계

[고객사례](반도체분야)

MATLAB을이용한계측공정분석시스템구축

Simulink와 Embedded

Coder를이용한최적코드생성

김종남차장 SK하이닉스 김종헌부장

16:10-16:20 (10)

16:20-16:50 (30)

[고객사례]통계및기계학습을이용한생체물리정보기반퇴행성신경계질환예측

MATLAB 과 Simulink 기반병렬컴퓨팅기법

[고객사례]모델기반설계및AUTOSAR 적용한 BMS

솔루션개발

(주)제이어스전진홍박사 정승혁과장 LG화학조원태부장

16:50-17:00 (10) 경품추첨

Page 54: How to build an autonomous anything - MATLAB EXPO · Autonomous Service for Predictive Maintenance Which sensor values should they use? Decide & Plan Act Perceive Sense Pressure Other

56