Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ......

25
1 © 2015 The MathWorks, Inc. Computer Vision System Design

Transcript of Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ......

Page 1: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

1© 2015 The MathWorks, Inc.

Computer Vision System Design

Page 2: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

2

Computer Vision

Page 3: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

3

Computer Visionfor

Autonomous Systems

Page 4: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

4

Computer vision for autonomous systems

An increasingly important part of the pipeline

One of the key sensors in many applications is the camera

Other sensors also provide vision– Depth sensors– Infrared– LiDAR– RADAR

Page 5: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

5

More Sensors

Infrared Depth

Page 6: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

6

Multi sensor fusion

Page 7: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

7

Computer vision system design

Files

Databases

Sensors

ACCESS AND EXPLOREDATA

DEVELOP AND TESTALGORITHMS

Hardware-Accelerated Training

Parameter Tuning

Visualization

LABEL AND PREPROCESSDATA

Data Augmentation/ Transformation

Labeling Automation

Integrate Existing Research

INTEGRATE MODELS WITHSYSTEMS

Desktop Apps

Enterprise Scale Systems

Embedded Devices and Hardware

Page 8: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

8

Full System Design Example

Page 9: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

9

Original ImageOriginal Image

ROI detection

Pixel classification

Page 10: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

10

Semantic Segmentation

CamVid Dataset

1. Segmentation and Recognition Using Structure from Motion Point Clouds, ECCV 20082. Semantic Object Classes in Video: A High-Definition Ground Truth Database ,Pattern Recognition Letters

Page 11: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

11

Image Classification Network

Boat

Airplane

Other classes

Page 12: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

12

Semantic Segmentation Network

Page 13: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

13

Access and Explore Data

Page 14: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

14

Access image/video data

Page 15: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

15

Access pixel label data

Page 16: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

16

Label and Preprocess Data

Page 17: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

17

Using image labeling tools

Page 18: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

18

Develop and Test Algorithms

Page 19: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

19

Prepare the network for training

Page 20: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

20

Train and test the network

Page 21: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

21

Evaluate algorithm performance

Page 22: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

22

More evaluation

Page 23: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

23

Challenges we addressed

Accessing data

Labeling and preprocessing

Using previous research

Developing an algorithm

Evaluating the algorithm

What’s next?

Page 24: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

24

Computer vision system design

Files

Databases

Sensors

ACCESS AND EXPLOREDATA

DEVELOP AND TESTALGORITHMS

Hardware-Accelerated Training

Parameter Tuning

Visualization

LABEL AND PREPROCESSDATA

Data Augmentation/ Transformation

Labeling Automation

Integrate Existing Research

INTEGRATE MODELS WITHSYSTEMS

Desktop Apps

Enterprise Scale Systems

Embedded Devices and Hardware

Page 25: Computer Vision System Design - de.mathworks.com€¦ · Computer vision for autonomous systems ... ECCV 2008 2. Semantic Object Classes in Video: A High-Definition Ground Truth Database,Pattern

25© 2015 The MathWorks, Inc.