Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer...

25
1 CONFIDENTIAL | © 2014 The MathWorks, Inc. CONFIDENTIAL Signal Processing and Computer Vision Using MATLAB and Simulink Tabrez Khan Senior Application Engineer

Transcript of Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer...

Page 1: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

1 C ONFID E NTIA L | © 2014 The MathWorks, Inc. C O NFID ENTIAL

Signal Processing and Computer

Vision Using MATLAB and Simulink

Tabrez Khan

Senior Application Engineer

Page 2: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

2 C ONFID E NTIA L |

Agenda

Signal Processing & Measurement Workflow

Demos

– Signal Analysis and Filtering

– Image Denoising using Wavelets

What is Computer Vision?

Demos

– Object Detection and Tracking

• Face Detection and Tracking

• Multiple Object Tracking Framework

• Camera Calibration

Summary, Q&A

Page 3: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

3 C ONFID E NTIA L |

Signal Analysis and Measurement Workflow

Reporting and

Documentation

Outputs for Design

Deployment

Signal Analysis

& Measurement

Algorithm

Development

Application

Development

Files

Software

Hardware

Code & Applications

Page 4: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

4 C ONFID E NTIA L |

Reporting and

Documentation

Outputs for Design

Deployment

Share

Explore & Discover

Files

Software

Hardware

Access

Code & Applications

Automate

Reporting and

Documentation

Outputs for Design

Deployment

Signal Analysis

& Measurement

Algorithm

Development

Application

Development

Files

Software

Hardware

Code & Applications

Signal Analysis and Measurement in MATLAB

Page 5: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

5 C ONFID E NTIA L |

Signal Analysis, Processing, and Algorithms

Perform interactive signal processing – Make key signal measurements

– Perform time and frequency analysis

Design, visualize, and optimize filters

– Digital IIR and FIR filters

– Interactive design and analysis tools

Develop algorithms for signal processing – Signal transforms, multi-rate operations

– Statistical functions, linear prediction

Utilize MATLAB Apps – Signal Analysis (sptool)

– Filter Design and Analysis (fdatool)

– Window Design and Analysis (wintool)

Page 6: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

6 C ONFID E NTIA L |

Filter Design & Analysis with MATLAB

Design application-specific filters

Audio weighting, octave, and parametric equalizers

Pulse shaping, peak or notch, and multirate filters

Kalman, LMS adaptive, RLS adaptive filters

Implement filters with efficient architectures

Second-order sections, lattice wave digital filters

Multistage structures

Farrow filters

Analyze filter performance Compute cost in hardware

Estimate group delay

Visualize and overlay responses

Page 7: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

7 C ONFID E NTIA L |

Filter Analysis with MATLAB

Magnitude response

Phase response

Impulse response

Step response

Pole-zero plot

Group delay

Phase delay,

and more…

Page 8: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

8 C ONFID E NTIA L |

Demo – Image denoising using Wavelets

>> wavemenu

Denoising procedure:

– Compute transform coefficients

of noisy input

– Remove noisy components by an

appropriate thresholding method

– Compute inverse transform

Page 9: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

9 C ONFID E NTIA L |

System Toolboxes Enable System Design for

DSP, Comms, and Video Applications

DSP System Toolbox

Platform for Signal Processing System Design

Phased Array System Toolbox

Phase Array and Radar System Design

Communications System Toolbox

Communications System Design

Computer Vision System Toolbox

Image Processing and Computer Vision

Page 10: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

10 C ONFID E NTIA L |

What is Computer Vision ?

Page 11: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

11 C ONFID E NTIA L |

Examples of CV

Object Detection

Object Tracking

3D Vision

Page 12: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

12 C ONFID E NTIA L |

Tracking a Person’s Movements

Page 13: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

13 C ONFID E NTIA L |

Track a person’s movements

Page 14: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

14 C ONFID E NTIA L |

Workflow: Tracking a Person’s Movements

First detect

person/object

Use point tracking

algorithm to track

persons

movements from

frame-frame

Page 15: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

15 C ONFID E NTIA L |

Cascade Object Detection

Viola-Jones algorithm

Great for detecting

faces, eyes, noses

etc.

Detects categories of

objects

Page 16: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

16 C ONFID E NTIA L |

Summary: Tracking a Person’s Movement

Use cascade object detector to detect object categories

– Pre-trained detectors for faces, eyes, noses, torsos

Find features on detected objects

Track features using KLT point tracker

– vision.PointTracker

Page 17: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

17 C ONFID E NTIA L |

Typical Parts of a Computer Vision Algorithm

1. Image/video acquisition

2. Image/video pre-processing

3. Feature detection

4. Feature extraction

5. Feature matching

6. Using features

– Stabilization, mosaicking

– Object Detection, Tracking

7. Feature classification

Image Acquisition Toolbox

Statistics Toolbox

Image Processing Toolbox

Computer Vision

System Toolbox

Page 18: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

18 C ONFID E NTIA L |

Image Acquisition Toolbox

Acquire images and video directly into

MATLAB and Simulink

Configure device properties

Perform background acquisition

Synchronize multimodal devices

Configure, acquire, and preview live

video data using a graphical interface

Page 19: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

19 C ONFID E NTIA L |

Image Acquisition Toolbox Hardware Support

Industry standard support:

– Frame grabbers

Analog

Camera Link

– DCAM compatible FireWire (IIDC 1394)

– GigE Vision

– Common OS webcam interfaces

Operating system support:

– Windows

– Linux

– Macintosh

Page 20: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

20 C ONFID E NTIA L |

Image Acquisition Toolbox Hardware Support

Manufacturers include: – Allied Vision Technologies

– Basler

– Baumer

– DALSA

– FLIR

– Hamamatsu

– Lumenera

– Matrox Imaging

– National Instruments

– PixeLINK

– Point Grey

– Qimaging

– Sony

– And many more

See Supported Hardware Pages for more information

Page 21: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

21 C ONFID E NTIA L |

Image Processing Toolbox

Perform image processing, analysis, visualization, and algorithm development

Image analysis

Image enhancement

Spatial transformation

Image registration

Morphological operations

ROI-based processing

Image display and exploration

Page 22: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

22 C ONFID E NTIA L |

Computer Vision System Toolbox

Design and simulate computer vision

and video processing systems

Feature detection and extraction

Registration and stereo vision

Object detection and tracking

Motion estimation

Video processing, file I/O, display,

and graphic overlays

Page 23: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

23 C ONFID E NTIA L |

• Public trainings in various cities

• Standard or customized private training Public and Private

Trainings

• MathWorks Training Facility Bangalore

• Your place Flexible delivery

• MATLAB

• Simulink

• Stateflow

Introductory and Intermediate Courses on

• Signal Processing & Control Design

• Model Management and Verification Specialized and Advanced

Courses Including

• Over 25 courses on offer in India

• Customization to your team´s requirements possible

Training to Your Needs

www.mathworks.in/training

Code

Generation

Page 24: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

24 C ONFID E NTIA L |

Public Training Courses 2014 public training schedule is placed here.

No Start Date

Course Name

City

1 30th June

MATLAB and Simulink for Control Design Acceleration Bangalore

2 21st July MATLAB Fundamentals Bangalore

3 24th July Simulink for System and Algorithm Modeling Bangalore

4 02nd Sep Signal Processing with MATLAB Bangalore

5 04th Sep Image Processing with MATLAB Bangalore

6 18th Sep MATLAB to C with MATLAB Coder Bangalore

7 13th Nov Generating HDL Code from Simulink Bangalore

Page 25: Signal Processing and Computer Vision Using MATLAB · PDF fileSignal Processing and Computer Vision Using MATLAB and Simulink ... Develop algorithms for signal processing ... Specialized

25 C ONFID E NTIA L |

MathWorks India Contact Details

URL: http://www.mathworks.in

E-mail: [email protected]

Technical Support: www.mathworks.in/myservicerequests

Tel: +91-80-6632 6000

Fax: +91-80-6632 6010

• MathWorks India Private Limited 9th Floor, ‘B’ Wing, Etamin Block Prestige Technology Park II Marathahalli – Sarjapur Ring Road Bangalore - – 560103, Karnataka India

Thank You for Attending

Talk to Us – We are Happy to Support You