EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

19
EVENTS: INRIA Work Review Nov 18 th , 2002. Madrid.

Transcript of EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Page 1: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

EVENTS: INRIA Work Review

Nov 18th, 2002. Madrid.

Page 2: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Two Input Frames

Page 3: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Problems: Objects on Different Planes

Page 4: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Problem: Current Minimum Resolution is Triangle

Page 5: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Separate Objects on Different Planes

Page 6: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Approach

• Separate images into Background and Foreground objects

• Extension to Dynamic Scenes?

Page 7: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Scenario: Dynamic Scenes

• Fixed or static background

• Moving objects (i.e. players)

Page 8: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Scenario: Camera Motion

• What can be done with moving camera (rotations, zoom and focus changes)

12 xx H~ )(H R,Zf

Page 9: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Segmenting Player

Initial foreground

HH

Page 10: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Segmenting Player

Initial foreground

--

Page 11: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Segmenting Player

•Initial Foreground

•Corresponding Background

Page 12: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Segmenting Player

1 ... k ... N

statistics

Page 13: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Background

Page 14: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Advantages

• Segmentation of foreground objects

• Arbitrary foreground resolution can be handled

• Background model generated

Page 15: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Open Problems

• Different planes on background are still not segmented

• Real time?

Page 16: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Extension to Multiple Views

• Background interpolation need to be done only once

• Only foreground objects need to be interpolated

Page 17: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Synchronization of Stereo-Data

• Player Tracker – Modified Mean Shift

• Track positions are used to recovered 3D trajectories of players

• Novel curve registration framework

• Automatic

Page 18: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Conclusions

• Automatic Segmentation of foreground Objects

• Background model generation

• Synchronization of Stereo Data

Page 19: EVENTS: INRIA Work Review Nov 18 th, 2002. Madrid.

Publications

• From Video Sequence to Motion Panorama, IEEE Workshop on Visual Motion, Dec 5-6, Florida, USA.

• Indexing Key Positions between Multiple Videos, IEEE Workshop on Visual Motion, Dec 5-6, Florida, USA.