An Introduction to VIDEO SUMMARIZATION

- VIDEO SUMMARIZATION Video 2011-2012

1 2011-2012 ; .

;Dynamic video skimming : - video trailer Static video summary: - storyboard

- Key frames2 2011-2012 ;

Browsing (Searching) video.

Retrieval video, , videos .

Indexing video.

3 2011-2012

New Indians. ..4 2011-2012 storyboard:

:

: , ...5 2011-2012 (scene) ,

(shot) ,

(key frame) /

6 2011-2012

7 2011-2012 (1)Cut frame frame .Fade ( ) frame, (fade-in) (fade-out) , frame.

8 2011-2012 (2)Dissolve fade-out fade-in () . .Wipe frame frame . http://www.mediacollege.com/video/editing/transition/types.html

9 2011-2012 - Sampling based

- Shot based

Clustering

(.. X VANTAGE points)

: : : 1 10 2011-2012 : HSV ?- - ! HSV ?- - MPEG7Hue Saturation ( ) Value

2011-201211 ...12 2011-2012

- Sampling based

- Shot based

Clustering

(.. X VANTAGE points)

13 2011-2012 & (Shot based)

14 2011-2012 (1)

15 2011-2012 (2)

16 2011-2012 (3) : ? cut?

: ?Bin size? ?17 2011-2012 (4)

E 1

1 .18 2011-2012 (5):

cut

19 2011-2012

20 2011-2012 (1) ( )

21 2011-2012 (2)

22 2011-2012 (3)iii+1i-1 d23 2011-2012 (4)

24 2011-2012 (5)

. 1 .

25 2011-2012 (6):

dissolve

26 2011-2012Shot based 2011-201227... - Sampling based

- Shot based

Clustering

(.. X VANTAGE points)

28 2011-2012 - Clustering 2011-201229

- Clustering 2011-201230

(Clustering): . - - . . 2011-201231 :

: VISTO

2011-201232 pre-sampling, .

Vsual STOryboard 2011-201233

storyboard ! !VIsual Sryboard (1) 1. HSV

2. -, s, z Generalized Jaccard Distance : 2011-201234

VIsual Sryboard (2)B 3. , , . key frame.

? ?

2011-201235VIsual Sryboard (3) : .

Furthest Point First :- = - ) ) 2011-201236 ..VIsual Sryboard (4) : . . . . ??

2011-201237VIsual Sryboard (5) :- 1 10- - - = key frame 2011-201238 key frames storyboard VIsual Sryboard (5) 4. - storyboard - Post Processing

- key frames , .. fade

5. storyboard- Mean Opinion Score20 , 1(bad) 5 (excellent) 2011-201239 - Sampling based

- Shot based

Clustering

- X VANTAGE points

40 2011-2012 Vantage Points

D.Besiris, N.Laskaris, F.Fotopoulou and G.Economou, Key frame extraction in video sequences: a vantage points approach, 2007 International Workshop on Multimedia Signal, pp. 434-437, Crete 2007

41 2011-2012Vantage points (1) .E , . .42 2011-2012Vantage points (2)

43 2011-2012Vantage points (3) : 1 key frame vector median ( )2 key frame vector median key frame 2 key frames key frame -1 key frames : 44 2011-2012Vantage points (4) ?

...

! 2 key frames!45 2011-2012 (1)1. .. Mean Opinion Score

2. 2.1 (Fidelity)2.2 (Compression Ratio)

46 2011-2012 (2) (Fidelity)

j : key-frameij : framedij : i j !47 2011-2012 (3) (Compression Ratio)NKF : key framesNF : frames

!48 2011-2012 ! ! 2011-201249