SYSTEM ARCHITECTURE FOR INDEXING REGIONS IN KEYFRAMES

1
SYSTEM ARCHITECTURE FOR INDEXING REGIONS IN KEYFRAMES Xavier Giró and Ferran Marqués Goal Proposed solution  Keyframes Videos Presenter Head Body Hair Face Funded by: ●  Design an architecture capable of automatically index at the keyframe region-level the video asset of a content producer. ●  Plug-in for an existing Multimedia Asset Management (MAM) Multimedia Asset Manager (MAM) Partition BPT Visual descriptors Head Body Relations Semantic Perceptual + + + + - - - - Automatic Manual Content DB Knowledge DB Models DB Instances DB Index Keyword       Video ID Presenter  ID1, ID3, ID5 Crowd   ID2 Arts   ID4 Test Train Object parts Query by example Graphical User Interfaces (GUIs) Manual annotation Automatic Indexer plug-in Query by keyword Content ingest

Transcript of SYSTEM ARCHITECTURE FOR INDEXING REGIONS IN KEYFRAMES

Page 1: SYSTEM ARCHITECTURE FOR INDEXING REGIONS IN KEYFRAMES

SYSTEM ARCHITECTURE FOR INDEXING REGIONS IN KEYFRAMESXavier Giró and Ferran Marqués 

Goal

Proposed solution

 KeyframesVideos

Presenter

Head Body

HairFace

Funded by:

●  Design  an  architecture  capable  of  automatically  index  at  the  keyframe  region­level  the video asset of a content producer.● Plug­in for an existing Multimedia Asset Management (MAM) 

Multimedia Asset Manager (MAM)

Partition

BPT

Visual descriptors

Head Body

Relations

Semantic

Perceptual

++++

­­ ­­

Automatic

Manual

Content DB Knowledge DB Models DB Instances DB

IndexKeyword       Video ID

Presenter  ID1, ID3, ID5Crowd   ID2Arts   ID4

Test

Train

Object parts

Query by example

Graphical User Interfaces (GUIs)

Manual annotation

Automatic Indexer plug­in

Query by keywordContent ingest

Trajectories and Keyframes for Kinesthetic Teaching: A Human … · 2012-06-13 · Trajectories and Keyframes for Kinesthetic Teaching: A Human-Robot Interaction Perspective Baris

Trajectories and Keyframes for Kinesthetic Teaching: A Human … · 2012-06-13 · Trajectories and Keyframes for Kinesthetic Teaching: A Human-Robot Interaction Perspective Baris

INDEXING* INDEXING*

INDEXING* INDEXING*

Storytelling with smarter tools - adobe.com · keyframes within flexible, stretchable After Effects compositions to protect designated regions, such as intros or outros. Faster animation

Storytelling with smarter tools - adobe.com · keyframes within flexible, stretchable After Effects compositions to protect designated regions, such as intros or outros. Faster animation

Visual Attention Based Keyframes Extraction and Video Summarization

Visual Attention Based Keyframes Extraction and Video Summarization

Multidimensional Indexing: Spatial Data Management & High Dimensional Indexing.

Multidimensional Indexing: Spatial Data Management & High Dimensional Indexing.

New SPECIAL MACHINES 512 October 2019 · 2020. 2. 6. · Plain indexing head Universal indexing head Optical indexing head Methods of indexing Direct indexing Simple or plain indexing

New SPECIAL MACHINES 512 October 2019 · 2020. 2. 6. · Plain indexing head Universal indexing head Optical indexing head Methods of indexing Direct indexing Simple or plain indexing

cdn.borisfx.com › borisfx › store › silhouette › ... · Silhouette User Guide • • • • • • Table of Contents 5 • • • • • • Timebar Keyframes ...

cdn.borisfx.com › borisfx › store › silhouette › ... · Silhouette User Guide • • • • • • Table of Contents 5 • • • • • • Timebar Keyframes ...

File Storage and Indexing. File Organizations Indices Types of index Tree based indexing Hash based indexing.

File Storage and Indexing. File Organizations Indices Types of index Tree based indexing Hash based indexing.

hcc729.files.wordpress.com · Keyframes and Tweening | 201 In-betweening (or tweening): the process of generating the set of frames between two keyframes. The properties of each object

hcc729.files.wordpress.com · Keyframes and Tweening | 201 In-betweening (or tweening): the process of generating the set of frames between two keyframes. The properties of each object

Relocalization Using Virtual Keyframes For Online ...holl/pubs/Kim-2009-VRST.pdf · Permission to make digital or hard copies of part ... Instead of relying on real keyframes from

Relocalization Using Virtual Keyframes For Online ...holl/pubs/Kim-2009-VRST.pdf · Permission to make digital or hard copies of part ... Instead of relying on real keyframes from

Multidimensional Indexing: Spatial Data Management & High Dimensional Indexing

Multidimensional Indexing: Spatial Data Management & High Dimensional Indexing

Discrete Mechanical Interpolation of Keyframes · Discrete Mechanical Interpolation of Keyframes Thesis by Weiwei Yang In Partial Fulfillment of the Requirements for the Degree of

Discrete Mechanical Interpolation of Keyframes · Discrete Mechanical Interpolation of Keyframes Thesis by Weiwei Yang In Partial Fulfillment of the Requirements for the Degree of

Visual Summary of Egocentric Photostreams by Representative Keyframes (BSc Ricard Mestre)

Visual Summary of Egocentric Photostreams by Representative Keyframes (BSc Ricard Mestre)

The Timeline and Keyframes

The Timeline and Keyframes

File Processing - Indexing MVNC1 Indexing Jim Skon.

File Processing - Indexing MVNC1 Indexing Jim Skon.

FamilySearch Indexing: Indexing

FamilySearch Indexing: Indexing

Towards programmatic control of keyframes, example 1

Towards programmatic control of keyframes, example 1

Indexing and Active Fund Management: International Evidence...indexing and lower in countries with more closet indexing. Overall, our evidence suggests that explicit indexing improves

Indexing and Active Fund Management: International Evidence...indexing and lower in countries with more closet indexing. Overall, our evidence suggests that explicit indexing improves

Indexing regions in dihedral and dodecahedral hyperplane arrangements MAA Intermountain Sectional Meeting, March 23, 2007 Cathy Kriloff Idaho State University.

Indexing regions in dihedral and dodecahedral hyperplane arrangements MAA Intermountain Sectional Meeting, March 23, 2007 Cathy Kriloff Idaho State University.

arXiv:1702.02175v2 [cs.CV] 2 Mar 2017 · and keyframes to make optimization feasible in real-time. It marginalizes over older frames and keyframes to keep a consistent prior and uncertainty

arXiv:1702.02175v2 [cs.CV] 2 Mar 2017 · and keyframes to make optimization feasible in real-time. It marginalizes over older frames and keyframes to keep a consistent prior and uncertainty