Multimedia Databases Eran StillerOmer Gertel. Eran Stiller Omer GertelMultimedia Databases2 In this...

Multimedia Databases

Eran Stiller Omer Gertel

Eran Stiller Omer Gertel Multimedia Databases 2

In this presentation…

Introduction What is a Multimedia Database? Why do we need it?

Modeling Multimedia DatabasesDesign MethodologyModeling the WWW as a Multimedia Database WebSQL Using the Multimedia Design Methodology

Graphical extension to SQL: SQL+D


What is a Multimedia Database?

Multimedia Data-typesMovies, Pictures, Sound Clips, Documents

etc…

Advanced Querying Possibilities


Why Do We Need It?

Tremendous Amounts of

Digitized Multimedia ContentVideo servers, Ifilms, IMDB, AllMusic, etc…

Querying for Digitized Information “A Picture is Worth a Thousand Words”


The Leading Concept

Extracting Information from Multimedia Objects “On the Fly”

Creating a Design MethodologySimple, Intuitive, Upward CompatibleUnbound by Data-type, Application, Usage


Modeling Multimedia Databases

Using Object Relational Data ModelsData Description Language


Data Description Language

Example:Movie Database:

MOVIE(Title, Year, Director, Length)What About the Movie?

Add It to the DatabaseCreate Additional Functions



First Approach:Complex Type:

Create Type Movie_t(Title varchar(20),Year int,Director varchar(20),Length int,MV blob);

Create Table Movie of type Movie_t;



Second Approach:Extended Type:

Create Table Movies(

Title varchar(20),

Year int,

Director varchar(20),

Length int,

MV movie_blob);



ConcernsDistinguishing the Digitized Information

ConclusionNaming ConventionThe ‘Core’ Special Attribute



Example – Continued:A New Relation:

MOVIE(Title, Year, Director, Length, Core)What About Querying?

“Show the opening sequence of all movies directed by Spielberg in 1993.”



SQL-like Language:Select Movie.opening_seq

From Movie

Where Year=1993 AND Director=“Spielberg”;



SQL Solution:Declare External opening_seq(movie_blob)

Returns movie_blob

Language C;

Smart Interpreter


A Design Methodology

Core-ER Diagram

Core-ORDB schema


EntitiesAbstract EntitiesCore Entities

Core-ER Diagram


Core-ER Diagram

AttributesConventional AttributesUnconventional Attributes


Core-ER Diagram

MethodsCore as InputEntity as Input


Core-ER Diagram

Keys and RelationshipsExactly as in ER Diagrams


Core-ER Diagram

Example


CER to Core-ORDB Schema

We Need Rules For: Abstract Entities Core Entities Methods Relationships

Embedded ER Diagram

Keys Core Can Be a Key

Example


Employee(SSN, name, picture, position, salary, Dept)


EMail(EMailID, From, To, Date, Date R, Size, RespTo, Core)


Declare External Keyword(Email, string) Returns BOOLEAN<Function Definition>;


Has(SSN, EMailID)


Note: Core Can Be A Key!


A Design Methodology

ConclusionFull Upward CompatibilityAn Easy to Use Solution


Modeling the WWW

WebSQL

Using the Multimedia Design Methodology


WebSQL

SQL-Like Language

Minimal Relational Approach

Queries Based Both On The Content And On The Hypertext Structure Of The Web


WebSQL

Content Based QueriesDocument(url, title, text, type, length,

lastModify)


WebSQL

Example:Find All HTML Documents About

“Hypertext”Select D.url, D.title, D.length, D.lastModify

From Document D such that D mentions “Hypertext”

Where D.type = “text/html”;


WebSQL

Hypertext Structure Based QueriesDocument(url, title, text, type, length,

lastModify)Anchor(base, href, label)


WebSQL

Example:Find All Links to Applet from Documents

About “Java”Select Y.label, Y.href

From Document X such that X mentions “Java” Anchor Y such that base = X

Where Y.label contains “Applet”;


WebSQL

Hypertext Link Classification Interior () Local () Global ()

Empty Path (=)Path Regular Expressions Alternation ( | ) Repetition ( * ) Concatenation ( . )


WebSQL

Example:Select D.url, D.title

From Document D such that “http://www.cs.huji.ac.il” = | | .

D

Where D.title contains “database”


WebSQL

Example:Select X.url, X.title, Y.url, Y.title

From

Document X such that X mentions “Computer

Science”,

Document Y such that X = | | . Y;


Modeling the WWW

WebSQLAlready Implemented in JavaSpecific SolutionRefers Only To Documents


Multimedia Databases

We’ll Be Back, Right After The Break…


Modeling the WWW

WebSQLAlready Implemented in JavaSpecific SolutionRefers Only To Documents



Multimedia Design Methodology

EntitiesHTMLdoc(h_url, title, type, length,

lastModify, core)Links(l_url, label) Include(h_url, l_url)



MethodsContains(HTMLdoc.title, string)Reach_by(HTMLdoc.url, url_to, by_n,

l_type)Mentions(HTMLdoc, string)Linktype(HTMLdoc, url)



Example:Find All HTML Documents About

“Hypertext”Select HTMLdoc.h_url

From HTMLdoc

Where Contains(HTMLdoc.title, “Hypertext”);


Example:Find All Links to Applet from Documents

About “Java”Select Links.l_url

From HTMLdoc, Links, IncludeWhere mentions(HTMLdoc, “java”) AND

HTMLdoc.h_url = Include.h_url AND

Links.l_url = Include.l_url AND substring(“applet”, Links.label);




Example: Select Links.l_url

From HTMLdoc, Links, Include

Where substring(“database”, HTMLdoc.title) AND

HTMLdoc.h_url = Include.h_url AND

Links.l_url = Include.l_url AND

reach_by(“http://www.cs.huji.ac.il”, Links.l_url, 2, local);

Hint: We’ve seen it before…



Example: Select HTMLdoc.h_url, Links.l_url

From HTMLdoc, Links

Where mentions(HTMLdoc, “Computer Science”) AND

reach_by(HTMLdoc.h_url, Links.l_url, 2, local);



Simplified Model, But…

Complicated Real World

Taking Another Step



EntitiesHTMLdoc(h_url, title, type, length,

lastModify, core)WebObject(w_url, label, objectType,

interactive, core)Properties(position, size, props) Include(h_url, w_url, position, size, props)



Methods Contains(HTMLdoc.title, string) Reach_by(HTMLdoc.url, url_to, by_n, l_type) Mentions(HTMLdoc, string) Linktype(HTMLdoc, url)

And Additional Methods DisplayDoc(HTMLdoc) DisplayObj(WebObject, Properties.position,

Properties.size, Properties.props)



Example: List All Documents That Have a Video-Clip Or a

Picture Labeled “Sharon” Select HTMLdoc.h_url

From HTMLdoc, WebObject, Include

Where HTMLdoc.h_url = Include.h_url AND

WebObject.w_url = Include.w_url AND

(WebObject.objectType = “Image” OR

WebObject.objectType = “Video”) AND

WebObject.label = “Sharon”;



Still Not Complicated Enough…

The Last Step


Modeling the WWW

WebSQL Already Implemented in Java Specific Solution Refers Only To Documents

Using the Multimedia Design Methodology General Methodology Used Doesn’t Require a Special Web SQL-Like

Language Easily Expandable


SQL+D

Graphical Extension to SQL

Answering a Multimedia Database Query

Easier than Creating Specific Display Solutions

Display Specifications Are Included in the Query


SQL+D

Video Store DatabaseMovie(available, title, director, producer,

date, classification, rating, core, poster)

Movie_Actors(title, name, role)Actors(name, age, biography, picture)


SQL+D

List All Actors in “Gone With the Wind” with Their Pictures and Biographies Select MA.name, A.biography, A.picture

From Movie_Actors MA, Actors AWhere MA.title = “Gone With the Wind” AND

A.name = MA.nameDisplay Panel main, Panel info On main(east),With MA.name As list On main(west),

A.picture As image On info(north), A.biography As text On info(south);


SQL+D

Display All Action Movies and Their Posters, Allowing to Play the movie If Desired Select title, poster, core

From MovieWhere classification = “Action”Display Panel main, Panel b On main(east)With poster As image On main(west),

title As list On b(north), “Play” As button On b(south)

Trigger ‘mpegplay(‘+ core +’)’


SQL+D

Campus Map DatabaseCampus(campus_area,area_map)Building(building_name, building_picture,

campus_area, coordinates)Floor(building_name, floor, floor_map)Room(building_name, floor, room_name,

description, homepage, info, coordinates)


SQL+D

Show a Map of Main Campus With a List of the Buildings in it Select C.area_map, B.building_name

From Campus C, Building B

Where C.campus_area = “Main Campus”

Display Panel main

With B.building_name As list On main(east),

C.area_map As image On main(west);


SQL+D

Show a Map of Main Campus With a List of the Buildings in it Select C.area_map, B.building_name,

B.coordinatesFrom Campus C, Building BWhere C.campus_area = “Main Campus”Display Panel mainWith B.building_name As list On main(east),

C.area_map As image On main(west) All B.coordinates As polygon On

main(west);


SQL+D

Show a Map of Main Campus With a List of the Buildings in it Select C.area_map, B.building_name

From Campus C, Building BWhere C.campus_area = “Main Campus”Display Panel mainWith B.building_name As list On main(east)

Trigger ‘building_maps(‘+ building_name +’)’

C.area_map As image On main(west);


SQL+D

Where building_maps(input) is Select B.building_name, B.building_picture, F.floor

From Building B, Floor FWhere B.building_name = + input + AND

F.building_name = B.building_nameDisplay Panel main, Panel b On main(south)

With building_picture As image On main(north), building_name As title On main(north), All floor As button On b(east)

Trigger ‘floor_buildings( ‘+ building_name +’, ‘+ floor +’)’

“Select Floor To Visit” On b(west);


SQL+D

And floor_buildings(input1, input2) isSelect F.floor_map, R.floor, R.room_name,

R.info, R.homepage, R.coordinates

From Floor F, Room R

Where F.building_name = +input1+ AND

F.floor = +input2+ AND

R.floor = F.floor


SQL+D

And floor_buildings(input1, input2) is Display Panel main,

Panel b On main(west), Panel c On main(east),

With floor_map As image On c(north), All coordinates As poly On c(north), room_name As list On b(north), info As text On b(center), All Distinct floor As button On c(south)

Trigger floor_buildings(‘+building_name+’,‘+floor+’)’ homepage As button On b(south);


SQL+D

SQL-Like Queries

Application-Like Display Controller

Makes Most of Both WorldsSimple to UseUser Friendly Output


Conclusion

Multimedia Content Becomes More and More Popular

Correct Generic Models Bring Easy to Use Results

Clean, Simple Solutions Come From Extending the Existing Format


References

Chitta Baral, Graciela Gonzalez and Tran Son, “Conceptual Modeling and Quering in Multi-media Databases”, Department of CS, UTEP

Alberto O. Mendelzon, George A. Mihaila and Tova Milo, “Quering the World Wide Web”, University of Toronto and Tel-Aviv University, 1996

Chitta Baral, Graciela Gonzalez and Tran Son, “A Multimedia Display Extension to SQL: Language Design and Architecture”, Department of CS, UTEP, 1997

Chitta Baral, Graciela Gonzalez and Tran Son, “Issues in Querying Multimedia Databases”, Department of CS, UTEP

Isabel F. Cruz, Michael Averbuch, Wendy T. Lucas, Mellisa Radzyminski, Kirby Zhang, “Delaunay: a Database Visualization System”, Database Visualization Reaserch Group, Tufts University


Th…Th…That’s All Folks!

Multimedia Databases Eran StillerOmer Gertel. Eran Stiller Omer GertelMultimedia Databases2 In this...

Documents

Transcript of Multimedia Databases Eran StillerOmer Gertel. Eran Stiller Omer GertelMultimedia Databases2 In this...