Multimedia Database

1

TIV3033 Multimedia DatabasesGroup B

Name : Syamsul Bahrin ZaibonRoom : FTM 3124Phone : 04-928 4679Email :URL : http://www.uum.edu.my

Consultation Hour : Tuesday & Thursday 2.30 – 4.30 pm

2

INTRODUCTION TO MULTIMEDIA DATABASES

Chapter 1 – MMDB [Lynne Dunckley]

TIV3033 Multimedia DatabaseTopic 1

3http://www.uum.edu.my

So what is A Database?

http://www.uum.edu.my/


• Database describes a collection of data organized in a manner that allows access, retrieval and use of data.

• Database is an integration of different kind of data which is deeply concerned with the development of computers to store fast increasing data of the real world and utilize them communally with ease.



In any such system, the real-world objects which comprise its domain are directly represented through their properties and indirectly represented through their relationships to other real-world objects. • Text-based systems• Object-Oriented Systems• Multimedia Information Systems

Definition: Extracts from Dr. William I. Grosky



• All properties and relationships are presented in a textual format to the user

What is a Text-based systems



• Allow the representation of more complex properties such as• those which are set or sequence valued• those whose values are other objects

• Presents information in a textual format.

What is an Object-oriented systems



What is Multimedia information system ?

• There exist representations of objects which are not textually based. These representations consist of:• portions of images (static visual

representations of objects)• videos (dynamic visual representations

of objects)• audios (aural representations of objects)



When these representations are included in the domain of an information system, they can be used in two distinct fashion:•real-world objects themselves•user-recognizable surrogates for the real-world objects

What is Multimedia information system (ctd.)



There are 3 challenges that arise from mm data that do not occur with other data types:•size•time•The semantic nature of multimedia is more complex than for traditional data types

WHAT IS DIFFERENT ABOUT MM DATA?



Size

• To get an idea of media data object, consider that the storage of single good quality colored image could required 6MB

• So, data size will affect the storage, retrieval & transmission of mm

• Therefore, techniques that reduce the size of mm data without impacting on the information within the data are extremely important



Time

• The frames of the video must run in the correct sequence & at an acceptable rate

• The same is true of audio media• This relationship with time will have

significance for the way the media object are stored, retrieved, transmitted & synchronized

• This effect of time is often referred to as the real-time nature of MM



• It makes it difficult to identify components within the media that could be used for retrieval or transaction processing

• An apparently simple solution would be to add a description in words of the content of the image

• However, when we want to find a way to retrieve a specific image we find that a picture often means different things to different people

Semantic Nature



• For example, we have an image of the product as well as a description in text

• The context is important for interpreting the meaning of an image so that in db terms the application domain is even more significant than for traditional db

• In order to manage the semantic nature of the media, interpretations may need to be made based on certain features of the mm data and stored as metadata

Semantic Nature (ctd)



Key topics to be considered in MMDB

1. Data modeling issues for : images, Video, Hypermedia

2. Content-based indexing for images and video

3. Multimedia content indicators for browsing

4. Content-based browsing5. Various prototype databases:

image databases , video databases, hypermedia systems.



Types of media (1)

Text• Or documents, except keywords, a more

effective representation also includes: structure, layout, link, etc. (e.g., hypertext)

Image• Digital equivalents of drawings, partings,

photographs, or prints

Graphics • Concepts that allow the generation of

drawings and other images based on formal descriptions, programs or data structures



Types of media (2)

Audio • Considers temporal characteristics• A meaningful interpretation of audio data is based on

its relationship to a constantly progressing time scale, e.g., signal

Video• Integrates the properties of Audio and Image. In

addition to time dependency of audio data, Video has to reflect the time dependency of video stream, ie., the time-dependent sequencing of frames/images

• The time scale of a video is, like audio, an absolute one which associates each video frame with its correct interpretation at any point in time



Types of media (3)

Speech• Speech shares the properties of audio, but it also has its

unique properties of spoken natural language. Speech data could serve as an input for the retrieval of audio and speech data, or generated as a result of queries

• Using speech recognition system to translate speech to text is generated => large vocabulary, recognition error

• Recent progress on speech recognition allow the recognition of characteristic keywords, and the identification of specific speakers

Generated Media• Computer-generated presentations like animation and

music. Both can be seen as a special kind of continuous media if they’re generated in real time during presentation

• Animations are associated with a relative time scale (which can be distorted by speeding up/slowing down without affecting its meaning); with music it is similar, although the freedom of changing the time scale may be restricted



A Generic Architecture of MMDBMS

MM

DBMS

Media objects

Feature extraction

Compression

IndexingQuery feature construction

Feedback Query construction

Search Engine Users

query

feedback

results



MMDBMS Development

Major steps in developing MMDBMS1. Media acquisition:

collect media data from various sources, such as WWW, CD, TV, etc.

2. Media processing: extract media representations and their features,

including noise filtering, rending, etc.3. Media storage:

store the data and their features in the system based on application requirement.

4. Media organization: organize the features for retrieval. i.e., indexing the

features with effective structures.5. Media query processing:

Accommodated with indexing structure, efficient search algorithm with similarity function should be designed.



• Differences between traditional data modeling and time-based data modeling are: • Data Flow , Timing , Temporal Composition and

Synchronization • MMDB support for a BLOB (Binary Large

Object) data type has been added to most commercial database systems.

• Although a BLOB does allow the user to reference large data objects, a BLOB does not provide enough support for complex data types.

Modeling Issues in MMDBs



1. Multimedia Content Becomes More and More Popular

2. A database is something that holds and organizes data in a way that makes it easy to retrieve and allow a user to search for a particular record.

3. A multimedia database allows text, data, video, still image, dynamic image and audio to become integral parts of database management- and this is a consequence of information retrieval.

CONCLUSION


Multimedia Database

Documents

Transcript of Multimedia Database