Project Multimedia Db

download Project Multimedia Db

of 21

Transcript of Project Multimedia Db

MULTIMEDIA DATABASE SYSTEMIntroduction:People interact with multimedia every day: reading books, watching television, listening to music. We organize and structure this multimedia, such that we can easily access it again. We create photo albums of our holidays, we keep racks of compact discs and tapes with the music we like, we store past editions of magazines in boxes, and use a videorecorder to record television programs about topics of our interest. Typically, these multimedia collections end up in old shoeboxes on the attic, guaranteeing pleasure and fun when re-discovered many years later.Since the introduction of multimedia inpersonal computers, it has become more common everyday to digitize part of the multimedia data around us. A major advantage of digitized data over shoeboxes is that digitized data can be shared easily with others. People now create their own homepages onthe world wide web (WWW), partially as a tool to manage the information they collect. But, browsing the web makes clear that a computer with a web server is not the best tool to share your shoebox data. It is not easy for others to nd your data, and, the information pointed at by search engines is often incorrect, or has been moved to another location. A better solution to create large collections of digitized data is to organize the data in (multimedia) digital libraries.A digital library supports effective interaction among knowledge producers, librarians, and information and knowledge seekers [AY96]. Adam and Yesha et al. characterize a digital library as a collection of distributed autonomous sites that work together to give the consumer the appearance of a single cohesive collection. A digital library should be accessible through the WWW as well, but it can provide much better support for searching and sharing the data, because it is not completely unstructured like the WWW. The popularity of so-called portal sites, and the increasing amount of domain-specic search engines appearing on the web, also indicate that better organization of data available in the WWW is necessary to make it accessible. This research project investigates the potential role of database management systems in software architectures for the creation and operation of multimedia digital libraries.Database technology has provided means to store and retrieve high volumes of data in the business domain. But, database systems havealways been designed for the management of alphanumeric data such as names and numbers. Recently, researchers have started to think about multimedia databases. Unfortunately, anything that simply stores multimedia data is called a multimedia database. The capabilities of such databases sufce for typical applications of real estate and travel businesses, as these systems only deal with the presentation of otherwise statically used information. But, a general-purpose multimedia database management systemshould provide much more functionality than just storage and presentation. This project is an attempt to dene what properties can be expected from a multimedia database system.-CONCEPTS-DEFINITIONWhat is Multimedia?A clear and unambiguous definitionof multimedia cannot easily be found and given. When going through books and articles, youll discover that the same underlying meaning isnt always intended, when the term multimedia is used. Most definitions, however, seem to convert to the same meaning.Multimedia is used by everyone. When someone is telling about an experience and uses both speech and gestures, then this is a form of multimedia communication. Within some branches, like telecommunication and publishing, there exists a different meaning for the term medium and consequently also for the word multimedia. This might cause confusion about the meaning of the word multimedia.According to Negroponte [Jansen], multimedia is the coming together of 3 business branches: the media world, the telecommunications branch and the computer industry. Because of this diverse historical background multimedia applications cannot easily be characterised. When studying several multimedia applications, features from these branches can be discovered in various proportions.The background of the media is providing information. Publishing companies mainly supply text, graphics and images, while the television broadcasts sound and moving images. The telecommunication facilitates communication between people, and the computer industry directs to structured data, like numbers and text.The market for multimedia applications is, among others, the IT-industry, publishing, amusement, health-care, education and marketing. The nature of these applications is as diverse as themarket. Often fast communication plays a crucial role.Multimedia applications you may be able to think of are electronic publishing like multimedia-encyclopedias, computer games, medical information systems (patient records with X-rays), computer based training (CBT) and tele-education, company and product presentations, and not forgetting surfing the Web: Internet. The latter has almost become synonymous with multimedia.These applications sometimes fill a new market based on new needs. Multimedia also operates on existing markets, like the one of computer games with better and flashier computer games. For marketing it serves as extension for the current advertisement media. Interactive home shopping is just an extension to the existing mail ordering services.Multimedia is intended to make communication more clear. Illustrations are used for this purpose, and also to make it more attractive. It shouldnt, however, distract from the real message. Often multimedia techniques are used without beforehand considering the benefits compared with traditional means.The use of multimedia techniques within an application should create a certain surplus value. Otherwise one takes the risk that it will hardly be used, or even not at all. Unfortunately the effects ofmultimedia are hard to quantify.Sometimes it is even impossible to express them in terms of reduced costs or increased profits. The prevailing opinion is, however, that multimedia causes a more effective transfer of information by integrating data in different presentation forms [Gurchom].When analysing the meaning of the word multimedia, it should mean something like consisting of many or multiple types of media. This definition is comparable with the one Kay and Izumida give for multimedia information in a database context.According to the Masters Thesis of Suijker on IBMs Digital Library [Suijker], multimedia information is text (alphanumeric information), images, video (fragments) and audio (fragments). He also points out that, according to some, multimedia data excludes the alphanumeric type.Until now the definition of multimedia hasnt been more than the series of datatypes it can consist of. What distinguishes Multimedia from a collection of datatypes? Suijker describes the concept Multimedia itself as computers using different kinds of audio-visual means to let people use information as natural a way as possible.In Toward Multimedia, Cheyney et al. put the emphasis on the integrated whole of text, graphic, audio and video information. A multimedia application should contain extensive provisions for random access and hypermedia linking.The essence of multimedia relates to the integration of different presentation forms or information types. The types are the same as the aforementioned.With integration one means synchronised and interlarded. Another will define integration in this context as a strong relation between the data by means of links and references (e.g. hyperlinks). In this sense they seem to agree with Cheyney.According to the aboveinformation, multimedia varies from a collection of multiple kinds of information types via this same collection presented as an integrated whole to a natural and human-like interaction with the computer.What is Multimedia Database System?Part of a multimedia application is the data. The diversity of multimedia data can be categorised in several ways:Time-Dependency- :Time-dependent data has a duration in time like sound and video, this is not the case with time-independent data like images or text.Dimensions-:Spatial (3D) occurring with GIS and CAD/CAM and non-spatial data (2D) can be distinguished from each other.By sense-: By which organ of sense it can be perceived, like ear (sound), eye (image), both or possibly other senses.Another classification of data, by Lorie, is based on how the data is formatted. All these kinds currently exist in the application areas of advanced database systems [Gudivada96]:Formatted Structure-:Traditional alphanumeric data structured heterogeneous data about an object is stored and retrieved together as with structures or records in programming languages.Complex-:Structured data with a variable number of components.Unformatted-:String data whose structure is not understood by the DBMS, like the BLOB (BinaryLarge Object).A very rough definition of multimedia information within a database context is given by Kay and Izumida [Kay]: consisting of one or more (according to some: two or more) of the following forms: image, text, diagram, graphical animation,sound and moving pictures.According to some definitions, a multimedia database is a database which contains one or more types of information. According to others, at least two types are needed, because otherwise it isnt possible to use multi. In my opinion, this definition should be extended with the addition that a multimedia database potentially can contain multiple media types.When storing images and text there are already two types involved. Most people will associate multimedia with flashy presentations with sound, video, images and supporting text.Ideally multimedia data will be stored in a suitable DBMS in a standardized and integrated manner. A multimedia database should provide support for multimedia applications as well as possible. This canbe by offering fast search coupled with the ability to handle a large variety of queries. According to Blanken and Apers [Blanken] databases provide more and more support for multimedia applications.Until recently there was hardly any multimedia databasesupport available. More than the BLOB wasnt available in most DBMS. Now this has almost become a standard feature.A BLOB isnt considered to be an object, but is unstructured binary data [Kay, Colton94, Colton95]. This raw data can be anything. The database system doesnt know the underlying datatype and has no knowledge about the internal format of it. For this reason, the database system doesnt know what operations are possible.As no operations are provided by the DBMS, also no internal components canbe retrieved and no indices can be created on it. The only thing a DBMS can do is store and retrieve it as a whole. In this sense, a BLOB seems to be an unsuitable datatype for storing multimedia information.Another way of looking at multimedia databasesis by which characteristics are important and how it distinguishes itself from traditional databases. Kay and Izumida [Kay], Blanken and Apers [Blanken] and Faloutsos et al. [Faloutsos] have described a number of them. Also the work of Huijsmans and Lew [Huijsmans] and that of Ma and Manjunath [Ma] more specifically look at image database characteristics. Smoliar and Zhang [Smoliar] look at the accessibility of video content.Isochronality and time-dimension of data:Continuous and synchronised delivery ofthe data is important for moving pictures and sound. Further, synchronisation of sub-objects.Continuous and synchronised delivery of the data is important for moving pictures and sound. Further, synchronisation of sub-objects.Internal structure:Although multimedia information often is considered unstructured, it really has a very complex structure.Size of the objects (and databases):Traditional database systems were designed to work with millions of records varying from a few bytes to kilobytes. The size of multimedia items can be immense (megabytes or even gigabytes) and results in large- scale databases (petabytes).External structure:This consists of relations between different media, often via so called hyperlinks.Query:In a multimedia databaseit often isnt the purpose to retrieve facts, but to find documents in order to get at the facts. Combination of various query mechanisms.Navigate and browse:Access and ad hoc-retrieval based on links. User-guided navigation.Long transactions and high concurrence:Many users have access to the same large multimedia items at the same time, mostly by reading (updates are scarce) and viewing.Presentation:The importance of the presentation and a (visual) query and user interface is often neglected.

Thereare number of data types that can be characterized as multimedia data types. These are typically the elements for the building blocks of ore generalized multimedia environments, platforms, or integrating tools. The basic types can be described as follows : Text : The form in which the text can be stored can vary greatly. In addition to ASCII based les, text is typically stored in processor les, spreadsheets, databases and annotations on more general multimedia objects. With availability and proliferation of GUIs, text fonts the job of storing text is becoming complex allowing special eects(color, shades..). Images : There is great variance in the quality and size of storage for still images. Digitalized images are sequence of pixels that represents aregion in the users graphical display. The space overhead for still images varies on the basis of resolution, size, complexity, and compression scheme used to store image. The popular image formats are jpg, png, bmp, ti. Audio : An increasingly populardatatype being integrated in most of applications is Audio. Its quite space intensive. One minute of sound can take up to 2-3 Mbs of space. Several techniques are used to compress it in suitable format. Video : One on the most space consuming multimedia data type is digitalized video. The digitalized videos are stored as sequence of frames. Dependingupon its resolution and size a single frame can consume up to 1 MB. Also to have realistic video playback, the transmission, compression, and decompressionof digitalized require continuous transfer rate. Graphic Objects: These consists of special data structures used to dene 2D and 3D shapes through which we can dene multimedia objects. These includes various formats used by image, video editing applications. Examples are CAD / CAM objects.Features of Multimedia Database Systems The multimedia database systems are to be used when it is required to administrate a huge amounts of multimedia data objects of different types of data media (optical storage,video tapes, audio records, etc.) so that they can be used (that is, efficiently accessed and searched) for as many applications as needed. The Objects of Multimedia Data are: text, images, graphics, sound recordings, video recordings, signals, etc., that are digitalized and stored. Multimedia Data are to be compared in the following way:MediumVideo-ClipConfigurationTypical sizeTime dependentSense

TextPrintable charactersSequence10KB (5 pages)NoVisual/acoustic

GraphicVectors, regionsSet10 KBNoVisual

Raster imagePixelsMatrix1 MBYesVisual

AudioSound/volumeSequence600 MB (AudioCD)YesAcoustic

Video-ClipRaster image/ graphicsSequence2 GB (30 min.)YesVisual

The need and efficiency of MM-DBS are to be defined byfollowing requirements:Basic service: To be used for multiple applications Not applicable as a real end-user system (like program interface)Storage and retrieval of MM-Data:For the Storage: Input of MM objects Composition (to multimediaobjects) (example: authoring systems) Archive of data (in hardware and format independent way)For the Retrieval: Support of complex search Efficiency (indices etc.) Evaluation (aggregation, filtering) Preview Also conversions (needed togain or lead to hardware and format independence)For the Update Only replace or also edit? (The complexity depends on).Multimedia Database Systems have to be capable:1. Support of multimedia data types, i.e. data types as data structures, including type of data and operations2. Capability to manage very numerous multimedia objects, store them and search for them3. To include a suitable memory management system, to improve performance, high capacity, cost optimization4. Database system features:Persistency Transaction concept Multi-user capability Recovery Ad-hoc queries Integrity constrains (which leads to consistency) Safety Performance5. Information retrieval features: Attribute-based search Content-based searchIntegrity Constrains for MM-DB ApplicationsThe following features are typical for MMDB: Unique, Primary-key Constraints Referential integrity Via foreign keys (RM) Via OIDs (OO) Existential integrity NOT NULL constraints Integrity rules(check clauses) TriggerSpecifically for OO: Pre- and post-conditions for methods Constraints of the class hierarchy Partition conditions (Dis-jointness constraints)Advantages of Multimedia Database Systems: integrated administration of hugeamounts of multimedia data optimized storage Efficient access Many fold complex search possibilities Referential integrity of links Transaction protected multiuser mode RecoveryDisadvantages Of Multimedia Database System:Conceptually it should be possible to treat multimedia data in the same way as data based on the data types (e.g. numbers, dates and characters). The content of multimedia data is often captured with dierent capture techniques (e.g., image processing) that may be rather unreliable. Multimedia processing techniques need to be able to handle dierent ways of content capture including automated ways and/or manual methods. Queries posed by the user in multimedia databases often cannot come back with a textual answer.Rather, the answer to a query may be a complex multimedia presentation that the user can browse at his/her leisure. Our framework shows how queries to multimedia databases may be used to generate multimedia presentations that satisfy users queries-a factor that is unique to our framework. Multimedia data is large and aects the storage, retrieval and transmission of multimedia data. In case of video and audio databases time to retrieve information may be critical ex(Video on demand). Automatic feature extraction and Indexing: In conventional databases user explicitly submits the attribute values of objects inserted into the database. In contrast, advanced tools such as image processing and pattern recognition tools for images, to extract the various features and content of multimedia objects. As size of data is very large we need special data structures for storing and indexing.

Multimedia-DB applications:Fields of application: Static/passive:Retrieval / Information / Archive(Libraries, videoon demand, information systems, press, hospitals) Databases, information retrieval Static/active Education / Commercials/ Entertainment(School, university, professional training, games, commercials) CSE, Teachware, Courseware, CBT, Dynamic/passive Writing / Publications/ Design(Press, engineering, architecture) Editors, layout generators, CAD-systems Dynamic/active Controlling/Monitoring(Factories, traffic, weather forecast, military) Process control systems

ISSUES AND CONCERNS OF USING MULTIMEDIA DATA IN CLASSROOM TEACHINGBecause technology continues to change dramatically, the different data types may require special methods for optimal storage, access, indexing, and retrieval. Information retrieval is dependent upon the design and implementation of systems. Data AvailabilityCandan, Lemar & Subrahmanian [2011] stated that multimedia objects have temporal and spatial aspects that do not exist in more traditional data objects; therefore, visualization of the results of a multimedia query requires specification of the visualization parameters along with the query. Some of the multimedia databases are searchable with search engines on their own website; some offer data files that teachers may download to their own computers. As a result, it may take time and expertise for teachers to search and locate relevant and useful databases. The International Journal of Multimedia & Its Applications (IJMA) Vol.3, No.1, February 2011File Format and SizeAs mentioned, multimedia data is comprised of text, images, graphics, video, audio, etc. There is an overwhelming number of file representations for these different types of data, including TIFF, BMP, PPT, IVUE, FPX, JPEG, MPEG, AVI, MID, WAV, DOC, GIF, EPS, PNG, etc. Because of restrictions on theconversion from one format to the other, the use of the data in a specific format has been limited as well. In addition to the fact that multimedia objects are complex in their file formats, they are large too. For example, each of the following takes 1Megabyte of storage in uncompressed form: six seconds of CD-quality audio, a single 640x480 color image with 24 bits/pixel, a single frame of (1/30 second) CIF video, or one digital X-ray image (1024x1024) with 8 bits/pixel.

Data Storage and RetrievalA multimedia database system includes a multimedia database management system and a multimedia database. The database management system manages the multimedia database; a multimedia database is the multimedia data being managed. Why is a database needed?It is for storing and retrieving data more efficiently. Multimedia information (e.g., text, graphics, audio, video, etc.) has to be managed differently depending on the type of data. However, efficient retrieval of data depends on the database system.Inefficiencies of traditional retrieval approaches could result in a demand for teachers to understand techniques that can manipulate the multimedia data. Search EnginesCurrent multimedia databases play an important role on the Web. There is the desire for Internet multimedia search engines capable of searching and locating the relevant sources containing the desired media types given a description of the specific content. Therefore, teachers will want to know how to search and manage multimedia data on both the Internet and intranet, and how to keep up with the explosive increase in multimedia databases. Teachers Technology Skills and AttitudeAs technology develops, the use of technology in a classroom has become a main concern. However, manyteachers would have a hard time consolidating their skills in the use of the existing technologies for classroom instruction, and the high uncertainty of emerging technologies makes it even more difficult for teachers to develop the level of expertise needed to incorporate technology into the classroom. As a result, students classroom practice may not meet student expectation, especially in the area of integration and use of multimedia because todays students are often far more skilled at using digital media than most of their teachers. Torrisi-Steele stated, The effective integration of multimedia in the curriculum depends not on the technology itself but rather on educators knowledge, assumptions, and perceptions.STRATEGIES FOR USING MULTIMEDIA DATAIN CLASSROOM TEACHINGAs Web applications grow, the need for efficient multimedia databases will become essential. Knowing how to effectively access various databases will become increasingly important for teachers as well. Pedagogical ConcernsToday'stechnologies make possible the use of multimedia by helping to move learning beyond a primarily text-based and linear arena into the cyclical world of sights, sounds, creativity, and interactivity. But, the challenge is whether the essence of multimedia can be integrated into an essential discipline. If some pedagogical design principles can be used effectively, multimedia can permit greater individualization, in turn fostering improved learning, learner satisfaction, and retention rates. With the largeamount of information in databases, it is necessary for teachers to guide students through meaningful learning activities so that they can learn how to use databases to facilitate their own thinking. Jonassen(1917) suggests some strategies for classroom applications, for example, teaching with databases should proceed gradually, starting from having students work with completed databases, to partially completed databases and then to databases created by students themselves. This process suggests how to provide different scaffolding to students with different database skills. Students critical thinking and problem-solving skills should be developed gradually from learning with guidance. Data SearchingAs more multimedia information becomes available, theneed for efficient browsing, searching, and retrieving of information increases. Petkovic & Jonker described the increasing demand to manipulate the data based on the content. Furthermore, Johnson [18] indicated that three approaches can be used to represent the content of multimedia data.They are: keyword-based, feature-based, and concept-based approaches. Keyword-based approach: The multimedia content is described by the user through annotations. Feature-based approach:A set of features can be used for representing and retrieving the multimedia data. Many multimedia databases allow users to query a database by specifying keywords and/or image characteristics. For example: general information like color, texture, shape, speed, position, or particular applications like fingerprint recognition or medical images. Concept-based approach:Concepts are subsequently used to interpret the content of the data and to retrieve the data itself. This is usually an application domain specific process and occasionally requires the intervention of the user. For efficient browsing and searching, querying the multimedia database is an important part of a database system. According to Kalipsiz, multimedia data queries can be divided into four different types.They are: a) Keyword query, b) Semantic query, c) Visual query, and d) Video query. Keyword querying only uses well-defined queries, while semantic and visual querying are designed to use the fuzzy (more approximate, less precise) query method. Querying in a multimedia database is quite different from querying in standard alphanumeric databases. If querying conventional databases, which consist of text or numerical data, a query is often represented in the form of text or a numerical value. Besides the fact that browsing takes on added importance in a multimedia environment, queries can contain multimedia objects input by the user; the results of these queries are based not on perfect matches but on degrees of similarity. While a content-based approach is preferable in a multimedia database system, Yoshitaka & Ichikawa further indicated a query-by-example approach for content-based representation, which is a method of query specification and allows a user to specify a query by giving examples. For example, an imageobject is retrieved by the shape of objects, by specifying colors and their spatial distribution in the image, or by a specific pattern appearing in an image.

FUTURE OF MULTIMEDIA DATABASE SYSTEMMOBILE CLOUD COMPUTING (MCC)Cloud computing is the next big thing in the current market scenario. Cloud computing is not only related to personal computers, it also affects and heavily impact the mobile technology. In Mobile Cloud Computing both the data storage and the data processing happen outside of the mobile device i.e. when we combined concept of cloud computing in mobile environment. In MCC scenario all the computing power and data storage move into the mobile cloud. MCC will not provide benefits only to the smart phone users but for will help a broader range of mobile subscriber. With MCC mobile phone user will get benefit in number of ways and help them to run their business application without large amount of capital investment in infrastructure and services.

ConclusionApplicationsrequiringcontent-basedretrievalarethesupportforuser-defined datatypes,including user-definedfunctions,andwaystocallthesefunctionsfromwithinSQL.Content-basedretrievalmodelscanbeincorporatedwithindatabasesusingtheseextensibilityoptions:theinternalstructureandcontentofmultimediaobjectscanberepresentedinDBMSsasabstractdatatypes,and similaritymodelscanbeimplementedasuser-definedfunctions.MostmajorDBMSsnowsupportmultimediaextensions(eitherdevelopedinhouseorbythird-partydevelopers)thatconsist ofpredefinedmultimediadatatypes,andcommonlyusedfunctionsonthosetypesincludingfunctionsthatsupportsimilarityretrieval.ExamplesofsuchextensionsincludetheImageDatablade supportedbytheInformixUniversalServer,andtheQBICextenderofDB2.

REFERENCES[1] Ismail Khalil Ibrahim, Handbook of Research on Mobile Multimedia.[2] Martin Gilje Jaatun, Cloud Computing: First International Conference,CloudCom 2009, Beijing, China, December 1-4, 2009, Proceedings, Springer Publications.[3] Selvakumar Samuel, Kesava Pillai Rajadorai, Mobile Multimedia Database Common Issues and Future Considerations, in Proceeding of MoMM 2009 IEEE.[4] J. Arreymbi, and M. Dastbaz, Issues in Delivering Multimedia Content to Mobile Devices, in Proceedings of the Sixth International Conference on Information Visualisation, (IV02) 1093-9547/02 $17.00 2002 IEEE.[5] Le Gruenwald, Frank Olken, Mobile Database Research: What Is To Be Done?" DOI=web.mst.edu/ ~cswebdb/Workshop-AFRL/Paper3209559.pdf[6] zsu, M.T. 1999. Issues inMultimedia Database Management. In Proceedings of the 1999 International Symposium on Database Engineering and Applications (August 02-04, 1999). IDEAS IEEE Computer Society, Washington, DC, 452.[7] Toby Velte, Anthony Velte, Robert C. Elsenpeter, Cloud Computing: A Practical Approach ,Tata McGraw Hill Professional, 2009.[8] Research Report by ABI Research in 2009. www.abiresearch.com/1003385Mobile+Cloud + Computing.[9] A. P. DeVries,. M. Windhouwer, P. M. G. Apers & M. Kersten, "Information Accessin Multimedia Databases based on Feature Models," (2000) In New Generation Computing, vol. 18, no. 4, pp. 323-339.[10] M. Wichterich, I. Assent, P. Kranen, & T. Seidl, "Efficient EMD-based similarity search in multimedia databases via flexible dimensionality reduction," (2008) In SIGMOD Conference, pp. 199-212. [11] S. Kiranyaz &M. Gabbouj, "Hierarchical Cellular Tree: An Efficient Indexing Scheme for Content-Based Retrieval on Multimedia Databases," (2007) In IEEE Transactions on Multimedia, Vol 9, No. 1.[12] M. Svensson, "Contextual Metadata in Practice," (2009) In the 2009 First International Conference on Advances in Multimedia.[13] Yu, C., Williams, A., Lin, C. F., & Yu, W. C. (2008). Planning effective multimedia instruction. In Terry T. Kidd & Holim Song (Eds.), Instructional systems and technology (Vol. 1, pp. 216-231). Hershey, PA: Information Science Reference.[14] Grementieri, V. (1998). Innovation technology and higher education. Higher Education in Europe, 23 (2), 169-175.[15] Roblyer, M. D., & Schwier, R. A. (2003). Integrating educational technology into teaching. Toronto: Pearson Education Canada Inc.[16] I. H. Witten, A. Moat, and T. C. Bell. Managing Gigabytes. Van Nostrand Reinhold, 2nd edition, 1999.[17] H. Wolfson and I. Rigoutsos. Geometric Hashing: An Overview. IEEE Computational Science and Engineering, 4(4):1021, 1997.