Smart Archives - the Brave New Semantic World

25
Smart Archives The Brave New Semantic World Presentation at the Workshop “The Scent of Information” February 13-14, 2009 Art University / Audimax Kollegiumgasse 2, 4010 Linz Georg Güntner Salzburg Research Forschungsgesellschaft m.b.H. Jakob Haringer Straße 5/3 | 5020 Salzburg, Austria T +43.662.2288-DW | F +43.662.2288-222 [email protected] www.salzburgresearch.at Credits to: Iron Maiden (2000)

description

This is a presentation about the utilisation of the "smart content paradigm" in digital archives and collections. The talk was given at the expert workshop “The Scent of Information” (at the Art University in Linz, Austria on February 13, 2009

Transcript of Smart Archives - the Brave New Semantic World

Page 1: Smart Archives - the Brave New Semantic World

Smart Archives The Brave New Semantic WorldPresentation at the Workshop

“The Scent of Information”

February 13-14, 2009 Art University / AudimaxKollegiumgasse 2, 4010 Linz

Georg GüntnerSalzburg Research Forschungsgesellschaft m.b.H.Jakob Haringer Straße 5/3 | 5020 Salzburg, AustriaT +43.662.2288-DW | F +43.662.2288-222georg.guentner@salzburgresearch.atwww.salzburgresearch.at

Credits to: Iron Maiden (2000)

Page 2: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 2

Structure

| Basic ideas about “Smart Archives” and the role of semantics| Case study: Smart Content Factory| Case study: Smart Media Archive| Case study: Live Staging of Media Events (LIVE)| Case study: Single Point of Access Semantic Media Repository

Framework (SAMY)| Conclusions

Page 3: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 3

Abstract

| In his talk Georg Güntner will summarize personal experiences with knowledge-based approaches in rich media archives and collections. The presentation will be based on three recent research projects which are in different states of realization: “Smart Media Archives” developed a semantically-enhanced index for ORF’s (the Austrian Broadcasting Corporation) media archive. “LIVE Staging of Media Events” showed ways to combine external knowledge spaces with media clips in real-time. Finally, “SAMY” a project conducted in co-operation with LBI Linz and basis wien (a documentation centre for contemporary art) aims at the creation of a single point of access semantic media repository framework for cultural collections and archives.

| Georg Güntner is head of the application area “Digital Media” at Salzburg Research and in this function also leads Salzburg NewMediaLab, a centre of excellence for applied research, combining approaches from multimedia content management, semantic technologies and social software to create new content structures and behavior, also denoted as “smart content”.

Page 4: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 4

Context - Salzburg Research

| Founded in 1996, Salzburg Research (SRFG) is the regional non-profit research organisation of the State of Salzburg

| Salzburg Research is located at Techno-Z Salzburg which focuses on Information and Communication Technologies (ICT)

| SRFG employs about 70 people, its turnover is 5,1 Mio. Euro (2008)

| Thematic areas (ICT with a focus on new media)| Knowledge and media management| Intelligent mobility| Educational innovation & Web technologies| IT-security and QoS-networks| eTourism and eInnovation| eCulture

| ICT is applied to application areas relevant to the region of Salzburg (culture, tourism, new media, learning)

| The core activities include applied research, coordination and networking, know-how transfer and market development www.salzburgresearch.at

Page 5: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 5

Context - Salzburg NewMediaLab

| Salzburg NewMediaLab (SNML) is the Austrian Centre of Excellence in the area of digital content engineering (type of research: application oriented; 2003-2009)

| Multimedia content management| Semantic technologies| Social software| Knowledge technologies

| Based on public-private partnership; funding partners: Austrian Ministry for Economic Affairs, State of Salzburg

| Cooperative research projects including 6 industrial partners and 5 research organisations

| Co-ordinator and legal representative of SNML: Salzburg Research

www.newmedialab.at

Page 6: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 6

Economic Drivers for “Smart Archives”

| The markets:| Corporate, community based & personal audiovisual collections

(archives, libraries): spanning from YouTube to the Austrian National Library

| Media producers: broadcasters, film and games industry| Learning applications, industrial applications| „Embedded publishers“, “Embedded archives”| Media analysts

| The „prosumer crisis“ as a driving factor:| Consumers become producers| Content production gets easier: The amount of manageable assets

explodes.| Professional content production is expensive: re-use is mandatory| Solutions of the prosumer crisis depend heavily on improvements of

the search and retrieval process

Bridge the semantic gap! Be visionary!

Page 7: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 7

Vision – „Smart Content Factory“

Page 8: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 8

The Ingedients of Smart Archives

| Content –The “archive”

| Domain model (internal and increasingly external sources)

| Intelligent content model (smart content)

| Applications to manage, browse and visualize archival content

InformationObject

Content

Conceptua-lisationTopic

User

Page 9: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 9

Musical forms(z.B. musical genres andforms)

Musical facts(Instances: e.g. works, composers, titles)

Musical Terminology(e.g. synonyms, classification)

Geographic names(places, regions, districts,countries, areas)

Domain Ontologies – an Example

Page 10: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 10

Themen:Linked Open Data (oder “Web of Data”)

by http://esw.w3.org/topic/SweoIG/TaskForces/CommunityProjects/

LinkingOpenData

Page 11: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 11

Smart Content

| Definition:| The term denotes a concept for new type of digital content developed in

the course of a strategic study for the European Commission (EP2010). Smart Content is designed to close the gap between the increasing ease of media creation and the requirement of personalized, context-driven content delivery and consumption.

| The concept is based on “intelligent content models” combining content and knowledge by means of domain knowledge models and offering a set of facets to access not only content and metadata, but also describing its “behavior”.

| http://ep2010.salzburgresearch.at/

Page 12: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner).

ThemenSpivak’s “Future Web”

© Nova Spivak

Page 13: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 13

Case Study: Smart Content Factory

| Vision:| Development of a prototype of

a knowledge-based audiovisual archive and navigation system for TV, radio and online broadcasts

| Increasing the utilization of audiovisual content repositories

| Duration: 10/2003 - 09/2006| Volume: 735.000 €| Efforts: 80 PM| Partners:

| ORF| X-Art ProDivision| Joanneum Research| Salzburg Research (co-

ordinator)

http://scf.salzburgresearch.at/

Page 14: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 14

SCF Results – Views

Navigation Principles in the Smart Content Factory

Page 15: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 15

Video Summary View

Developed by Joanneum Research (ActiveX-technology)Alternative view availabledeveloped by Salzburg Research (Javascipt-technology)

Page 16: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 16

Case Study: Smart Media Archive

| Vision:| Management of corporate

media archives| Opening archives for user

generated content (e.g. tell a story about an image)

| Meaningful relations between archival content and user generated content

| Intelligent search and navigation

| Duration: 01/2006 - 12/2009| Partners:

| mediamid digital services| Salzburg Research (co-

ordinator)

Page 17: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 17

Thesaurus(topics)

Article

Rating

Related articles

Annotations and meta information

Case study: Smart Media Archive

A „story“: UGC (Wiki-like style)

Page 18: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 18

Production support in the areaof interactive multistream TV shows(a challenge for ipTV – www.ist-live.org)

Page 19: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 19

Intelligent Media Framework - Modelling the Staging Domain

Event

| Human annotators| Editor

| Video conductor

| Automatic annotators

| Contentformats

| Stream profiles

| Stream interrelation

| Audience profile

IntelligentContentModel

ProductionArchive

| Consumer

User

Staging

Content

Page 20: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 20

Production Environment: IMF Message Console

Page 21: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 21

Case Study: SAMY

Single Point of Access Semantic Media Repository Framework| Objectives

| Design, implementation and evaluation of a framework for (media) art archives based upon

| an asset management system, and und| the management of ontology-based semantic metadata in an RDF triple store

| Access to these metadata via a „Single Point of Access“| Duration: 07/2003(*) - 12/2009

(*) The project has been conducted by LBI earlier

| Partners: | LBI Medien.Kunst.Forschung.| Basis Wien| Salzburg Research (co-ordinator)

Page 22: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 22

SAMY: Domain Model and Architecture

| The SAMY ontology comprises the following main concepts (domain model), e.g.

| Asset| Team| Community| Material| Person| Award| Role| Event| Work-Project| Version

SAMY - architectural layers

Page 23: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 23

Conclusions: A “Recipe” for Smart Archives

| Use existing content (URIs)| Define the scope of your application| Define an appropriate content model

| Is the content invariant to the semantic approach? Must the structures change?

| Integrate existing information sources| Production metadata (speakers, editing), archival data,

playout systems, EPGs| Consider creating links to other sources

| Test metadata extraction tools| Consider metadata annotation

| Is social tagging an alternative?| Define an appropriate domain knowledge model

| Scope, expressiveness, acceptance| Implement the semantic indexing process| Integrate the system in the production / archiving

workflow

Page 24: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner).

Modelling the Domain (Three Dimensions)

ModelScope

Level of Expressiveness

ModelAcceptance

Which parts of semantics are modelled?How is the perspective of the ontology onto the knowledge of the users?

What kind of semantics is used?What kind of semantics are required to fulfil requirements?

What are the user communities using the ontology?Which communities accept the ontology? © DynamOnt

Austrian research projectFIT-IT Semantic Systems Programm(2005 – 2007)

Page 25: Smart Archives - the Brave New Semantic World

17.03.2009 © Salzburg Research Forschungsgesellschaft 2009 (Georg Güntner). 25

Kontakt

| Information | www.salzburgresearch.at| www.newmedialab.at| www.ist-live.org| www.importnet-project.org| ikewiki.salzburgresearch.at| www.kiwi-project.eu| scf.salzburgresearch.at

| Kontakt| Güntner Georg

T: +43.662.2288.400, M: [email protected]

Salzburg ResearchJakob Haringer Straße 5/III

A-5020 SalzburgAustria/Österreich

Fax: +43.662.2288.222