Selection of Technical Concepts

The CULTOS Research Team

Cultural Units of Learning - Tools and Services

User-Driven Tool Development

Authoring ToolDevelopment

Authoring &enriching

Publishing ofvalue-added

content

Use of authoredcontent

Authors feedback Publishers feedback Users feedback

Evaluation of the value chain

Intertextual Thread and Knowledge

qz

p

y

parodic_ref(p,q)

parodic_ref(y,x)

depicts_scene(j,k)

contains(parodic_ref(y,x),z)

contains(parodic_ref(p,q),z)

x

Meta knowledge

db3

db2db1

contains(parodic_ref(p,q),z)

stores(doc(q),db2)

stores(doc(z),db2)

stores(pic(j),db3)

j

stores(doc(x),db1)

Authoring Environment for Intertextual Cultural Threads

Primary texts inelectronic form

KnowledgeenrichedAuthoring

KnowledgebasedSupport Tools

Ontology ofintertextuality ICT Thread

Publishing L-C

TransformersXML/XSLT/...

Initial CULTOS Authoring Architecture

EMMO2ANYTHING

MDB KDB OntDB

MDB API KDB API

EMMO Authoring

Ontology Authoring

EMMO Viewer

mercatis - Uni Wien I-views

SRFGSRFG

EMMO2SMIL

OntDB API

Repositories

Server APIsSOAP based

Clients

referencesreferences

Converter

EMMOs - Enhanced Multimedia Meta Objects

q

z

p

yparodic_ref(p,q)

parodic_ref(y,x)

depicts_scene(j,k)

x

j

Knowledge Interface Tran

sfor

mat

ion

Int.

Links Repository Int. Contents R

ep. Int.

Trading Interfaces

Trai

ls R

epos

itory

Int.

EMMOs Life Cycle

ProductPlanning

(Publisher)

Templateobject

Knowledgeenriched

object

M/Mcontentenriched

object

Edited &enhanced

object

Objectcustomisedfor targetplatform

Object used as aproduct

1 2 3

4 5 6

Content Acquisition

(Cont. Prov.)

Value Adding (Author)

Editing &Enhancing (Publisher)

MediaProduction(Publisher)

MediaUse

(End User)

Components of an EMMO

Knowledge template set of domain specific types of associations

(is_parody_of, is_epigone_of, etc.) Topic Maps (ISO 13250), MPEG-7, LOM

A set of transformation descriptions for representation in different modes, e.g. WBT,

SMIL, WML, print version, etc. A links repository

references to contents (RDF, XLink, URNs, etc.) A contents repository

for (parts of) actual contents, annotations, etc. A trails repository Interfaces for editing, management, trading, etc.

Designing an Intertextual Thread

Tuvia Rivner

“The Fall”

Cultural Concept

Referencing

Ekphrasis

“In Chagall ...”

accusationof the woman

forbiddenfruit

snake

Shared Origin

Auden, Musee des Beaux Arts

InBreughel’s Icarusfor instance: how

everything turns awayquite leisurely from the

disaster, [...]

“It is not the samein Breughel ...”

DescriptiveConfiguration

“... on each hand the flamesdriven backward slopetheir pointing spires, ...

then with expanded wingshe steers his flight

aloft, incumbent on thedusky air

Milton, Paradise Lost, Book 1, 222 - 226

Chagall Breughel

1 2

3

C/H Creates Challenges - Technology Pull at the Intersection of Technologies

CULTURAL HERITAGE

Multimedia (MPEG-7)Knowledge

Technologies

Dis

trib

uted

In

form

atio

n (R

DF

/S)

EMMO Interfaces

API

KDB

RDF

API

Onto DB

KIF

API

Media DB

MPEG-7

IntertextualThread

E M M OEnhanced Multimedia Meta Object

Preview - EMMO Document Model (2/5)

The knowledge database (KDB) holds all logical/semantic information

Consists of Logical Mediaparts, Ontology Objects, Associations and EMMOs

Everything is derived from the abstract „Entity“ A sketch of the knowledge database:

0..*

0..* type

has

Target

Source

0..*

0..*

OntologyObjectLogicalMediaPart Association

Entity

Emmo

EMMO 2

EMMO 1

Preview - EMMO Document Model (3/5)

Example of a mini-Emmo modelled with the KDBEMMO = Enhanced Multimedia Meta Object

LMP = Logical MediaPartOO = OntologyObjectASSO = Association

LMP 1 LMP 2ASSO 1

OO 3

type

Acoustic close quotation

type

OO 1

Popsong

type

OO 2

Classical music

OO 4

ASSO 2

type

OO 5

AuthorZiva Ben-Porat

„Roll over Beethoven“ by ELO

„Beethoven‘s 5th Symphony“

OO 6

OO 7

ASSO 3type

Domain

Music

Preview - EMMO Document Model (4/5)

The media database (MDB) is designed to hold different multimedia artifacts (text, image, audio, video)

MDB is based on the MPEG-7 Standard Stores useful metadata, like e.g. file format, size,

sampling rate, height, width, ... A sketch of the media database:

1 1..*11..*

0..*

1..*

MediaInstance SelectorMediaProfile

FullSelector SpatialSelector TemporalSelector TextualSelector CompositeSelector

Preview - EMMO Document Model (5/5)

Example of an MPEG-7 MediaProfile

MediaProfile 1fileformat: JPEG Imagefilesize: 54868 bytesheight: 306 pixelswidth: 460 pixelscolordomain: color….

MediaInstance 1 (media locator:http://www.xyz.com/guernica.jpg )

MediaInstance 2 (media locator: http://www.artnet.com/picasso/guernica.jpg )

<complexType name="MediaProfileType"> <complexContent> <extension base="mpeg7:DSType"> <sequence> ..... <element name="MediaFormat"

type="mpeg7:MediaFormatType" minOccurs="0"/> <element name="MediaTranscodingHints"

type="mpeg7:MediaTranscodingHintsType" minOccurs="0"/> <element name="MediaQuality"

type="mpeg7:MediaQualityType" minOccurs="0"/> <element name="MediaInstance"

type="mpeg7:MediaInstanceType" minOccurs="0" maxOccurs="unbounded"/>

</sequence> <attribute name="master" type="boolean" default="false"/> </extension> </complexContent></complexType>

<complexType name="MediaFormatType"> <complexContent> <extension base="mpeg7:DType"> <sequence> ..... <element name="FileFormat"

type="mpeg7:ControlledTermUseType" minOccurs="0"/>

<element name="FileSize" type="nonNegativeInteger" minOccurs="0"/>

...... <element name="VisualCoding" minOccurs="0"> ..... </element> <element name="AudioCoding" minOccurs="0"> ..... </element> </sequence> </extension> </complexContent></complexType>

CULTOS, LEIT, and Cultural MemoryA Vision for C/H

CULTOSTools & Services

Semantic WebInfrastructure:Large scaleroll-out of D/L products for developinga digital cultural memory

2002 2003 2004 2005 2006 2007 2008 2009 2010 2011

LEITIntegrated contextualisation environment