Semantic Copyright Management of Media Fragments
description
Transcript of Semantic Copyright Management of Media Fragments
Semantic Copyright Management of Media Fragments
Roberto García, David Castellà, Rosa GilUniversitat de Lleida, Spain
DATA 20132nd International
Conference on Data Management
Technologies and Applications
29-31 July 2013Reykjavik, Iceland
12.04.2023 Slide 2 of 28
MediaMixerCommunity set-up and networking for the reMIXing of online MEDIA fragments
• FP7 Coordination Action– Started November 2012 – Create an European market for media
fragments re-purposing and re-sellingA history of G8 violence (© Reuters) http://slideshare.net/troncy/a-semantic-multimedia-web-create-annotate-present-and-share-your-media
12.04.2023 Slide 3 of 28
Introduction
• The MediaMixer project and community promote the use of semantic technologies for media mixing
• Real use cases and demos that showcase these technologies– Fragmenting media assets– Annotating them using semantic descriptions– Exposing these descriptions for fragment level search
and selection
– Representing rights information using a copyright ontology that integrates licenses, policies and rights expressions languages
12.04.2023 Slide 4 of 28
Producer checks reused media licenses vs. internal policies and agreements (with providers and rights holders)
Policy example: “…avoid media fragments showing violence when producing content for children”.
Problems:1.) Semantic annotation
a) For instance, automatically tagviolent content
2.) Rights Integrationa) Policies and agreements (unstructured documents) b) Media fragments licenses (rights expression languages)
3.) Intelligently detect conflicts
Example Use Case
12.04.2023 Slide 5 of 28
Current SituationIssues:• scalability
(mostly a manual process)
• conflicts detected too late (added costs)
• missed opportunities (media already available)
• …
12.04.2023 Slide 6 of 28
Proposals:Assisted Policy and Agreement Modelling• Model policies and
agreements• Formal model that
allows automatic integration and intelligence support
• Semantic model based on Copyright Ontology
• Editor with assistance guided by the ontology
12.04.2023 Slide 7 of 28
Policy and Agreement Modelling Assistant
12.04.2023 Slide 8 of 28
Media Fragments Ingestion
Provider offers media fragment:
• Content: automatic annotation
• Detect topics: Violence? Outdoors? Cars?...
• Rights:automatic translation of rights language to Copyright Ontology
• DDEX, ODRL, MPEG-21, Creative Commons…
12.04.2023 Slide 9 of 28
Semantic Annotation
9
• Transform whole videos to sets of meaningful, indexable and re-usable video fragments
Person, Snow, Trees, Building, Ski, …
Baseball, Throwing, Sports, Plant, Running, …
Kitchen, Indoor, Cake, …
…
12.04.2023 Slide 10 of 28
Semantic AnnotationMetadata
• Metadata for semantic annotation:– Descriptive metadata for media
characteristics– Provenance metadata to credit source
and specify rights– Conceptual metadata to reflect what
media is perceived to represent
12.04.2023 Slide 11 of 28
Conceptual Metadata
• Globally unambiguous identifiers for any concept needed– Ideally more information
about the concept itself is available via the identifier
– Use of Web URIs → Linked Data concept space
– Would allow for inference of concept type and relationship to other concepts
12.04.2023 Slide 12 of 28
Producer Proposed Workflow
12.04.2023 Slide 13 of 28
Semantic Data Exploration
12.04.2023 Slide 14 of 28
Implementation
• Rights, License and Policies implemented as Classes– Reproduction Right, Copy,
Copy Pattern for fragment #1,...
• Uses implemented as Instances– u: Peter copies media fragment #1
in the US on 2013-06-03 using…
• if u ∈ Copy Pattern thenpattern authorises u
Reproduction Right
Copy
Copyright
CopyPattern
u
?
12.04.2023 Slide 15 of 28
Pattern BuildingActions (“verbs”)
12.04.2023 Slide 16 of 28
Pattern BuildingCase Roles (from linguistics)
• Connect verbs to the action participants– Example: “The dog ate food”
initiator resource goal essence
Action agent, instrument result, patient,effector recipient theme
Process agent, matter result, patient,origin recipient theme
Transfer agent, instrument, experiencer, themeorigin medium recipient
Spatial origin path destination location
Temporal start duration completion pointInTime
Ambient reason manner aim, conditionconsequence
Subject, role “agent” Object, role “theme”
12.04.2023 Slide 17 of 28
DDEX Sample-08.04.xml<Deal>
<DealTerms><ValidityPeriod><StartDate>2013-01-01</StartDate></ValidityPeriod><Usage><UseType>OnDemandStream</UseType><DistributionChannelType>Internet</DistributionChannelType></Usage><TerritoryCode>ES</TerritoryCode><TerritoryCode>US</TerritoryCode></DealTerms>
</Deal>
Copyright Ontology Model<http://media.com/agreement#1> owl:Class;
co:start "2013-01-01" ;owl:intersectionOf (ddex:OnDemandStream [ a owl:Restriction ;
owl:onProperty co:medium ;owl:someValuesFrom ddex:Internet ][ a owl:Restriction ;owl:onProperty co:location ;owl:someValuesFrom [ a owl:Class ;owl:oneOf (territory:ES territory:US) ][ a owl:Restriction ;owl:onProperty co:theme ;owl:hasValue<http://my.tv/video.ogv#t=60,100> ]
]) .
Scenario
DDEX to RDF
12.04.2023 Slide 18 of 28
Scenario
Logical interpretation of a license model
Reasoning with DDEX
12.04.2023 Slide 19 of 28
Scenario
Reasoning with DDEX
Policy #1
Agreement #1
12.04.2023 Slide 20 of 28
reasoner = new Sesame(new OWLIM-SE_5.3())reasoner.loadOntologies()
> Loaded: iso3166a2.owl (territories), ddex.owl, copyrightonto.owl
reasoner.loadPolicy("NoStreamingInUS.owl")reasoner.loadLicense("DDEX_Sample-08.04.owl")use1 = new Use(use1URI, "user01", "OnDemandStream", "Internet",
"http://my.tv/video.ogv#t=60,100", "ES", "2013-04-19")
reasoner.load(use1)response = reasoner.isUsePermitted(use1URI)print response
> Authorised: http://mediamixer.eu/copyright/examples/agreement#1
use2 = new Use(use2URI, "user01", "OnDemandStream", "Internet","http://my.tv/video.ogv#t=60,100", "US", "2013-04-19")
reasoner.load(use2)response = reasoner.isUsePermitted(use2URI)print response
> Prohibited: http://mediamixer.eu/copyright/examples/policy#1
Scenario
License Checking Implementation
12.04.2023 Slide 21 of 28
@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> . @prefix odrlv: <http://w3.org/ns/odrl/vocab#> . @prefix owl: <http://www.w3.org/2002/07/owl#> .
<http://example.com/policy> a co:Agree ; co:agent <http://example.com/billie>, <http://example.com/sony> ; co:theme [ a owl:Class ; co:end "2012-12-31" ; co:start "0001-01-01" ; owl:intersectionOf (
[ owl:intersectionOf (odrlv:play [ owl:complementOf odrlv:mobile_ringtone ] ) ]
[ a owl:Restriction ;owl:hasValue <http://example.com/billie> ;owl:onProperty co:agent ][ a owl:Restriction ;owl:hasValue <http://example.com/music> ;owl:onProperty co:theme ] ) ] .
<http://example.com/sony:10> a co:Person .<http://example.com/music> a co:Creation .<http://example.com/billie> a co:Person .
ScenarioODRL Example from LCC Rights Reference Model Spec
Copyright Ontology license to text: “sony and billie Agree that billie play and not mobile ringtone music”.
12.04.2023 Slide 22 of 28
Creative Commons BY-SA ModelScenario
12.04.2023 Slide 23 of 2823
• Following Linked Data principles, starting from just content ID (URI)…
Long term vision…
Content
URI
URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI … H
TT
P G
ET
text/n3
HTTP GETimage/jpeg
12.04.2023 Slide 24 of 2824
Linked Data for Worldwide Copyright Management?
Content
URI
URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI …
HT
TP
GE
T
Agreement
URI
URI a co:Agreement co:agent URI co:theme … …
HT
TP
GE
T
Person
URI
URI a foaf:Person foaf:name “…” vcard:address … vcard:country URI
HT
TP
GE
T
12.04.2023 Slide 25 of 28
Get involved
• Join MediaMixer community to know more (http://community.mediamixer.eu):– discussions, use cases, demonstrators,
tutorials, presentations, software,…
More details:http://community.mediamixer.eu http://rhizomik.net/copyrightonto/
Roberto GarcíaUniversitat de Lleida, Spain
http://rhizomik.net/~roberto
Thank you for your attention
DATA 20132nd International
Conference on Data Management
Technologies and Applications
29-31 July 2013Reykjavik, Iceland