Tech Talk: Coty Transforms from Event Management to Service Operations Management
Cloud Transforms Culture, Europeana Tech 2014
-
Upload
pavelkats -
Category
Technology
-
view
65 -
download
1
Transcript of Cloud Transforms Culture, Europeana Tech 2014
Culture transformed by the Cloud
Pavel Kats (Europeana Foundation)Marcin Werla (PSNC)
Data Storage: Records and Datasets
● Scaleable object storage cluster with support for basic technical metadata● Storing content of all types - as parts of data records● Allows to organize data records in datasets● Generic data model to support metadata and content aggregation
workflows
Record → Representation → Version
Technology: OpenStack Swift + Apache Cassandra
Project: Europeana Cloud
Persistent Identifiers
● Allocates unique and persistent identifiers to records
● Maintains a built-in mapping between these identifiers and local identifiers used by providers (several local identifiers can be mapped to one global)
● Will be compliant with standards like URN and PURL in the future
● As an additional service for the cultural sector, can be backed by a connection to an available identifier system (e.g. DOI)
Technology: Apache CassandraProject: Europeana Cloud
Annotations
● Separation between core data (digital objects+metadata) and complementary data layers required for research, provenance or other application-specific needs
● Complementary data can be structured in many ways and it is usually stored separately from the core one
Technology: Graph databases (probably, e.g. Neo4j)Project: Europeana Cloud
Long Term Archival Storage
● Several public data archiving services exist in Europe on national and pan-Europeana levelso EU-DAT (European level,
see http://www.eudat.eu/partners) o DANS (the Netherlands)o PLATON Archiving Service (Poland)
● Europeana DSI can be partnering with such trusted bodies to provide digital preservation services
Content-Specific Access
Technology: IIIF-compliant streaming of images Project: Europeana Cloud+Europeana Newspapers+Europeana Creative
● Streaming functionality for specific popular content formats
● For images (the most popular content type) provide a streaming service compatible with the IIIF standard, increasingly adopted by the cultural heritage sector
● HTTP-based streaming of audio and video content will be considered
Metadata and Content Indexing
● Out-of-the-box search service for a controlled set of formats which are well known, e.g.:
o EDM, LIDO, ...
o Full text search (where full text is provided)
Technology: SolrProject: Europeana Cloud / Europeana v3
A scaleable distributed computing system for massive resource-intensive computations, such as
● Metadata transformations according to predefined mappings
● Metadata enrichment
● Content analysis● Content conversions
between formats● Thumbnail generation
Metadata and Content Processing
Technology: Apache Storm, AkkaProject: Europeana Cloud / Europeana Creative
Application Hosting
● Cloud-based application hosting services
● PaaS as a service offered by the DSI to projects and developers
Thank you for your attention!
Pavel Kats <[email protected]>Marcin Werla <[email protected]>