Demo of integrated synergetic preservation workflow (WP8 ForgetIT 1st year review)

6
Francesco Gallo Heiko Maus EURIX DFKI Demo of integrated synergetic preservation workflow ForgetIT 1st Review Meeting, April 29-30, 2014 Kaiserslautern, Germany

Transcript of Demo of integrated synergetic preservation workflow (WP8 ForgetIT 1st year review)

Page 1: Demo of integrated synergetic preservation workflow  (WP8 ForgetIT 1st year review)

Francesco Gallo Heiko MausEURIX DFKI

Demo of integrated synergetic preservation workflow

ForgetIT 1st Review Meeting, April 29-30, 2014 Kaiserslautern, Germany

Page 2: Demo of integrated synergetic preservation workflow  (WP8 ForgetIT 1st year review)

ForgetIT Project GA600826, 1st Review Meeting, Kaiserslautern, April 2014

PoF Framework: Architecture Components

middlewareapplications archive

cloud storage

Page 3: Demo of integrated synergetic preservation workflow  (WP8 ForgetIT 1st year review)

ForgetIT Project GA600826, 1st Review Meeting, Kaiserslautern, April 2014

PoF Middleware: Message Oriented Middleware

© F. Munz, Middleware and Cloud Computing, 2011

© D.A. Chappel, Enterprise Service Bus, 2004

Page 4: Demo of integrated synergetic preservation workflow  (WP8 ForgetIT 1st year review)

Preservation event triggered by the Active System

Request sent to PoF Middleware (REST API)

Synergetic Preservation Worklow is triggered● Scheduler creates a new job, initial message sent

Resource retrieved from the Active System CMIS server● Collector processes message, retrieves resource from CMIS server● ID Manager generates a new ID ● Collector stores retrieved resource on the Middleware server● Flow control returned to Scheduler, new messages sent

ForgetIT Project GA600826, 1st Review Meeting, Kaiserslautern, April 2014

Preliminary integrated end-to-end workflow

Page 5: Demo of integrated synergetic preservation workflow  (WP8 ForgetIT 1st year review)

Content processing● Extractor processes messages for image analysis (QA and concept

detection)● Contextualizer processes messages for text contextualization (mentions

and context)● Flow control returned to Scheduler, results messages sent

SIP preparation● Archiver processes message to prepare SIP, with all resources and MD

SIP ingest● Archiver processes message to ingest SIP into AIS ● ID Manager updates IDs adding AIP ID

ForgetIT Project GA600826, 1st Review Meeting, Kaiserslautern, April 2014

Preliminary integrated end-to-end workflow - 2

Page 6: Demo of integrated synergetic preservation workflow  (WP8 ForgetIT 1st year review)

AIP store● AIS Packager stores AIP into PDS● ID Manager updates IDs adding PDS ID● PDS triggers Storlets according to rules

Resource status update● The resource is shown as “preserved” in the Active System

Resource Restore Workflow● Active System can send request to PoF Middleware (REST API)● Scheduler creates a new job, initial message sent● Collector retrieves DIP, containing original resource (or new one after

transformation by PDS), which is returned to Active System

ForgetIT Project GA600826, 1st Review Meeting, Kaiserslautern, April 2014

Preliminary integrated end-to-end workflow - 3