Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers...
-
Upload
marvin-shelton -
Category
Documents
-
view
218 -
download
1
Transcript of Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers...
![Page 1: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/1.jpg)
Cloud Task Replica
Repository Preservation ToolsOpen Repositories 2009 - Atlanta
Richard RodgersMIT Libraries
![Page 2: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/2.jpg)
cloud computing
dynamic capacity: elastic
high availability
> storage: compute, database, more
new programming model
WOA - service bus in the sky
lightweight protocols
![Page 3: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/3.jpg)
problem space: replication
replication != backup
time decay of trust - needs maintenance
coordination costs $$$$
who’s watching the detectives ?
impermeable system boundaries
sizing forecast uncertainty
![Page 4: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/4.jpg)
reliable messaging
enables asynchronous handling
queue = list of messages
coordination of work, non-persistent
access controlled, encryptable
cheap: $0.01 per 10k messages
Amazon SQS + S3
![Page 5: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/5.jpg)
roles
decompose work into distinct replaceable agents
archive = content home
replicator = manages copies
auditor = implements and enforces policy
role != institution
![Page 6: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/6.jpg)
process model
a message queue for each role
message post triggers activity asynchronously
bucket brigade - message is a handoff or acknowledgment
storage is abstracted (cloud in prototype)
![Page 7: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/7.jpg)
workflow: replication
archive replicator auditor
S3
![Page 8: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/8.jpg)
workflow: removal
archive replicator auditor
S3
![Page 9: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/9.jpg)
workflow: audit
archive replicator auditor
S3
![Page 10: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/10.jpg)
message semantics
web-standard URI addressing
entities: packages, ORE maps
content model agnostic
entity checksums for integrity
standard identifiers for actors
![Page 11: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/11.jpg)
self-managed deployment
mit
![Page 12: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/12.jpg)
peered deployment
mit gatech
![Page 13: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/13.jpg)
service provider deployment
mit duracloud mit
![Page 14: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/14.jpg)
todo
plumbing only - replication requires more
all policy definition and agreements OOB
address business model
content packaging/description
expand skeletal prototype
stress at scale
![Page 15: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/15.jpg)
opportunities
federated & large scale problems
distributed registries
metadata harvesting
subject overlays
preservation workflows, micro-services
![Page 16: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/16.jpg)
thanks
![Page 17: Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.](https://reader036.fdocuments.us/reader036/viewer/2022062422/56649e7c5503460f94b7e46d/html5/thumbnails/17.jpg)
extra credit