April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service...

16
April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox

Transcript of April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service...

Page 1: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

April 28, 2015 Stanford IIPC 2015 GA

Archiving Transactions Towards Uninterruptible Web ServiceArchiving Transactions Towards Uninterruptible Web ServiceZhiwu Xie, Prashant Chandrasekar, Edward A Fox

Page 2: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

2

OutlineOutline• Motivation

• Technical background

• System architecture

• Demo

• Future work

Page 3: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Web Archiving Current StateWeb Archiving Current State• Stakeholders• Cultural heritage organizations• Academia

• Coverage• Wide but shallow

3

Page 4: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Web Archiving Current StateWeb Archiving Current State• Approach• Crawler-based archiving

• Value proposition• Comprehensive public good: preserve the

history, collect research data, …

4

Page 5: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Wider Participation?Wider Participation?• “Free rider”

• “What’s in it for me?”

5

Page 6: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Expand the Value PropositionExpand the Value Proposition• Ask what the web archiving can do for

the potential stakeholders and participants

6

Page 7: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

What Matters to a Website?What Matters to a Website?

7

Page 8: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

How Can Web Archiving Help?How Can Web Archiving Help?

8

Page 9: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Web Archiving ApproachesWeb Archiving Approaches• Crawler-base

• User-drive

• Transactional

9

Page 10: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

SiteStorySiteStory

10

Page 11: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Uninterruptable Web Service (UWS)Uninterruptable Web Service (UWS)

• Turn SiteStory into a web infrastructure component that improves website availability

• Mask server errors from the end user• Gain precious time for webmasters to recover

from application server failures without disrupting the majority of their users’ web experience

11

Page 12: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

UWS ArchitectureUWS Architecture

12

Page 13: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

DemonstrationDemonstration

13

Page 14: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Future WorkFuture Work• Moving UWS functions to application

servers

• Improving performance

14

Page 15: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

AcknowledgementsAcknowledgements• Partially funded by the Web Archiving

Incentive Award by Mellon Foundation via Columbia University

15

Page 16: April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Questions?Questions?• Zhiwu Xie [email protected]

• Prashant Chandrasekar [email protected]

• Edward A Fox [email protected]

16