Open, social and linked - what do current Web trends tell us about the future of digital libraries?

119
S e p t e m b e r 2 0 0 9 Andy Powell, Eduserv [email protected] www.eduserv.org.uk/research twitter.com/andypowe11 Advanced Technologies for Digital Libraries 2009 Trento, Italy September 2009 Open, social and linked What do current Web trends tell us about the future of digital libraries?

description

A invited presentation given at the Advanced Technologies for Digital Libraries (AT4DL) meeting held in Trento, Italy in September 2009.

Transcript of Open, social and linked - what do current Web trends tell us about the future of digital libraries?

Page 1: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

Sep

tem

ber 2

00

9

Andy Powell, [email protected]

www.eduserv.org.uk/researchtwitter.com/andypowe11

Advanced Technologiesfor Digital Libraries 2009

Trento, ItalySeptember 2009

Open, social and linked

What do current Web trends tell us about the future of digital libraries?

Page 2: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 2

the purpose of this talk is to ask some questions about the future of digital libraries

Page 3: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 3

that’s not because I think current digital library thinking is wrong

Page 4: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 4

but because I think it is healthy to ask those kind of questions every so often

Page 5: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 5

JISC Information Environment

Page 6: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 6

Dublin Core Metadata Initiative

Page 7: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 7

linked data, social networks and digital identity

Page 8: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 8

I hope I have something useful to say

but we’ll see!

Page 9: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 9

I’m going to focus on the three words in the title as core themes for this talk

Page 10: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 10

open

Page 11: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 11

social

Page 12: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 12

linked

Page 13: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 13

digital library content should be not just “on” the Web but “of” the Web

Page 14: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 14

Huh? What does

of the Web

actually, like, mean?

Page 15: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 15

an attitude

Page 16: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 16

an expectation that your content will be re-used in ways you didn’t anticipate

Page 17: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 17

an expectation that people will take your content, your API and URLs and use them to build

something different

Page 18: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 18

so let’s take a step back for a minute

Page 19: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 19

where are we coming from?

Page 20: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 20

uk-centric

Page 21: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 21

and specific to higher education

Page 22: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 22

jisc ie diagram

Page 23: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 23

focus on the content

Page 24: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 24

primarily ‘document-like objects’

Page 25: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 25

focus on describing the content (primarily using simple Dublin Core metadata)

Page 26: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 26

and on moving that metadata from providers to consumers

Page 27: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 27

for the purposes of resource discovery, access and use

Page 28: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 28

being ‘open’ is all about enabling re-use

Page 29: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 29

but the cultural conditions for open sharing and re-use don’t necessarily emerge overnight

Page 30: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 30

as we have found with learning objects

Page 31: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 31

and we are likely to find with research data

Page 32: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 32

UKRDS survey of staff representing 700 researchers...

43% expressed need to see other’s research data

most share data in some form (informally with peers)

but only 12% share via existing formal data centres

Page 33: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 33

and even in the case of scholarly publications (where there is an existing heritage of ‘sharing’ for ‘re-use’) cultural change towards deposit is

only happening very slowly

Page 34: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 34

I also wonder if there’s a generational attitude to ‘openness’ which tends to assume most things

digital are ‘open’?

Page 35: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 35

so even things that are very definitely not open, like most music for example, are often treated

as though they are

Page 36: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 36

anyway, I digress...

back to the JISC Information Environment

Page 37: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 37

we tend to talk about the OAI-PMH, Z39.50, SRW/SRU, OpenURL, Dublin Core and so on

Page 38: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 38

much of the content is provided commercially

Page 39: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 39

so there is also a focus on mechanisms to protect content from inappropriate access

Page 40: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 40

in the JISC Information Environment there is an implied flow

Page 41: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 41

jisc ie diagram

Page 42: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 42

the JISC IE says very little about the relationships between people and content

Page 43: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 43

and nothing about relationships between people

Page 44: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 44

it says nothing about the social use that grows around content

Page 45: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 45

it talks about identifiers for stuff

Page 46: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 46

but not about identity (of people)

Page 47: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 47

this is not unusual for ‘digital library’ activities

Page 48: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 48

we talk a lot about content, and data formats, and metadata, and curation, and preservation, and

persistent identifiers, and …

Page 49: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 49

and we talk about openness, and Creative Commons, and other open licences

Page 50: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 50

and these things are all very good and important

Page 51: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 51

but we don’t talk much about social networks

Page 52: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 52

which is a shame…

Page 53: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 53

because... “cultural heritage results from EXCHANGE OF IDEAS about objects - it is not located IN them”

tweeted by @janestevenson from the #soa09 conference, quoting Marc Bouley of the University of St Andrews

Page 54: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 54

and while we have been busy building digital library initiatives like the JISC Information

Environment

Page 55: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 55

the Web has changed under our feet

Page 56: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 56

it’s increasingly participatory

Page 57: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 57

it’s increasingly about user-generated content

Page 58: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 58

it’s increasingly open

Page 59: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 59

it’s increasingly social

Page 60: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 60

it’s increasingly linked

Page 61: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 61

Page 62: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 62

Page 63: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 63

Page 64: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 64

Page 65: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 65

Page 66: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 66

Page 67: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 67

all very much open, social and linked

Page 68: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 68

3 other things are also worth noting about these services...

Page 69: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 69

firstly, concentration

Lorcan Dempsey, OCLC

http://orweblog.oclc.org/archives/001556.html

Page 70: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 70

secondly, they are ‘of’ the Web

they support diffusion thru simple and open APIs, the use of RSS, cool URIs for everything of value, a

RESTful architectural approach, and so on...

Page 71: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 71

in short... they see being mashed as a virtue

Page 72: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 72

thirdly, identity (in these services) is not just concerned with questions like “who are you and

what are you allowed to do?”

Page 73: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 73

but also about “this is me, this is who I know, and this is what I’ve created”

Page 74: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 74

digital identity has become user-centric

Page 75: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 75

concentration, diffusion and identity are enablers of social interaction

Page 76: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 76

meanwhile... somewhere in academia

(a alternative case-study)

Page 77: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 77

the open access

movement

and

scholarly repositories

Page 78: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 78

a university-based institutional repository is a set of services that a university offers to the members of its community for the management and dissemination of digital materials created by the institution and its community members. It is most essentially an organizational commitment to the stewardship of these digital materials, including long-term preservation where appropriate, as well as organization and access or distribution. … An institutional repository is not simply a fixed set of software and hardware

(Cliff Lynch, 2003)

Page 79: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 79

scholarly publications

learning objects

research data

Page 80: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 80

manage

deposit

disclose

make openly available

curate

preserve

Page 81: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 81

largely institutional focus

interoperability through centralised aggregators (national and global)

harvesting metadata about content using OAI-PMH (metadata = simple Dublin Core)

Page 82: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 82

jisc ie diagram

Page 83: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 83

we have tended to adopt service oriented approaches in line with long

tradition from Z39.50to SOAP/WSDL

Page 84: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 84

our focus has been on building“services on content”

rather than on the“content” itself

Page 85: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 85

we don’t tend to adopt a resource oriented approach

Page 86: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 86

we don’t adopt REST – an architectural style with a focus on resources, their identifiers (e.g. URIs), and a simple

uniform set of operationsthat each resourcesupports (e.g. GET,PUT, POST, DELETE)

Page 87: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 87

we don’t encourage aWeb style “follow your nose” approach

Page 88: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 88

… and we tend to treat “content” in isolation from the “social networks” that need to grow around

that content

Page 89: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 89

successful “repositories” (Flickr, YouTube, Slideshare, etc.) promote the social activity that

takes place around content as well as the content management and disclosure activity

Page 90: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 90

the institutional approach has fundamental mismatch with the real-life social networks adopted by

researchers

subject-based

cross-institutional

global

Page 91: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 91

while institutional approach isgood from perspective of institutional

management, preservation, etc.

globally “concentrated” repositories might better reflect the social networks that need to arise

Page 92: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 92

the net effect …is that there is no net effect

Page 93: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 93

repositories remain uncompelling places to disclose scholarly publications from POV of the

researcher

Page 94: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 94

perceived cost of deposit remains higher than perceived benefits

Page 95: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 95

we resort to institutional or funder mandates, “thou shalt deposit”, to fill what would

otherwise remain empty

Page 96: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 96

final thoughts

Page 97: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 97

visitors vs. residents

David White, University of Oxford

http://tallblog.conted.ox.ac.uk/index.php/2008/07/23/not-natives-immigrants-but-visitors-residents/

Page 98: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 98

counterpoint to the whole ‘Google generation’, ‘digital native’ meme

Page 99: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 99

resident – “an individual who lives a percentage of their life online”

Page 100: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 100

visitor – “an individual who uses the web as a tool in an organised manner whenever the need

arises”

Page 101: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 101

the cultural heritage sector tends to build services aimed at visitors

Page 102: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 102

I think we should be designing with residents in mind

Page 103: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 103

conclusions...

Page 104: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 104

what would I do if I was advising on something like the JISC Information Environment now?

Page 105: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 105

I’d aim to be as like the mainstream Web as possible

Page 106: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 106

I’d ask “How would Google do this?” more often

Page 107: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 107

I’d focus on the basics

Page 108: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 108

I’d focus on the principles of linked data

http://www.w3.org/DesignIssues/LinkedData.html

Page 109: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 109

use URIs to name things

Page 110: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 110

use HTTP URIs so that people can look them up

Page 111: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 111

provide useful information when people dereference the URIs

Page 112: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 112

include links to other things as part of that information (so that the recipient can find new

things)

Page 113: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 113

I’d promote the principles of cool URIs

(practical persistence)

Page 114: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 114

I’d strongly encourage a RESTful architectural approach

Page 115: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 115

I’d encourage RSS / Atom as essential point of access

Page 116: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 116

I’d focus on the social aspects of the systems being built

Page 117: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 117

implies that the Open Stack (OpenID, OAuth, ...) is increasingly important

Page 118: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 118

I’d focus on building stuff for residents rather than visitors

Page 119: Open, social and linked - what do current Web trends tell us about the future of digital libraries?

September 2009AT4DL09 - Trento, Italy 119

thank you