Does metadata matter?

Post on 19-Aug-2014

21.657 views 0 download

description

A lunchtime seminar for Eduserv staff.

Transcript of Does metadata matter?

July 2008

Andy Powell, Eduserv Foundationandy.powell@eduserv.org.uk

www.eduserv.org.uk/foundation

Does metadata matter?

July 2008Does metadata matter? 2

or…

should we be interested in metadata and, if so, why?

July 2008Does metadata matter? 3

I’m going to try to deliver 130 slides in 30 minutes

July 2008Does metadata matter? 4

then you can ask questions

(yes… I really did say “130 slides”)

July 2008Does metadata matter? 5

non-technical

July 2008Does metadata matter? 6

metadata jargon

July 2008Does metadata matter? 7

first, some history…

July 2008Does metadata matter? 8

July 2008Does metadata matter? 9

July 2008Does metadata matter? 10

metadata is…

July 2008Does metadata matter? 11

machine-readable

July 2008Does metadata matter? 12

descriptive

July 2008Does metadata matter? 13

for the purposes of…

July 2008Does metadata matter? 14

resource discovery

July 2008Does metadata matter? 15

resource management

July 2008Does metadata matter? 16

delivery / access control

July 2008Does metadata matter? 17

use / re-use

July 2008Does metadata matter? 18

long term preservation

July 2008Does metadata matter? 19

July 2008Does metadata matter? 20

MARC - Machine-Readable Catalogue

July 2008Does metadata matter? 21

July 2008Does metadata matter? 22

July 2008Does metadata matter? 23

still the predominant

metadata standard

(in thelibrary world)

July 2008Does metadata matter? 24

July 2008Does metadata matter? 25

a distributed search standard called…

Z39.50

so that multiple library catalogues can be searched from one place

July 2008Does metadata matter? 26

AACR2 currently being replaced by…

RDA

(more generic – i.e. not just books!)

July 2008Does metadata matter? 27

Z39.50 supplemented by SRW and SRU

(Web-friendly variants)

July 2008Does metadata matter? 28

FRBR

July 2008Does metadata matter? 29

none of which needs bother you…

July 2008Does metadata matter? 30

other than to note that…

July 2008Does metadata matter? 31

metadata tends to get more complicated the longer you think about it

July 2008Does metadata matter? 32

1994

July 2008Does metadata matter? 33

July 2008Does metadata matter? 34

July 2008Does metadata matter? 35

a few 10s of 1000s of pages

July 2008Does metadata matter? 36

but recognised that finding stuff was going to start getting difficult

July 2008Does metadata matter? 37

people (mainly librarians) began trying to catalogue it by hand

July 2008Does metadata matter? 38

July 2008Does metadata matter? 39

July 2008Does metadata matter? 40

http://www.intute.ac.uk/http://www.intute.ac.uk/

July 2008Does metadata matter? 41

meanwhile…

July 2008Does metadata matter? 42

AltaVista

(first major Web search engine – circa 1995)

July 2008Does metadata matter? 43

people began to realise that the metadata they embedded into Web pages might be important

July 2008Does metadata matter? 44

hang on…

did I just say “metadata embedded into Web pages”?

July 2008Does metadata matter? 45

<html><head><title>A web page</title></head><body>…</body></html>

July 2008Does metadata matter? 46

<html><head><title>A web page</title><meta name=“keywords” content=“some, key, words” /><meta name=“description” content=“a summary” /></head><body>…

July 2008Does metadata matter? 47

birth of the SEO industry

July 2008Does metadata matter? 48

then came Google

July 2008Does metadata matter? 49

and the rest, as they say, is history

July 2008Does metadata matter? 50

Google takes note of links between pages

Google PageRank

July 2008Does metadata matter? 51

but places less emphasis on embedded metadata

July 2008Does metadata matter? 52

metaspam

<meta name=“keywords” content=“coca cola” />

July 2008Does metadata matter? 53

metacrap

<title>put your title here</title>

July 2008Does metadata matter? 54

despite that, work continued on embedded metadata

most notably in the form of…

July 2008Does metadata matter? 55

Dublin Core

(circa 1995)

July 2008Does metadata matter? 56

initially 15 metadata elements

a.k.a properties

a.k.a. attribute/value pairs

July 2008Does metadata matter? 57

contributorcoveragecreator

datedescription

formatidentifierlanguagepublisherrelationrightssourcesubject

titletype

July 2008Does metadata matter? 58

embedded into Web pages

July 2008Does metadata matter? 59

or encoded using XML

July 2008Does metadata matter? 60

intention was to improve indexing by search engines

July 2008Does metadata matter? 61

but people forgot about…

July 2008Does metadata matter? 62

“metaspam” and “metacrap”

July 2008Does metadata matter? 63

the search engines didn’t!

July 2008Does metadata matter? 64

and so, by and large,

search engines still ignore embedded metadata

July 2008Does metadata matter? 65

despite that, there has been fairly widespread adoption in policy terms

July 2008Does metadata matter? 66

particularly in e-Government(e.g. UK eGMS)

July 2008Does metadata matter? 67

but also in other areas – education, health, environmental agencies, libraries, cultural

heritage sector, …

July 2008Does metadata matter? 68

growth of rules around metadata content(i.e. cataloguing rules)

(everyone’s rules are different)

July 2008Does metadata matter? 69

and growth in use of additional elements for particular communities

(and everyone’s additions are different)

July 2008Does metadata matter? 70

such usage documented in the form of “application profiles”

July 2008Does metadata matter? 71

Dublin Core Metadata Initiative

coordinating “standards” body

(note again: growing complexity over time)

July 2008Does metadata matter? 72

meanwhile…

July 2008Does metadata matter? 73

the W3C developed the Resource Description Framework (RDF)

(circa 1999)

July 2008Does metadata matter? 74

the standard for the “Semantic Web”

July 2008Does metadata matter? 75

Tim Berners-Lee’s vision for a machine-readable Web of data

July 2008Does metadata matter? 76

allowing software to navigate and reason about Web content automatically

July 2008Does metadata matter? 77

a Web of “Linked Data”

July 2008Does metadata matter? 78

RDF, RDFS, OWL, FOAF, …

(but also Microformats, RSS, …)

July 2008Does metadata matter? 79

meanwhile…

July 2008Does metadata matter? 80

elearning community was busy developing its own standards

July 2008Does metadata matter? 81

IEEE LOM(Learning Object Metadata)

July 2008Does metadata matter? 82

same as DC

…but different!

(different elements, different syntax)

July 2008Does metadata matter? 83

<cough />

July 2008Does metadata matter? 84

a brief aside

July 2008Does metadata matter? 85

identifiers are important

July 2008Does metadata matter? 86

URI (Uniform Resource Identifier) is the identifier system of the Web

July 2008Does metadata matter? 87

but some issues…

e.g. around persistence

July 2008Does metadata matter? 88

to cut a long story short

July 2008Does metadata matter? 89

it turns out that ‘http’ URIs (a.k.a. URLs) are the worst kind of Web identifier…

July 2008Does metadata matter? 90

…apart from all the others

July 2008Does metadata matter? 91

(not everyone agrees with that!)

July 2008Does metadata matter? 92

<breath />

July 2008Does metadata matter? 93

repositories

July 2008Does metadata matter? 94

July 2008Does metadata matter? 95

July 2008Does metadata matter? 96

but arXiv was not the only repository

July 2008Does metadata matter? 97

recognised need for aggregating metadata from different repositories into a single place so that

it could be searched

July 2008Does metadata matter? 98

OAI-PMH

(a protocol for metadata harvesting)

July 2008Does metadata matter? 99

harvesting metadata into repository search engines

of which OAIster is best known

(but it isn’t really used much)

July 2008Does metadata matter? 100

and the major search engines like Google don’t support the OAI-PMH

July 2008Does metadata matter? 101

because it isn’t mainstream enough

(and because of “metaspam” and “metacrap”)

July 2008Does metadata matter? 102

and so to 2008…

July 2008Does metadata matter? 103

political agenda around institutional repositories

July 2008Does metadata matter? 104

in order to store, manage and disclose…

July 2008Does metadata matter? 105

institutional assets

research paperslearning objectsresearch data

July 2008Does metadata matter? 106

exposing metadata about these things using the OAI-PMH to search services

July 2008Does metadata matter? 107

which services?

err… OAIster :-(

July 2008Does metadata matter? 108

what kind of metadata?

typically DC

July 2008Does metadata matter? 109

or a variant of DC

because simple DC is really too simple to be very useful

July 2008Does metadata matter? 110

but unfortunately…

July 2008Does metadata matter? 111

…DC variants tend to be more complex

and therefore metadata can’t be created very easily by ordinary researchers

July 2008Does metadata matter? 112

but that’s another story!

July 2008Does metadata matter? 113

ok…

July 2008Does metadata matter? 114

why are we interested?

July 2008Does metadata matter? 115

are we interested?

July 2008Does metadata matter? 116

metadata is everywhere

July 2008Does metadata matter? 117

July 2008Does metadata matter? 118

July 2008Does metadata matter? 119

July 2008Does metadata matter? 120

July 2008Does metadata matter? 121

July 2008Does metadata matter? 122

July 2008Does metadata matter? 123

metadata in sites like the Science Museum is mostly locked away within the site

July 2008Does metadata matter? 124

can expect growing pressure to expose it on the Web for others to “mash up”

July 2008Does metadata matter? 125

in HE, we are operating in an “institutional repository” political environment

July 2008Does metadata matter? 126

we (should?) have an interest in repositories of research publications and research data

particularly research data

July 2008Does metadata matter? 127

metadata comes to the fore in scenarios where content is non-textual (e.g. data) and where required information can’t easily be derived

from textual content (e.g. author name)

July 2008Does metadata matter? 128

thank you

July 2008Does metadata matter? 129

OK I lied…

…it was 128 slides

July 2008Does metadata matter? 130

unless you count these last two