Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

43
Created for: Presented by: Date issued: MCN Laura Mann 20 h November 2014

description

In July 2013, SFMOMA launched its first online collection catalogue, the Rauschenberg Research Project (RRP), which features nearly 90 Robert Rauschenberg works from the museum's permanent collection. The RRP combines rigorous scholarship with multimedia resources. With more than 500 images, videos, and research materials, it is the largest research effort the museum has ever devoted to a single artist; a print equivalent would have totalled more than 600 pages. The RRP is part of the Getty Foundation's Online Scholarly Catalogue Initiative (OSCI), which explores how scholarly collection catalogues can be transformed by the online environment. Based on a recent evaluation, this presentation will share insights into the reach and impact of an online scholarly museum publication. Who is using the RRP specifically, and online scholarly catalogues more generally? How is it being used? How is it perceived by its target audience of scholars, historians, and curators? The findings are encouraging, while also revealing concerns.

Transcript of Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Page 1: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + WebbCreated for: Presented by: Date issued:

MCN Laura Mann 20h November 2014

Page 2: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Making a 21st-Century Combine:

SFMOMA’s First Online

Collections Catalogue

2014 MCN Conference

November 20, 2014

Page 3: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb Photo by Amanda Graham on Flickr

Page 4: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Page 5: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

1.Who is using the RRP?

2.How is it being used?

3.How is it perceived?

4.Is it replicable by SFMOMA?

Page 6: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

What We Did

1.Online survey

2.Interviews with users and

stakeholders

3.Usability testing

4.Google Analytics

Page 7: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Let’s start with some good news

1.Reaching the primary audience

2.Used for research and

teaching

3.A trusted source

4.A new form

Page 8: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Q: What best describes you?

The RRP is reaching its primary target audience

69% Primary Audiences

• 25% Graduate

students

• 18% Professors

• 16% Curators

• 6% Independent

scholars

• 4% Librarians

N=51

69%

Primary

Audiences

12%

Secondary

Audiences

20%

Other

Audiences

Page 9: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Q: What best describes you?

It’s also reaching secondary and wider audiences

69% Primary Audiences

• 25% Graduate

students

• 18% Professors

• 16% Curators

• 6% Independent

scholars

• 4% Librarians

12% Secondary Audiences

• 10% Museum educators

• 2% Undergraduates

N=51

69%

Primary

Audiences

12%

Secondary

Audiences

20%

Other

Audiences

Page 10: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Greater and more diverse reach than

a comparable print catalogue

700Museum, university and

library network domains

from around the world

24,792Unique visitors in first

six months

Page 11: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Google is the key to the

discoverability of the RRP

>48%Traffic referred by Google

I'm Googling for …some random

fact about Rauschenberg in

1953…and I often find that

that takes me back to an essay

in the RRP.

Graduate student

Page 12: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Where do scholars expect to find

the RRP?

…in academic databases?

Page 13: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Where do scholars expect to find

the RRP?

Page 14: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Where do scholars expect to find

the RRP?

…at the library

…it's parallel to a

huge book…I might expect to

see to it listed instead in

the actual [university]

library where they're

cataloguing books…

Graduate student

Page 15: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

But…there’s no

standardized

process for

adding digital

publications to

library

catalogues

Page 16: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

What does this

mean for you?

• SEO is critical to the

findability of your online

scholarly catalogue

• Get an ISBN number for your

online publication

• Getting online publications

into university libraries will

require outreach to art

librarians

Page 17: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

How is the RRP being used?

N=81

Q: What were your reasons for visiting/using the Rauschenberg Research Project

online? (Please select all that apply)

35%

20%

19%

14%

12%

1%

0% 5% 10% 15% 20% 25% 30% 35% 40%

Interest in online catalogues

General research

Looking for materials and

resources to support teaching

Researching Robert

Rauschenberg

Looking for images of

Rauschenberg’s work

Looking for conservation

research

Page 18: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

How is the RRP being used?

N=81

Q: What were your reasons for visiting/using the Rauschenberg Research Project

online? (Please select all that apply)

35%

20%

19%

14%

12%

1%

0% 5% 10% 15% 20% 25% 30% 35% 40%

Interest in online catalogues

General research

Looking for materials and

resources to support teaching

Researching Robert

Rauschenberg

Looking for images of

Rauschenberg’s work

Looking for conservation

research

Visitors who are

interested in the

catalogue’s form,

rather than its

content

Page 19: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

How is the RRP being used?

N=81

Q: What were your reasons for visiting/using the Rauschenberg Research Project

online? (Please select all that apply)

35%

20%

19%

14%

12%

1%

0% 5% 10% 15% 20% 25% 30% 35% 40%

Interest in online catalogues

General research

Looking for materials and

resources to support teaching

Researching Robert

Rauschenberg

Looking for images of

Rauschenberg’s work

Looking for conservation

research

Visitors who are

interested in the

catalogue’s form,

rather than its

content

15% of RRP

visitors have

been to the

site 9-200

times

Page 20: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Primary audiences rate RRP content very highly

Q: “How do you rate the content of the Rauschenberg Research Project on a

scale of 1-5 where 1 is not at all useful and 5 is extremely useful? N=35

4.54

4.54

4.51

4.43

4.26

4.63

1 2 3 4 5

Images of the artworks

Scholarly essays and

curatorial commentary

Exhibition histories

Curatorial documents

Conservation documents

Videos

Extremel

y useful

Very

useful

Fairly

useful

Not very

useful

Not at all

useful

Page 21: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

There was universal praise for the usefulness, quality, depth

and breadth of RRP content

The [RRP] was a huge

asset for my [Masters]

paper…

Graduate student

comprehensive.

I cite it as a model

Graduate student

98% of the primary audience said they

were likely to use the RRP for any

future research on Rauschenberg

The research…is

just phenomenal

Curator

Page 22: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

The audience also trusted RRP as a scholarly source

37% of the primary audience that had

used the RRP said they planned to

cite it in future research

The RRP presents

itself as something

that makes me trust

it to a very high

standard.

Curator

…generally…I don't cite

online material…but because

of the rigor that was used

in this project, I felt

comfortable citing it.

Graduate student

Page 23: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

A deeper level of access to museum information

It’s like the museum

opened up their databases to

me. I wish I could find this

kind of resource for the

artists I work on.

Curator

Page 24: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Features for the academic audience

1.Video transcripts and sharing

2.Citation tools

3.Downloadability

[Recommended format for citation

is] super super important…in terms

of training our students in

research and documentation”

Professor

Page 25: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Features for the academic audience

1.Video transcripts and sharing

2.Citation tools

3.Downloadability

I downloaded pretty

much everything …because

I wanted to use it offline

where I didn't have WiFi.

Graduate student

Page 26: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

But many also saw the RRP as offering a new type of scholarship

The RRP seems somewhat unique

in the aggregation of very high

quality images...detailed object

information and particular

essays geared toward those

objects.

Graduate student

The…content of the essays

was …the most surprising and interesting

thing for me. The essays by SFMOMA curators

had insights about the physical objects,

their histories, that don't appear in

traditional art historical scholarship

written by people who have limited access

to the objects…

Graduate student

The RRP appears to be a

new kind of thing…a unique

publication… It's a new kind

of form

Graduate student

Page 27: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

What does this

mean for you?

• Online catalogues need some

specialized functionality to

meet the needs of a scholarly

audience

• The features reflect working

process and signify academic

authority

• Online scholarly catalogues

offer opportunities for

innovation in content and form

Page 28: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Challenges

1.Boundaries

2.Permanence

3.Status

4.Replicability

Page 29: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Boundaries: where does an online

publication begin and end?

Page 30: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Where is the container

that makes this into a separate

publication? Does it bleed

out into the rest of the

website?...where does the publication

begin and where does it end? And how

do you tell when you're in it or not

in it?

Graduate student

Boundaries: where does an online

publication begin and end?

Page 31: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Page 32: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Permanence: will this be here

in 20 years?

Page 33: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Permanence: will this be here

in 20 years?

But if you cite

something there's the

possibility that it

would disappear.

There's a lot of

scholarly nervousness

about that.

Graduate student

Do we have a way

to ensure that... 20 years from now,

will we be able to read this data?

…If it's in a library catalogue…will

that URL be stable?

Graduate student

Page 34: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Status: what is the value of

an online scholarly catalogue?

Page 35: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Status: what is the value of

an online scholarly catalogue?

It doesn't feel as

prestigious [as a printed

catalogue] but I think

that's changing…I wouldn't

hesitate to sign on to a

project that was digital.

Curator

The physical heft of

a book is in some ways how

we translate the

intellectual weight

Graduate student

Page 36: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Status: what is the value of

an online scholarly catalogue?

I have published in museum

publications before. And… what I've

been told is that they don't count

towards tenure review…they go on my

CV, but they…aren't considered tenure-

worthy. But..the RRP that's some new

territory I think…

Graduate student

Page 37: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Status: what is the value of

an online scholarly catalogue?

It changed my opinion... it

served for me as an example of

what's possible.

Graduate student

I saw that one could be done

in a very comprehensive and

scholarly manner. I'm not

sure I was a big believer

prior to that.

Curator and RRP contributor

Page 38: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

What does this

mean for you?

• Clear boundaries translate to

audience trust

• Can online catalogues be

permanent, updatable and

archival?

• Perceptions of online

catalogues are shaped by

larger issues of status and

publication record in the

academic community

I

Page 39: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Is the RRP replicable?

Page 40: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

Technology isn’t

the only issue

Page 41: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

• Technical framework

• Integration of museum

systems

• Roles and

responsibilities

• Resources and workflow

Page 42: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

What does this

mean for you?

• Technology integrations

• New museum workflows

• New roles and responsibilities

• Quantifying scope and effort

for appropriate resources

Page 43: Digipublishing in Museums - Evaluating SFMoMA's first digital catalogue

Frankly, Green + Webb

e:

[email protected]

t:

@lhmann

Images thanks to Flickr Commons:

The hidden treasures of the Worlds

Public Archives

http://www.flickr.com/commons