Second Look at Google Books Ryan James University of Hawaii at Manoa [email protected].

33
Second Look at Google Books Ryan James University of Hawaii at Manoa [email protected]

Transcript of Second Look at Google Books Ryan James University of Hawaii at Manoa [email protected].

Page 1: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Second Look at Google Books

Ryan James

University of Hawaii at Manoa

[email protected]

Page 2: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Legibility

Page 3: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Methodology

• 50 randomly selected books– Random.org– OED

• 2,500 pages examined for legibility errors– First fifty pages, excluding prefatory material

• Major errors = loss of information

• Minor errors = difficult to read information

Page 4: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Summary of Results Legibility

Number of Books 50

Number of Pages 2500

Major Errors 15

% of Pages with Major Errors 0.6

Minor Errors 9

% of Pages with Minor Errors 0.36

% of Pages with both types of errors

0.96

Page 5: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Major Error

Page 6: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Minor Error

Page 7: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 8: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 9: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 10: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 11: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 12: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 13: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 14: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 15: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 16: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Impact of Legibility Errors

• Loss of information

• Difficult to read information

• Frustrated Users

• OCR problems

Page 17: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Metadata Errors

Page 18: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Methodology

• 400 randomly selected records reviewed– Random.org– OED

• 1,600 metadata fields reviewed– <Author> <Title> <Publication Date>

<Publisher>

Page 19: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Metadata Field Errors Found % of Errors

Publisher 83 41%

Author 48 24%

Publication Date 41 20%

Title 31 15%

Total 203 100%

Page 20: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Errors per Book

• Expect around 1-12% error rate per traditional library catalog error rate

• Found 35.76% error rate (records having at least one error)

Page 21: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Types of Errors

0

10

20

30

40

50

60

70

80

90

Title Author Publisher Date

Page 22: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Errors per Book

0

20

40

60

80

100

120

1 Error 2 Errors 3 Errors 4 Errors

Page 23: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Example Search

• Author Edgar Allan Poe

• Works published before 1809

Page 24: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 25: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Impact of Metadata Errors

• Errors in search results– results list order– advanced searching– Frustrated Users

• Problems integrating with other information systems

Page 26: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Optical Character Recognition

Page 27: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Ham. To be, or not to be, that is the question, Whether tis nobler in the minde to suffer

The flings and arrowes of outragious fortune, Or to take Armes against a sea of troubles, And by opposing, end them, to die to fleepe

Page 28: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Impact of OCR Errors

• Keyword searching!

• Frustrated Users

• Frustrated Disabled Users– text-to-speech technology

Page 29: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

The Importance of Fleepe

• Cross-contamination of errors– errors in one Google product show up in other

Google products

Page 30: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.
Page 31: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Ngram Viewer

Page 32: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

Final thoughts

• How significant are the errors found in Google Books?

• Is it useful to patrons?

• What role can Google Books play?

Page 33: Second Look at Google Books Ryan James University of Hawaii at Manoa rsjames@hawaii.edu.

James, R. (2010). An Assessment of the legibility of Google Books. Journal of Access Services, 7(4), 223-228.

pre-pub version: http://scholarspace.manoa.hawaii.edu/handle/10125/15358

Email: [email protected]