An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help...
Transcript of An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help...
![Page 1: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/1.jpg)
International Image Interoperability Framework
An Introduction to IIIFTom Crane#IIIF @tomofhernehill
Digirati Ltd @digirati_uk
Swedish National Heritage Board, Stockholm, 11 March
![Page 2: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/2.jpg)
Who am I?
• Technology Director of Digirati • https://medium.com/digirati-ch
• One of the editors of the IIIF specifications
• Chair of the IIIF AV Technical Specification Group
![Page 3: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/3.jpg)
What is IIIF?
20+ years of digitisation
Common themes…
• Book readers/viewers/page turners
• Deep Zoom
• Transcriptions, OCR, full text
• Annotation, comments, content creation related to the object
• Linking to other objects
• Some bespoke format for delivering a sequence of images to a bespoke viewer
But…
![Page 4: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/4.jpg)
Can this be standardised, and interoperable?
• Use cases for IIIF…
![Page 5: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/5.jpg)
![Page 6: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/6.jpg)
![Page 7: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/7.jpg)
![Page 8: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/8.jpg)
![Page 9: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/9.jpg)
![Page 10: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/10.jpg)
![Page 11: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/11.jpg)
Digital Surrogate
I still have my cultural awareness when looking at a digital surrogate
…but the computer needs assistance in presenting that digital surrogate to me
It needs to be mediated by metadata that can drive a viewing experience so my human cultural awareness can take over again
![Page 12: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/12.jpg)
![Page 13: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/13.jpg)
![Page 14: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/14.jpg)
![Page 15: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/15.jpg)
![Page 16: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/16.jpg)
![Page 17: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/17.jpg)
IIIF: Two Core APIs
“get pixels” via a simple, RESTful, web service
Just enough metadata to drive a remote viewing experience
Image API Presentation API
![Page 18: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/18.jpg)
• Descriptive metadata doesn’t help us get pixels on screen• Read the pages
• Look at the brush strokes
• See the film grain
• IIIF Presentation provides • A model for describing digital representations of objects
• A format for software - viewing tools, annotation clients, web sites - to consume and render the objects and the statements made about them
• The model defines a shared abstract space and time for assembling this content
![Page 19: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/19.jpg)
IIIF is founded on Shared Canvas and the W3C Web Annotation Model
What is a canvas?
It’s where we assemblecontent in IIIF
![Page 20: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/20.jpg)
It’s an abstraction of a view of an object
Essentially, a coordinate system for placement of images and text, and for targeting annotations
![Page 21: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/21.jpg)
![Page 22: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/22.jpg)
Familiar concept of annotation
![Page 23: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/23.jpg)
IIIF Concept
{"@id": "https://wellcomelibrary.org/iiif/b22031261/canvas/c0","@type": "sc:Canvas","width": 10000,"height": 15000,...
}
![Page 24: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/24.jpg)
Same canvas, multiple images
![Page 25: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/25.jpg)
![Page 26: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/26.jpg)
Biblissima: MSS of Francehttp://demos.biblissima-condorcet.fr/chateauroux/
![Page 27: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/27.jpg)
![Page 28: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/28.jpg)
![Page 29: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/29.jpg)
Many views => many canvases
A manifest is a sequence of views
A viewer loads the manifest and renders the views
https://wellcomelibrary.org/iiif/b28769454/manifest
![Page 30: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/30.jpg)
As well as manual addition of annotation content, machines can make them too.
The biggest source of machine annotations is straightforward OCR
Machine processesalso add content
![Page 31: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/31.jpg)
![Page 32: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/32.jpg)
Here, natural language processing is identifying entities, which can then be used by humans to tag and find other content.
Humans and machines can collaborate
![Page 33: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/33.jpg)
![Page 34: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/34.jpg)
Summary
(0,0)
(3110, 2102)
Publishers provide canvases
All content is placed onthe canvas throughannotations
Images, text – from the publisher and from anyone else
![Page 35: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/35.jpg)
SomeDescription
of the Thing
![Page 36: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/36.jpg)
![Page 37: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/37.jpg)
![Page 38: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/38.jpg)
What is IIIF?
International Image ???Interoperability Framework
But we have AV!
![Page 39: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/39.jpg)
Canvases can now have duration(0,0)
(3110, 2102)
🕐
![Page 40: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/40.jpg)
• This canvas has a mixture of image, video and text annotations, targeting different regions of the x,y space and different extents of the canvas duration.
• The user interface gives the user control of the canvas time
![Page 41: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/41.jpg)
![Page 42: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/42.jpg)
![Page 43: An Introduction to IIIF - raa.se...Image API Presentation API •Descriptive metadata doesn’t help us get pixels on screen •Read the pages •Look at the brush strokes •See the](https://reader035.fdocuments.us/reader035/viewer/2022062311/5fb4b13178c5b256b1037dcd/html5/thumbnails/43.jpg)
International Image Interoperability Framework
…thanks!Tom Crane#IIIF @tomofhernehill
Digirati Ltd @digirati_uk
Swedish National Heritage Board, Stockholm, 11 March