Towards more smart, connected and open audiovisual archives

77
Johan Oomen Head of Research Netherlands Institute for Sound and Vision @johanoomen Towards more smart, connected and open audiovisual archives 29 October 2014 http://sipad2014.sched.org

description

As a result of digitisation of analogue holdings and working processes, more and more material from audiovisual archies is being made available online. This marks a transformative shift, as archives and users are now sharing the same information space. Once digital and part of an open network, objects from audiovisual archives can be shared, recommended, remixed, embedded, cited, referenced to and so on. It is a far cry from several years ago, when users were obliged to visit brick and mortar institutions to access collections. This shift towards digital enables archives to fulfil their pubic missions better; crossing geographical boundaries, using new channels for content distribution, engage with user groups and use new technologies to make work processes more efficient and allow for new access points to collections. It also introduces fundamental challenges, forcing audiovisual archives to [1] rethink their role and function in the value chain of media production and modern society at large, [2] assess which activities and competences are vital to succeed in a digital context. We envision the future audiovisual archives to be smart, connected and open; using smart technologies to optimise workflows for annotation and content distribution. Collaborating with third parties to co-design and co-develop new technologies in order to manifest themselves as frontrunners rather than followers. Being connected to other sources of information (other collections, contextual sources), to a variety of often niche user communities, researchers and the creative industries. To embrace the use of standards defined by external instances rather than by the cultural heritage communities themselves. Fully embrace ‘open’ as the default to have maximum impact in society: applying open licences for content delivery, using open source software and open standards wherever possible. Promote open access to publications and so on. This keynote examines how the public mission of archives (i.e. supporting a myriad of users to utilize collections to learn, experience and create) can be achieved in a digital context. It addresses the challenges related to the role and function of institutions and provides practical insights in how archives can establish a culture of innovation to manage challenges they face today. It addresses some of the major questions audiovisual archives are faced with today.

Transcript of Towards more smart, connected and open audiovisual archives

Page 1: Towards more smart, connected and open audiovisual archives

Johan Oomen Head of Research

Netherlands Institute for Sound and Vision @johanoomen

Towards more smart, connected and open audiovisual archives

29 October 2014http://sipad2014.sched.org

Page 2: Towards more smart, connected and open audiovisual archives
Page 3: Towards more smart, connected and open audiovisual archives
Page 4: Towards more smart, connected and open audiovisual archives
Page 5: Towards more smart, connected and open audiovisual archives
Page 6: Towards more smart, connected and open audiovisual archives
Page 7: Towards more smart, connected and open audiovisual archives
Page 8: Towards more smart, connected and open audiovisual archives

A

10,3 petabyte (October. 2014)

Visuals https://vimeo.com/51425368 - Sebastiaan ter Burg CC-BY

+ backup 10,3 petabyte

Page 9: Towards more smart, connected and open audiovisual archives

A

- broadcast archives- national audiovisual archives

- libraries with AV collections- museums, footage sales libraries, …

A variety of ‘entities’ look after audiovisual collections!

- private ‘archives’

http

s://w

ww

.flic

kr.c

om/p

hoto

s/49

8738

08@

N00

/ (cc

-by)

Page 10: Towards more smart, connected and open audiovisual archives

Source: http://blog.1000memories.com/94-number-of-photos-ever-taken-digital-and-analog-in-shoebox Date of publication: 2011. Note 1000 Memories stopped its operations after being acquired by Ancestry

Page 11: Towards more smart, connected and open audiovisual archives

Institutions and missions

- “As guardian of Dutch audiovisual heritage, we keep Dutch history, as documented in moving images, alive. We enable everyone to utilize the collections to learn, experience and create.” (mission Sound and Vision)

- “[a library] is a place where a nation nourishes its memory, and exerts its imagination - where it connects with its past and invents its future” (Pierre Ryckmans, 1996)

- „places that foster curiosity, celebrate ideas and enable discovery.” (sxswLAM community, http://www.sxswlam.com/)

Page 12: Towards more smart, connected and open audiovisual archives

Impact

1. We are more effective and efficient in delivering change and tangible benefits (Internal Impact);

2. Our organization is gaining strategic advantage through the innovation inherent in this digital activity (Innovation Impact);

3. We are delivering a strong economic benefit to our community that demonstrate the worth and value of our endeavours in clear monetary terms (Economic Impact);

4. and the community has been changed by the resource in beneficial ways that can be clearly identified (Social Impact)

Source: Simon Tanner, Kings College London http://www.kdcs.kcl.ac.uk/innovation/impact.html

Page 13: Towards more smart, connected and open audiovisual archives

The picture we love…

- Source: http://www.avid.com/static/resources/common/documents/whitepapers/Avid_Everywhere.pdf

…where everything revolves around the archive-

Page 14: Towards more smart, connected and open audiovisual archives

…in the meantime

- Content production changes - Distribution changes - Media consumption changes - Business models change - Attention economy - Copyright legislation hardly changes

Page 15: Towards more smart, connected and open audiovisual archives

A

Source: https://vimeo.com/68370703

Page 16: Towards more smart, connected and open audiovisual archives

Source: kpcb.com/InternetTrendsNote: 1 petabyte = 1MM gigabytes, 1 zetabyte = 1MM petabytes.

2/3rd’s of digital universe Content = consumed & created by consumers

Page 17: Towards more smart, connected and open audiovisual archives

New stars!

Page 18: Towards more smart, connected and open audiovisual archives

Source: Horowitz Associates, State of Cable and Digital Media Report, 4/14. Note: Study based on 1,200 interviews in 1/14 among heads of households (18+) who watch any kind of TV. Live TV defined as watching linear programming that is not time-shifted from original programming time intended. TV Content defined as any type of video content. Computer includes desktop + notebook. Mobile includes smartphone + tablet.

‘device share’ of TV Content

Page 19: Towards more smart, connected and open audiovisual archives

Content distribution

Page 20: Towards more smart, connected and open audiovisual archives

(not so legal) Content distribution

Page 21: Towards more smart, connected and open audiovisual archives

In the news this week…

Page 22: Towards more smart, connected and open audiovisual archives

84% of mobile owners use devices while watching TV

Source: Nielsen Connected Devices Report, Q3, 2013Sample = 13+ years old, 9,448 respondents who own a mobile device (tablet, smartphone, etc.)

Page 23: Towards more smart, connected and open audiovisual archives

thousands of hrs of new television content produced by Dutch public broadcasters every year

Hours of archival content of Sound and Vision used in this new content

Attention economy - some guestimates (1/2)

Page 24: Towards more smart, connected and open audiovisual archives

Total collection of Sound and Vision 750k of hours (& growing daily)

we need different channels!

competing for attention

Attention economy - some guestimates (2/2)

Page 25: Towards more smart, connected and open audiovisual archives

Sound and Vision - Channels (3 examples…)general public & creative industries

media studies scholars general public

Page 26: Towards more smart, connected and open audiovisual archives

Ahere we go!

Page 27: Towards more smart, connected and open audiovisual archives

A

how do we reach out to new user groups? What is the level and

nature of engagement we seek?

Page 28: Towards more smart, connected and open audiovisual archives

A

what service level do we provide to new user groups? (digital humanities scholars,

tourism, app developers, and so on)

Page 29: Towards more smart, connected and open audiovisual archives

A

how can we fulfill our missions in the context of current copyright legislation, especially for recent

(in copyright) material?

Page 30: Towards more smart, connected and open audiovisual archives

A

what is our position in the ‘value chain’ in an post-analogue

context? Which services do we provide next to services offered

by market players?

Page 31: Towards more smart, connected and open audiovisual archives

A…..

Source - Pedro Venzini (cc-by)

Page 32: Towards more smart, connected and open audiovisual archives

Smart OpenConnected

We need more of this

Page 33: Towards more smart, connected and open audiovisual archives

Smart

– using new technologies for indexing and retrieval and linking

– link to workflows of the creative industries – explore distribution over various devices and

platforms

Page 34: Towards more smart, connected and open audiovisual archives

Audiovisual broadcasts

Professional annotation

Search engine

Television makers

General public

Academics

Page 35: Towards more smart, connected and open audiovisual archives

Television makers

General public

AcademicsProfessional annotation

Audiovisual broadcasts

Search engine

Machine analysis Data gathering

Page 36: Towards more smart, connected and open audiovisual archives

WikisTwitter

Subtitles

Importer

NewsCrowdsourcing

Data gathering

Page 37: Towards more smart, connected and open audiovisual archives

• Large-scale data for some programs

• Access to opinions about television

• Puts programs in larger national context

• Affordable

• Noisy data (sometimes)

• Not created for the archive

• Unclear how the data can be used (sometimes)

Data gathering: pros and cons

Page 38: Towards more smart, connected and open audiovisual archives

Low-level features

Multimediacontent analysis

today sniper fire disrupted the funeral of an eleven year old ethnic albanian boy he was killed yesterday while while chopping wood his family blames serb police before his death louisiana state police now say six workers were killed after a natural gas well exploded and caught fire about forty five miles east of shreveport four others were injured in yesterday's blast a police spokesman says the derek started to melt in the intense heat the

Audio transcripts Concept detectors

Speaker recognition Face recognition

Machine analysis

Page 39: Towards more smart, connected and open audiovisual archives

• Extremely detailed, millisecond-level descriptions

• Directly describe video content

• Affordable

• Large scale!

• Noisy

• Limited to what the machine “knows”

• No summarisation of what is important

• Confusing for users

Machine analysis: pros and cons

Page 40: Towards more smart, connected and open audiovisual archives

AXES project

Source: http://www.youtube.com/watch?v=LVfrSnmHE2o Via: www.axes-project.eu/

Page 41: Towards more smart, connected and open audiovisual archives

Connected

- to users: Sound of the Netherlands

- between collections: EUscreen

- to distributed content: After the Libration

Page 42: Towards more smart, connected and open audiovisual archives

Sound of the Netherlands

Step 1: uploading hundreds of high quality, digitized archival sounds to Soundcloud

www.geluidvannederland.nl

Page 43: Towards more smart, connected and open audiovisual archives

Sound of the Netherlands

Step 2: placing the sounds on the map & ask the world to contribute

Page 44: Towards more smart, connected and open audiovisual archives

Sound of the Netherlands

enrichments on Soundcloud

inserts in Wikipedia pages

app ‚Mix van Nederland’

https://en.wikipedia.org/wiki/Emperor_Goosehttp://tools.wmflabs.org/glamtools/baglama.php?

https://soundcloud.com/beeldengeluid/commentaar-en-racegeluiden-op

„Sound of the emperor goose”

Page 45: Towards more smart, connected and open audiovisual archives

45

Pan-European Aggregator for Audiovisual Heritage

www.euscreen.eu

Page 46: Towards more smart, connected and open audiovisual archives

The consortium

Page 47: Towards more smart, connected and open audiovisual archives

The network

Page 48: Towards more smart, connected and open audiovisual archives

The website (1/2)

Page 49: Towards more smart, connected and open audiovisual archives

The website (2/2)

tens of thousands of video’s and photo’s

Page 50: Towards more smart, connected and open audiovisual archives

Beyond search => context!

exhibitions academic journal

Page 51: Towards more smart, connected and open audiovisual archives

EuropeanaNational Library of Spain (597)

Complutense University Library of Madrid (194) EuroPhoto ANP provider (145)

Audiovisual Library of the European Commission (127) Världskulturmuseet (93)

Bodleian Libraries, University of Oxford (84) askaboutireland.ie (83)

Classical Renaissance (64) Etnografiska museet (42)

Royal Albert Memorial Museum (35) National Library of the Netherlands - Koninklijke Bibliotheek (26)

Austrian National Library (21) Ghent University Library (20)

EuroPhoto SCANPIX provider (19) Ethnologisches Museum, Staatliche Museen zu Berlin (13)

Royal Museums Greenwich (11) Stadtgeschichtliches Museum Leipzig (10) e_Buah (Universidad de Alcalá, Spain) (9)

The Wellcome Library (8) TopFoto.co.uk (8)

Archiv der sozialen Demokratie (AdsD) (7) Botanic Garden and Botanical Museum Berlin-Dahlem (7)

Consiglio nazionale delle ricerche (7) Muséum national d'Histoire naturelle (7)

Natural History Museum, Vienna - Herbarium W (7) CulturaItaliaInternet Culturale / biblioteca nazionale centrale - firenze (6)

Hunterian Museum (5) Nationaal Archief (5)

Uppsala University (5) VGA (5)

DW-WORLD.DE | Deutsche Welle (4) ČT (4)

Architekturmuseum der Technischen Universität Berlin in der Universitätsbibliothek (3) Bavarian State Library (3) Det Danske Filminstitut (3) EuroPhoto MTI provider (3) Imperial War Museums (3)

Sportmuseum Vlaanderen - Centrum voor Sportcultuur (3) University of Vienna, Institute for Botany - Herbarium WU (3)

Amsab-Institute of Social History (2) Biblioteca Virtual del Patrimonio Bibliográfico (2)

Collecting Records OMP (2) CulturaItaliaMuseiD-Italia (2) EuroPhoto DPA provider (2)

Fitzwilliam Museum (2) Natural History Museum of Denmark (2)

Netherlands Centre for Biodiversity Naturalis (2) Smithsonian Institution Libraries (2)

TVC (2) Uppsala Universitet (2)

architekturclips_network (2) Alinari Archives (1)

Arts Productions Ltd (1) Atria, Institute on Gender Equality and Women's History (1)

Biblioteca Virtual Miguel de Cervantes (1) Bibliothek der Friedrich-Ebert-Stiftung (1)

Catalogue en ligne Carmentis (1) Cinecittà Luce S.p.A. (1)

Danish Broadcasting Corporation (1) Deutsche Welle (1)

Deutsches Filminstitut - DIF (1) Digital Mechanism and Gear Library - www.dmg-lib.org (1)

Digitum : Depósito de la Universidad de Murcia (1) Frauenforschungs-, -bildungs- und -informationszentrum FFBIZ e.V. (1)

Fundacion Albeniz (1) Gerstein - University of Toronto (archive.org) (1) Gredos (Universidad de Salamanca, Spain) (1)

Hedatuz (1) Institut National de l'Audiovisuel (1)

Institutul Național al Patrimoniului (1) Kunst i offentlige rom - KORO (1)

Lippmann+Rau-Stiftung (Lippmann+Rau Foundation); Germany (1) MAC's Grand-Hornu (1) MBLWHOI Library (1)

Minerva (Universidade de Santiago de Compostela, Spain) (1) ModeMuseum Provincie Antwerpen (1)

Museum of Archaeology and Anthropology (University of Cambridge), Cambridge, UK (1) Museum of Fine Arts Ghent (1)

Museum voor Schone Kunsten Gent (1) NIOD (1)

Nasjonalbiblioteket (1) National Library of Denmark (1) National Széchényi Library (1) Norges Olympiske Museum (1)

OAPEN Foundation (1) Open Society Archives at Central European University (1)

Portable Antiquities (1) Repozytorium Politechniki Krakowskiej (1)

Research Libraries UK (1) Rijksmuseum (1)

Ringve (1) Royal Botanic Gardens, Kew (1)

SNM - Historické múzeum v Bratislave (1) Sunnfjord Museum (1)

Swiss National Library (1) The European Library (1)

The Military Archives of Sweden (1) Universitat Jaume I (1)

University of California Libraries (archive.org) (1) University of Florida, George A. Smathers Libraries (archive.org) (1)

VRT (1)

the query for “Mexico City” => results from 101 memory organisations.

32+ million objects (October 2014)

Page 52: Towards more smart, connected and open audiovisual archives

EuropeanaNational Library of Spain (597)

Complutense University Library of Madrid (194) EuroPhoto ANP provider (145)

Audiovisual Library of the European Commission (127) Världskulturmuseet (93)

Bodleian Libraries, University of Oxford (84) askaboutireland.ie (83)

Classical Renaissance (64) Etnografiska museet (42)

Royal Albert Memorial Museum (35) National Library of the Netherlands - Koninklijke Bibliotheek (26)

Austrian National Library (21) Ghent University Library (20)

EuroPhoto SCANPIX provider (19) Ethnologisches Museum, Staatliche Museen zu Berlin (13)

Royal Museums Greenwich (11) Stadtgeschichtliches Museum Leipzig (10) e_Buah (Universidad de Alcalá, Spain) (9)

The Wellcome Library (8) TopFoto.co.uk (8)

Archiv der sozialen Demokratie (AdsD) (7) Botanic Garden and Botanical Museum Berlin-Dahlem (7)

Consiglio nazionale delle ricerche (7) Muséum national d'Histoire naturelle (7)

Natural History Museum, Vienna - Herbarium W (7) CulturaItaliaInternet Culturale / biblioteca nazionale centrale - firenze (6)

Hunterian Museum (5) Nationaal Archief (5)

Uppsala University (5) VGA (5)

DW-WORLD.DE | Deutsche Welle (4) ČT (4)

Architekturmuseum der Technischen Universität Berlin in der Universitätsbibliothek (3) Bavarian State Library (3) Det Danske Filminstitut (3) EuroPhoto MTI provider (3) Imperial War Museums (3)

Sportmuseum Vlaanderen - Centrum voor Sportcultuur (3) University of Vienna, Institute for Botany - Herbarium WU (3)

Amsab-Institute of Social History (2) Biblioteca Virtual del Patrimonio Bibliográfico (2)

Collecting Records OMP (2) CulturaItaliaMuseiD-Italia (2) EuroPhoto DPA provider (2)

Fitzwilliam Museum (2) Natural History Museum of Denmark (2)

Netherlands Centre for Biodiversity Naturalis (2) Smithsonian Institution Libraries (2)

TVC (2) Uppsala Universitet (2)

architekturclips_network (2) Alinari Archives (1)

Arts Productions Ltd (1) Atria, Institute on Gender Equality and Women's History (1)

Biblioteca Virtual Miguel de Cervantes (1) Bibliothek der Friedrich-Ebert-Stiftung (1)

Catalogue en ligne Carmentis (1) Cinecittà Luce S.p.A. (1)

Danish Broadcasting Corporation (1) Deutsche Welle (1)

Deutsches Filminstitut - DIF (1) Digital Mechanism and Gear Library - www.dmg-lib.org (1)

Digitum : Depósito de la Universidad de Murcia (1) Frauenforschungs-, -bildungs- und -informationszentrum FFBIZ e.V. (1)

Fundacion Albeniz (1) Gerstein - University of Toronto (archive.org) (1) Gredos (Universidad de Salamanca, Spain) (1)

Hedatuz (1) Institut National de l'Audiovisuel (1)

Institutul Național al Patrimoniului (1) Kunst i offentlige rom - KORO (1)

Lippmann+Rau-Stiftung (Lippmann+Rau Foundation); Germany (1) MAC's Grand-Hornu (1) MBLWHOI Library (1)

Minerva (Universidade de Santiago de Compostela, Spain) (1) ModeMuseum Provincie Antwerpen (1)

Museum of Archaeology and Anthropology (University of Cambridge), Cambridge, UK (1) Museum of Fine Arts Ghent (1)

Museum voor Schone Kunsten Gent (1) NIOD (1)

Nasjonalbiblioteket (1) National Library of Denmark (1) National Széchényi Library (1) Norges Olympiske Museum (1)

OAPEN Foundation (1) Open Society Archives at Central European University (1)

Portable Antiquities (1) Repozytorium Politechniki Krakowskiej (1)

Research Libraries UK (1) Rijksmuseum (1)

Ringve (1) Royal Botanic Gardens, Kew (1)

SNM - Historické múzeum v Bratislave (1) Sunnfjord Museum (1)

Swiss National Library (1) The European Library (1)

The Military Archives of Sweden (1) Universitat Jaume I (1)

University of California Libraries (archive.org) (1) University of Florida, George A. Smathers Libraries (archive.org) (1)

VRT (1)

now: built new apps using this content!

32+ million objects (October 2014)

Page 53: Towards more smart, connected and open audiovisual archives

After the Liberation

• Enriched version of “After the Liberation’, a 7-part documentary

• Original sources: films, soundtracks, photos & newspaper articles used in the series and as research material

• From official archives (45) to personal collections (35)

• Tablet-first development: more and more tv-viewers use tablet during and after viewing

www.nadebevrijding.nl

Page 54: Towards more smart, connected and open audiovisual archives
Page 55: Towards more smart, connected and open audiovisual archives
Page 56: Towards more smart, connected and open audiovisual archives
Page 57: Towards more smart, connected and open audiovisual archives
Page 58: Towards more smart, connected and open audiovisual archives

Open

FULFILL  THEIR  PUBLIC  MISSION  “For  content  to  be  truly  accessible,  it  needs  to  be  where  the  users  are,  

embedded  in  their  daily  networked  lives.”  (Wabel,  2009)  

STIMULATING  COLLABORATION  AND  CREATIVITY    “No  maSer  who  you  are,  

most  of  the  smartest  people  work  for  someone  else.”  (Joy’s  Law,  via  Michael  Edson)  

Page 59: Towards more smart, connected and open audiovisual archives
Page 60: Towards more smart, connected and open audiovisual archives
Page 61: Towards more smart, connected and open audiovisual archives

• open licences

• open source, open standards

• various collections

• syndication!!

Open Images www.openimages.eu

Page 62: Towards more smart, connected and open audiovisual archives

“if it doesn’t spread, it’s dead” (Jenkins, 2013)

Syndication as strategy

Page 63: Towards more smart, connected and open audiovisual archives
Page 64: Towards more smart, connected and open audiovisual archives

MW2012

Page 65: Towards more smart, connected and open audiovisual archives

Example: ‘soccer’ page Dutch Wikipedia

Page 66: Towards more smart, connected and open audiovisual archives

Measuring impact

Number of items on Wikimedia Commons 1,600

Number of articles on Wikipedia 2,000

Number of language versions 70

Number of views 50,000,000!!!

2013 numbers http://www.openimages.eu/blog/2014/09/sound-and-vision-on-the-future-of-video-on-wikipedia/

Page 67: Towards more smart, connected and open audiovisual archives

Positive effects of ‘open’

Source: Europena (cc-by)

Page 68: Towards more smart, connected and open audiovisual archives

Conclusion

Source: https://vimeo.com/103364847

Page 69: Towards more smart, connected and open audiovisual archives

69

Page 70: Towards more smart, connected and open audiovisual archives

What can you do today: smart

- Collaborate with computer science university - Identify areas where you can use open source

technology - Only outsource what you understand - Explore ‘two speed’ IT: loose coupling of:

- asset management & storage (slow) - access (fast, agile)

Page 71: Towards more smart, connected and open audiovisual archives

What can you do today: connected

- Users are digital, mobile & online - social media strategy - bring content where users are - syndicate! - convenient

- Educate staff - cataloguers & bloggers

- Forge new partnerships - Content creators - Humanities scholars

Page 72: Towards more smart, connected and open audiovisual archives

What can you do today: open

- Use open licenses and encourage others to do so too

- Join the conversation: http://openglam.org - Follow a course: https://p2pu.org/en/groups/

open-glam/

Page 73: Towards more smart, connected and open audiovisual archives

Jason Ryan: http://www.slideshare.net/jasonryan/mcn-measuring-engagement (via Simon Tanner)

institutional websites

Measuring Measuring

Page 74: Towards more smart, connected and open audiovisual archives

74

A

'the virtues of an archivist: rage, paranoia and kleptomania’

Jason Scott

…lets add ‘fearlessness’

Page 75: Towards more smart, connected and open audiovisual archives

A

75

Page 76: Towards more smart, connected and open audiovisual archives

Credits

Johan Oomen Netherlands Institute for Sound and Vision

@johanoomen

Many thanks to: - Lotte Belice Baltussen @lottebelice - Maarten Brinkerink @mbrinkerink - Jesse de Vos @85jesse - Bouke Huurnink - Roeland Ordelman - @RoelandOrdelman - Erwin Verbruggen - @erwinverb - Michael Edson - @mpedson

www.highexistence.com/images/view/where-the-magic-happens-vs-your-comfort-zone-2/

Page 77: Towards more smart, connected and open audiovisual archives

Johan Oomen Head of Research

Netherlands Institute for Sound and Vision @johanoomen

Towards more smart, connected and open audiovisual archives

29 October 2014http://sipad2014.sched.org