Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

47
Towards Open Pervasive Displays Adrian Friday, Lancaster University, UK Thanks to: Nigel Davies, Sarah Clinch, Oliver Storz, Christos Efstratiou and the eCampus and PD-NET teams.

description

We discuss the challenges of opening up networks of public displays to wider control (based on our experiences of eCampus) and postulate what might happen if we open up to applications also (global networks of displays, content and applications, c.f. http://pd-net.org)

Transcript of Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Page 1: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Towards Open Pervasive Displays!Adrian Friday, Lancaster University, UK! Thanks to: Nigel Davies, Sarah Clinch, Oliver Storz, Christos Efstratiou and the eCampus and PD-NET teams.

Page 2: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

I’m from Lancaster in UK!

About 1 hour from Liverpool and Manchester (United)!

About 250 miles from London!

Experimental systems focused department!

!

Page 3: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

My background!

1990! 1995! 2000! 2005! 2010!

Mobile"Collaboration!

Mountain"rescue!

Context-aware"GUIDE!

Equator: Physical - "Digital!

Open Interactive "Public Displays!

Page 4: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Why real world systems?!To probe – beyond participatory design!

Ultimate ‘acid test’ of acceptability!

Teaches you about Ubicomp ‘for real’!

Naturalistic evaluation (you say ‘it’s good for doing X for community Y’, is it?)!

Increasingly the ‘gold standard’ in major conferences!!

Championed in Oulu!!

Page 5: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Why not real"world systems?!

Uncontrolled environment!

Effort (initial, ongoing support and in generating high quality content and applications)!

Remote: “out of sight, out of mind”!

Unsupervised!

Often built out of COTS hardware not designed for the domain!

The unexpected happens!!

Page 6: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

The only future for displays?!

Minority Report, 20th Century Fox, 2002 http://bit.ly/cKSOop

Is Pervasive Advertising the only future for ubicomp displays?!

Page 7: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Overview!Experiences of opening up our network of displays on campus!

Particularly a user and display owner facing interface!

Postulate how we might move beyond this for applications!

Some early ideas about challenges and avenues to explore!

Page 8: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

FLUMP Adaptive Signage, 1996!

J. Finney, N. Davies, FLUMP - The FLexible Ubiquitous Monitor Project, Proceedings of the 3rd Cabernet Radicals Workshop, Connemara, May 1996

And then we had to take it down for fire safety reasons!!

Badges triggered personal pages

embedding the output of crude ‘apps’!

Page 9: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

e-Campus, 2005-!

Large-scale deployment of networked displays across the campus (approx £0.5 million budget)!

•  To create a large scale experimental testbed in public displays and ubiquitous computing across campus!

•  To act as a catalyst for world class research in ubiquitous computing!

•  To enhance the image of Lancaster University for staff, students and visitors!

Specific focus on creating an open research infrastructure – but that only paid for the kit and running real world systems is hard!!

Page 10: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Requirements for standard content and proprietary applications."

Content from a range of different sources: arbitration, priorities and

preemption, wide range of scheduling criteria (interaction, time, …), dynamic

length!

O. Storz, A. Friday, N. Davies, J. Finney, C. Sas, and J. Sheridan. Public ubiquitous computing systems: Lessons from the e-campus display deployments.

IEEE Pervasive Computing, 05(3):40–47, 2006.

Page 11: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

The e-Campus platform for display networks!

Flexible distributed infrastructure!

•  Small set of management processes on each display machine communicate over Elvin pub-sub event broker!

•  Low level API for building range of schedulers and presentation tools!

•  Abstractions hide specialised hardware, AV switching and distribution!

•  Provide support for transactions on displays (Control, Atomicity and Isolation) – can use them in concert!

•  HTTP based high-level API supporting the display of sets of content subject to a set of constraints!

Page 12: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Status: 70 displays: 40 door displays, 25 Large LCD panels in colleges and foyers, and 5 projected displays "(e.g. theatre)!

Ref: Keith Cheverst!

Page 13: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Applications!

N. Davies, A. Friday, P. Newman, S. Rutlidge and O. Storz Using Bluetooth Device Names to Support Interaction in Smart Environments MobiSys 2009

•  Bluetooth Friendly Name (Map, Google, Flickr, YouTube, TinyURL…)!

•  Follow me Content (LitFest)!

•  ‘Capture the Campus’ MR game!

•  Main ‘app’ is digital signage!!

Page 14: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Applications!But, these are all ‘insider’

apps – by us, trusted, using our internal framework. More complex apps require

manual deployment.!

Page 15: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

OPENING UP CONTENT AND DEVOLVING CONTROL!

Letting go of top down control of content!

Page 16: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

The Channel System!Initially – production and experimental systems co-existed - users sent us their content!!

The Channel systems allowed trusted user groups to schedule content on their own and others displays – it’s deliberately simple!

Separates content provision and display ownership!

The primary method for control of the e-Campus displays (for approaching 3 years)!

Page 17: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Channel!Users create private or

public channels ‘shared folders’ for content.

Channels may have time constraints. Stimulate a

(content) ‘network effect’.!

Page 18: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Displays!Display owners

subscribe to one or more channels!

Page 19: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

And it works fairly well…!33 user groups (about 80 active users) - > 50% have used the system for > 1 year!

Over 1,700 unique content items (3,700 content items) since 2008!

Supports a variety of media (images, movies, urls)!

The only serious issue we have is poor handover when staff changes are made!

Some evidence of gaming the system!

Page 20: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Typical content!

Page 21: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)
Page 22: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

2008-05

2008-06

2008-07

2008-08

2008-09

2008-10

2008-11

2008-12

2009-01

2009-02

2009-03

2009-04

2009-05

2009-06

2009-07

2009-08

2009-09

2009-10

2009-11

2009-12

2010-01

2010-02

2010-03

2010-04

2010-05

2010-06

2010-07

2010-08

2010-09

2010-10

2010-11

2010-12

2011-01

2011-02

2011-03

2011-04

0

20

40

60

80

100

120

140 imageurlvideostreamunsupported

> 80% of content are

images (toolchain and effort)!~40% of channel providers have used video at some point!Links to

webpages least effective!!

Looking deeper!

Page 23: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Surprisingly little temporal and locative coherence!

Rarely bound to location, but sometimes audience!

24% of content items had no obvious time constraints!

8% had a validity of one day (sometimes repeated)!

8% had a validity of up to week!

12% up to a month!

21% a validity of 2-3 months, and!

12% a validity of 1 year!

!

Page 24: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Or long (~120 days), - roughly a University Semester!

Content lifetime is short (7-10 days)!

People are much better at adding content than removing it!!

Page 25: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

!"#$%&'()*+,''-.%)/012,'(.-%34),"#$%&'()"2%5.,6)%$7%*125&8'%)/*18%%-%3),'")98"2:62'()*8'0-'0);2,)0+-)<.-)%6%0-9)/"80%3))=',7.-")08)>81?)"2@-1-'0.6)

A,B-1'%)8:)*+,''-.)$%-)

Page 26: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Arts

Bui

ldin

g 1

Bui

ldin

g 2

Business

Careers

Chap

Dep

ED

ep P

Dis

p. D

ev.

Estates

Facu

lty 1

Facu

lty 2

L. T

ech. PR

Pro

j 1R

es 1

Res

2R

es 3

Res

4R

es 5

Res

6R

es 7

Res

8R

es 9

St.

Exp

.S

t. R

ecru

it.S

t. S

ervi

ces

St.

Uni

onStudent

Theatre

Volunt.

CHANNEL_SUSPENDCHANNEL_DELETECHANNEL_ADDCHANNEL_ACTIVATE

Num

ber o

f eve

nts

0

20

40

60

80100 channels (64 currently marked ‘active’)!

50% are shared, 50% private!Considerable differences between users!-  to organise,

organisational change!

Channels are suspended but not often removed!

Page 27: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Discussion!The channel system has been very effective at devolving control of content scheduling!

The combination file system + web approach is very successful!

It’s conceptually simple and easy to learn!

User peeves: can’t order ‘slides’, can’t preview channel content!

Would this approach work for applications and more interactive content?!

No! Regular users can’t create the apps! So

who can?!

Page 28: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

!"#$!%!&"'(&%

)*+,-C)DE--4)F1,2'4)>+,0)"8)68$)>,'0)

08)"8)08'2(+0GD)./0%'12*+C)DH+-)

%,9-)0+2'()>-)"8)-;-16)'2(+04)A2'?6I016)08)0,?-)8;-1)0+-)

>81."JK)

Kids' WB, 1995-2001

Page 29: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

An “Open” Approach!Current systems are closed – small networks under a single management domain!

Difficult to introduce new applications, new content or interaction!

A new infrastructure that supports a “global” network of displays & interaction and personalisation on that scale!!

New approach for applications that decouple display ownership from content production!

Need to tap into wide (global) community of developers, 3rd party applications!

Page 30: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Open is more content, developers, communities and customers!

http://econ.st/ifJr5g

Page 31: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

So, writing apps is hard… we need app stores!!

http://read.bi/johtdH

For fun,"for profit!

Page 32: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

CHALLENGES!But that may not be entirely straightforward…!

Page 33: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Scale: who controls what - Control vs.

Abuse, hierarchy, overlay, cloud, P2P?!

http://bit.ly/bcChQj

Page 34: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Personalisation, context-aware or privacy violation?!

http://www.cityware.org.uk/

Page 35: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Who pays, and who gets the revenue?!

More stakeholders, apps not entirely

personal, infrastructure not

owned by the end user!

Page 36: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

DISPLAY APP MARKET!What might we see (as well as inevitable advertising)?!

Page 37: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Being Artistic!http://www.simultaniaproject.com/!

Page 38: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Inevitably… games, social media!

http://locamoda.com

Page 39: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Surprising hobbies… http://ww

w.laptopreview

s.org.uk/wp-content/uploads/2009/02/grandm

a-in-the-park3.jpeg

http://ww

w.truepunk.com

/wp-content/uploads/hitthelights.jpg

Memarovic N, Langheinrich M. “Your place or mine?” – Connecting communities and public places through networked public displays. Urban Internet of Things - Towards Programmable Real-time Cities (UrbanIOT 2010); Workshop at the 2nd Intl. Conference on the Internet of Things (IOT2010), December 2010

Airtime to Local Issues!

Page 40: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Sustainable local food?!

Photographer: Sarah Lee, http://bit.ly/knnKkU

Page 41: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Part of pan-global events?!

http://www.avert.org/

Page 42: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Wider: Events, Disasters, Human Rights, Climate Change!

Image of Tokyo Tsunami removed for copyright reasons.!

Page 43: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Support local events, "share globally…!

Communities of interest rather than geography? !

Some rights reserved, Sepultura, http://bit.ly/k6dM3j2

Page 44: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

The Internet of displays ?!“Change spaces with public displays - from spaces where information is pushed to passers-by in the form of adverts to spaces that can be tailored to reflect the hopes, aspirations and interests of its occupants using content and applications created anywhere in a global network.”!

http://pd-net.org

http://www.facebook.com/pdnet

Page 45: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

To conclude!The channels system lets us open up control of our network to interest groups!

We create a network of content that is shared – its been largely successful too!

The next step is moving to a pan-European testbed (3 nodes so far: Switzerland, Germany and Portugal)!

Join in helping to overcome the challenges!"http://pd-net.org!

Page 46: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

A unique opportunity!

A globally unique infrastructure testbed of displays and wireless coverage!

A model for conducting ‘in the wild’ Ubicomp research!

An incredible pioneering achievement – and we appreciate this having tried something similar!!

A proving ground for future Ubicomp business ideas!

http://www.ubiweek.fi/

Page 47: Towards Open Pervasive Displays (Keynote at UbiSummit, Helsinki, May 2011)

Adrian Friday!School of Computing and Communications!InfoLab21, Lancaster [email protected]!Tel: +44 (0)1524 510326!

Image: http://www.kingofboxes.co.za