E3 wesker kuflik_novel_technologylivinglab
-
Upload
evaminerva -
Category
Education
-
view
21 -
download
4
Transcript of E3 wesker kuflik_novel_technologylivinglab
Automatic or Manual Path: a Groupware application for
Museum Visit Planning using Interaction with Situated Displays
Inna Belinky
February 3rd, 2016 UNINA 1
Novel technology at the fingertips of the visitors: A living research lab
Alan J. Wecker Tsvi Kuflik
EVA/Minerva 2016
Intelligent User Interfaces for Cultural Heritage Exploration
UNINA 2
Automatic or Manual Path: a Groupware application for
Museum Visit Planning using Interaction with Situated Displays
Inna Belinky
February 3rd, 2016
Agenda:
• A modern adaptive guide
• The museum as a living research lab
UNINA 3
The Hecht Museum (Movie)
February 3rd, 2016
The Phoenicians Ancient arts and craftsThe Ma’agan Michael Ship
Second floor coins First floor - archeology Museum’s floor plan
4
• Our goal was to transfer a research prototype of a museum visitors guide into a system that is used by museum visitors on a daily basis– This goal had two practical aspects:
• Museum visitors guide system – available to regular museum visitors
• Living research lab that enables on going research– Experimenting and evaluating novel technology in realistic
setting
Project goal
5
• Knowing where the visitor is– Indoor positioning system
• What about the museum constraints?– Invisible technology…
• What amount of information is needed?• How can we let the visitors know that
information is available?
Challenges
6
• We examined the museum and selected 43 most interesting positions
• We Installed almost invisible indoor positioning system
• We prepared over 300 presentations * three languages
• We introduced additional capabilities– Navigation support– Recommendations– Messaging service
So what did we do?
7
This is how it looks
UNINA 8
Automatic or Manual Path: a Groupware application for
Museum Visit Planning using Interaction with Situated Displays
Inna Belinky
February 3rd, 2016
Agenda:
• A modern adaptive guide
• The museum as a living research lab
9
• We can enable online visit planning • We can enable onsite re-planning• We can enable onsite interaction• We can create a personalized visit summary• We can study indoor navigation• We can study interrupt management• We can monitor visitors’ behavior• We can provide feedback to the curator
So we have an instrumented museum, so what?
Shared setting
Private setting
10
11
Results
Shared setting Private setting
• Speaking time was longer in the private setting. • Private setting was perceived to stimulate more
discussion.
12
• We can enable online visit planning • We can enable onsite re-planning• We can enable onsite interaction• We can create a personalized visit summary• We can study indoor navigation• We can study interrupt management• We can monitor visitors’ behavior• We can provide feedback to the curator
So we have an instrumented museum, so what?
13
Visit summary
14
• We can enable online visit planning • We can enable onsite re-planning• We can enable onsite interaction• We can create a personalized visit summary• We can study indoor navigation• We can study interrupt management• We can monitor visitors’ behavior• We can provide feedback to the curator
So we have an instrumented museum, so what?
15
Landmark-based navigation
UNINA 16
Shared displays study
February 3rd, 2016
17
• We can enable online visit planning • We can enable onsite re-planning• We can enable onsite interaction• We can create a personalized visit summary• We can study indoor navigation• We can study interrupt management• We can monitor visitors’ behavior• We can provide feedback to the curator
So we have an instrumented museum, so what?
Notifications
18
Proactiveness allows systems to provide their users with relevant information (or service) at the right time
• Proactive museum visitors guide is one example for such system
• However, when considering proactiveness, two questions pop up:– When to provide information to the users?
• We do not want to interfere– How to notify the users about the availability of a service ?
• We would like to make sure that the user will get the message
19
Motivation
Content types
– Urgent“The building is on fire! leave now!”
– Important“Don’t make plans for tonight, we will go out for dinner”
– Relevant“Keep your head up even though Ido is boring”
20
21
• We can enable online visit planning • We can enable onsite re-planning• We can enable onsite interaction• We can create a personalized visit summary• We can study indoor navigation• We can study interrupt management• We can monitor visitors’ behavior• We can provide feedback to the curator
So we have an instrumented museum, so what?
An illustrative example
22
Visitor movement styles I
Sto(ry)chastics: A Bayesian Network Architecture for User Modeling and Computational Storytelling for Interactive Spaces by Flavia Sparacino (2003)
• Busy• Selective• Greedy
Visitor movement styles IIVeron E. and Levasseur M. (Ethnographie de l'exposition, Paris, Bibliothèque Publique d'Information, Centre Georges Pompidou (1983)
Classified visitor movements into four styles:
ant fish
grasshopper butterfly
UNINA 25
Visitor Style Pairs• Meekrats• Doves• Ducks• Lone Wolves
February 3rd, 2016
26
• Visualization of visitors’ behavior
Online access to accumulated data
27
• We compared visit logs– Regular visitors that used a mobile guide– Regular visitors that did not use it
The effects of a mobile visitors guide on visitors’ behavior
Results: Conclusions• Using a mobile guide increased visit time
• The mobile guide monopolized visitor’s time– Both holding power and attraction power increased
• The use of the guide disrupted the social interaction of visitors coming in a group
28
Alan J. WeckerU of Haifa,U of Trento
Tsvi KuflikU of Haifa
Oliviero StockFBK-Irst
Dynamic personalization based on Mobile Behavior: from Personality to Personalization:
A Blueprint
Joint work with:Rose Ginosar, Eynat SharonTower of David Museum
• General– Can we use personality data to help our users?
• In what ways?
• Cultural Heritage– What does this mean in a museum context?
• How?– Coerce > Persuade > Influence– Present in a manner which is the most amenable to the user for
his benefit
Problem
• Tower of David Museum a museum within a castle– 6 rooms + Entrance and Exit– 15 Exhibits
Setting
• Some of the Tower of David Museum ExhibitsSetting
Canaanite Period3200 BCE
First Temple Period1006 BCE
Second Temple Period 515 BCE
Byzantine Period324 CE
Roman Period63 CE
Muslim Period638 CE
Crusader Period1099 CE
Ayyubid Period1187 CE
Mamluk Period1260 CE
Ottoman Period1517 CE
British rule – State of Israel1917 CE
Museum Types- based on identity (Falk )
• Explorer • Experience Seeker• Hobbyist/Professional• Recharger• Facilitator• Respectful pilgrims• Affinity seekers
Type Formula
Fish(NPV – PPS >= PPS) ||((PPS/NPV < = T1) &(NPS/PPS < T3 ))
Ant (PPS/NPV > T1 ) &(NPS/PPS > T2)
Butter-fly (PPS/NPV > T1) &(NPS/PPS < T2)
Grass-hopper (PPS/NPV < T1) &(NPS/PPS > T3)
Table 2. Classification of users based on movementThe thresholds T1=0.5, T2=0.5, T3=0.3 were obtained by experimental trial and error until a good clustering was obtained on visitor data at the Hecht Museum (n=400).
Movement pattern
Curiosity Attention Span
Big 5 Falk type %
Grasshopper Low High NO Professional
Hobbyist
41
Fish Low Low NU Recharger 33
Ant High High IO Explorer 10
Butterfly High Low IU Experience Seeker
16
Movement to personality
Table 3 Movement to Personality
• What can you do with personality?– Develop, Exploit, Manage opportunities
• How can use personality to do this?– Increase Awareness– Increase Commitment– Manage the opportunity in an optimum way
(marketing sense)
What do you want to do with personality?
• When increasing Awareness use:– Subtlety– Frequency– Length– Marketing strategy (in the door, in your face…)– Incentive type (different wordings)– Context
• Location• Temporal
– Social (not in this study)
How to do this using personality (Factors)
• Calibration of beacons– Range & Frequency
• People follow a general path (not much chance to express personality)– Physical Constraints
• Stairs• Side Rooms• Natural Flow
– Time Constraints• “Museum Fatigue” (rooms seen at end…)
• Developing Solution– Examine the small variants
Initial insights
Mobile-CH 39
A Novel Image-Based Positioning Technique Using Mobile Eye-Tracker
For Enhancing the Museum Visit
Moayad Mokatren, Tsvi Kuflik and Ilan ShimshoniDepartment of Information Systems
The University of Haifa
Sep 2016
40
Research QuestionHow can we use mobile eye tracker to identify
location and object of interest?
Sep 2016
Mobile-CH
Mobile-CH 41
Architecture
Fixation point
<Descriptor , FixationPoint>
Sep 2016
Broadcaster
Locating
Server
Towards Using Mobile, Head-Worn Displays in Cultural
Heritage: User Requirements and a Research Agenda
Natalia VainsteinThe University of Haifa
Haifa, [email protected]
Tsvi KuflikThe University of Haifa
Haifa, [email protected]
Joel LanirThe University of Haifa
Haifa, [email protected]
The research
• This study focuses on exploring the potential of HWD to enhance the museum visit experience.
• We first aim to fully understand user requirements for such a guide.
• These requirements drive the development of a smart glasses museum visitors' guide prototype which later will be evaluated in a museum setting
System Requireme
nts
Design and implement
ationEvaluatio
n
EVA/Minerva 2016
User Requirements for Glasses-Based Guide
• System Proactiveness – most participants preferred to keep the user in control, where the user decides when to receive information.
November 2016
User Requirements for Glasses-Based Guide Interaction with the device
control the glasses with an accompanied mobile device
using physical touch on the side of the glasses (through buttons or slide gestures)
voice commands
mid-air hand gestures
User Requirements for Glasses-Based Guide
• Device characteristics
light weight device the ability to adjust/remove the display
display for both eyes located at the center of the glasses
IUI 2016
User Requirements for Glasses-Based GuideInformation delivery
Text audio video images having information registered to the real-world position of the museum objects (i.e., see-through AR)
March 2016
IUI 2016
User Requirements for Glasses-Based GuidePersonalization and Privacy
multiple content items personalization
March 2016
Future Work• Comparing the use of HWD with a more
conventional museum visitor's guide at a real museum.
Visualizing Proximity-Based Behavior of Museum Visitors using Tangram Diagrams
J. Lanir, P. Bak, & T. Kuflik: The University of Haifa in cooperation with IBM Research / Haifa Lab, Israel
50
Tangram Diagrams – Exploring the design space
1. Problem characterization:1. Encode the ratio between
2D variables2. Judgment of relative size3. Pattern detection4. Comparison of patterns
2. Visual Variables:1. Absolute Size (outer)2. Relative Size (inner)3. Orientation4. Planes5. Color
51
Visiting Patterns – Engagement
Show the trade-off between holding power (time spent at an exhibition) and attracting power (% of visitors at an exhibit). Information requirements:1. What is the engagement of visitors by exhibit
and how do different exhibits relate to each other?
2. How does the usage of the mobile guide affect the engagement of the visitors at every exhibit?
3. What are the different engagement patterns of exhibits expressed by the differences of holding-to-attraction ratio?
52
Visiting Patterns – Engagement
53
54
• We cover major aspects of the museum visit and we will cover more
So what did we get
Web-based visit planning (at home)
Onsite individual visit
Group interaction with large displays
SSP and Interrupt management
Individual and group navigation and communication support
Post visit summary
55
And if we connect everything
PlanningSummary
Onsite visitPlanning Summary
The visit becomes a link in a lifelong chain of cultural heritage experience
UNINA 56
Automatic or Manual Path: a Groupware application for
Museum Visit Planning using Interaction with Situated Displays
Inna Belinky
Questions?
February 3rd, 2016
UNINA 57February 3rd, 2016