Scott gunter usability sciences internet summit 2011 designing for touch are we ready
Challenges in Designing a Menu System with Touch-less Technology
-
Upload
omek-interactive -
Category
Design
-
view
2.077 -
download
0
description
Transcript of Challenges in Designing a Menu System with Touch-less Technology
![Page 1: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/1.jpg)
© Omek Interactive, Ltd. All rights reserved. © Omek Interactive, Ltd. All rights reserved.
CHALLENGES IN DESIGNING A MENU SYSTEM WITH
DEPTH MOTION SENSOR TECHNOLOGY
Shachar OzGame & UX Designer
Omek Interactive Studios
![Page 2: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/2.jpg)
© Omek Interactive, Ltd. All rights reserved.
MENUS ARE FORGOTTEN ABOUT .OR, WHAT CAN DRIVE USERS CRAZY ?
![Page 3: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/3.jpg)
© Omek Interactive, Ltd. All rights reserved.
![Page 4: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/4.jpg)
© Omek Interactive, Ltd. All rights reserved.
MENU SYSTEM DESIGN GUIDELINES
• Confident users understand:– where they are– where they were– what can they do– how can they do it
![Page 5: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/5.jpg)
© Omek Interactive, Ltd. All rights reserved.
3D DEPTH SENSOROR, WHAT IS IT ?
![Page 6: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/6.jpg)
© Omek Interactive, Ltd. All rights reserved.
3D DEPTH SENSOROR, WHAT IS IT ?
![Page 7: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/7.jpg)
© Omek Interactive, Ltd. All rights reserved.
TOUCH-BASED TECHNOLOGY
![Page 8: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/8.jpg)
© Omek Interactive, Ltd. All rights reserved.
TOUCH-LESS TECHNOLOGY
![Page 9: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/9.jpg)
© Omek Interactive, Ltd. All rights reserved.
TOUCH-LESS TECHNOLOGY
![Page 10: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/10.jpg)
© Omek Interactive, Ltd. All rights reserved.
DEPTH MOTION CAPTURE
Body trackingNatural gesturesFree from controllers
×Tangible feedback×100% stability×Accuracy
![Page 11: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/11.jpg)
© Omek Interactive, Ltd. All rights reserved.
CHALLENGESOR, HOW TECHNOLOGY INFLUENCE DESIGN ?
![Page 12: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/12.jpg)
© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE• Feeling of a click :
virtual tangibility• Active & inactive modes • Am I in control ? • Inner delay of the interface
![Page 13: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/13.jpg)
© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE• Feeling of a click• Active & inactive modes :
differentiate between user behaviors
• Am I in control ? • Inner delay of the interface
![Page 14: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/14.jpg)
© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE• Feeling of a click• Active & inactive modes • Am I in control ?
feedback for the users• Inner delay of the interface
![Page 15: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/15.jpg)
© Omek Interactive, Ltd. All rights reserved.
CHALLENGES OF MOTION CAPTURE• Feeling of a click• Active & inactive modes • Am I in control ? • Inner delay of the interface :
cannot predict the user
![Page 16: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/16.jpg)
© Omek Interactive, Ltd. All rights reserved.
DEALING WITH CHALLENGESSELECTING AND SCROLLING ITEMS
![Page 17: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/17.jpg)
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
• Click gesture : imitate mouse
• Hot-spot• Grand gesture• Swipe in • Grab gesture
![Page 18: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/18.jpg)
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
• Click gesture• Hot-spot :
hold cursor above item and wait
• Grand gesture• Swipe in • Grab gesture
![Page 19: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/19.jpg)
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
• Click gesture• Hot-spot• Grand gesture :
grandiose arm movement• Swipe in • Grab gesture
![Page 20: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/20.jpg)
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
• Click gesture• Hot-spot• Grand gesture• Swipe in :
continuous feedback
• Grab gesture
![Page 21: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/21.jpg)
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
• Click gesture • Hot-spot• Grand gesture• Swipe in • Grab gesture :
pinch or fist
![Page 22: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/22.jpg)
© Omek Interactive, Ltd. All rights reserved.
Selecting Items
Responsiveness v x v v v
Active & inactive
v x v ½ ½
Stablilty x v v v ½
Comfortable ½ v x v v
Usability v v x ½ ½
![Page 23: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/23.jpg)
© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
• 2D cursor : imitate mouse
• 1D cursor• Static active spot• Dynamic active spot• Grand gesture
![Page 24: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/24.jpg)
© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
• 2D cursor• 1D cursor :
scroll on one axis• Static active spot• Dynamic active spot• Grand gesture
![Page 25: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/25.jpg)
© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
• 2D cursor• 1D cursor• Static active spot :
magnifying glass• Dynamic active spot• Grand gesture
![Page 26: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/26.jpg)
© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
• 2D cursor• 1D cursor• Static active spot• Dynamic active spot :
magnifying glass++• Grand gesture
![Page 27: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/27.jpg)
© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
• 2D cursor• 1D cursor• Static active spot• Dynamic active spot • Grand gesture :
grandiose arm movements
![Page 28: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/28.jpg)
© Omek Interactive, Ltd. All rights reserved.
Scrolling Items
Responsiveness v v ½ v v
Active & inactive
v v x v v
Stablilty ½ v ½ v v
Comfortable v ½ v ½ x
Usability v v ½ v x
![Page 29: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/29.jpg)
© Omek Interactive, Ltd. All rights reserved.
Pagination
• Just another button: hot-spot / click• Grand gesture: Minority Report• Drag n’ drop: scroll the entire list
![Page 30: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/30.jpg)
© Omek Interactive, Ltd. All rights reserved.
User Real Location
• Camera view: what the camera sees?
• B&W: grey scale colors• Freeze!: control over the character• Trapezoid: view playfield from up• Note over character: main area of
concern
![Page 31: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/31.jpg)
© Omek Interactive, Ltd. All rights reserved.
Feeling of a Click
![Page 32: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/32.jpg)
© Omek Interactive, Ltd. All rights reserved.
CONCLUSIONSOR, WHAT DID WE LEARN ?
![Page 33: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/33.jpg)
© Omek Interactive, Ltd. All rights reserved.
Conclusions
• Tracking: essential constant feedback
• Gesture: toggle action modes
![Page 34: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/34.jpg)
© Omek Interactive, Ltd. All rights reserved.
Conclusions
• Tracking: essential constant feedback
• Gesture: toggle action modes
![Page 35: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/35.jpg)
© Omek Interactive, Ltd. All rights reserved.
User Expectations
• One hand based control scheme• Grandiose gestures only once in a
while• Constant feedback for each
movement
![Page 36: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/36.jpg)
© Omek Interactive, Ltd. All rights reserved.
Depth Sensor Menu Design Guidelines• Consistency • Simplicity• Feeling of control• Feedback • Comfortable
![Page 37: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/37.jpg)
© Omek Interactive, Ltd. All rights reserved.
Future Experiments
• Sound based feedback (for blind)• Speech based / speech components
![Page 38: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/38.jpg)
© Omek Interactive, Ltd. All rights reserved.
References
• Frosted Glass / CAMPAR• EyeSight• Dance Central / Harmonix• Adrenaline Misfits / Konami• Omek Interactive Studios• Media Center / Primesense• PointGrab• Powerup Heroes / Ubisoft
• Huang J., White R.W., Buscher G. (2012). User See, User Point: Gaze and Cursor Alignment in Web Search. CHI’12, May 5–10, 2012, Austin, Texas, USA
![Page 39: Challenges in Designing a Menu System with Touch-less Technology](https://reader035.fdocuments.us/reader035/viewer/2022062615/548ed142b47959f9328b45a9/html5/thumbnails/39.jpg)
Thank You For Listening ,
Shachar OzGame & UX Designer
Omek Interactive Studioswww.OmekInteractive.com