Kill the Search Button II - Mobile Gestures

45
Kill the Search Button II The Handheld Devices Are Coming

description

Code4Lib presentation about smartphone gestures. I talk about an alternative gesture based paradigm for mobile devices and show an example of how to augment an iPhone library search app with gestures.

Transcript of Kill the Search Button II - Mobile Gestures

Page 1: Kill the Search Button II - Mobile Gestures

Kill the Search Button II

The Handheld Devices Are Coming

Page 2: Kill the Search Button II - Mobile Gestures

Gestures for a Mobile Search App

Michael Poltorak Nielsen

Page 3: Kill the Search Button II - Mobile Gestures

Today's agenda

● Current Mobile Interaction Paradigm

● An Alternative

● Smartphone Gestures

● Demo: A Library Search App with Touch and Gestures

Page 4: Kill the Search Button II - Mobile Gestures
Page 5: Kill the Search Button II - Mobile Gestures

But, the Current Handheld Interaction Paradigm is based on:

Page 6: Kill the Search Button II - Mobile Gestures

Glass

Page 7: Kill the Search Button II - Mobile Gestures
Page 8: Kill the Search Button II - Mobile Gestures
Page 9: Kill the Search Button II - Mobile Gestures

The future is sliding, toomicrosoft.com/office/vision

Page 10: Kill the Search Button II - Mobile Gestures
Page 11: Kill the Search Button II - Mobile Gestures
Page 12: Kill the Search Button II - Mobile Gestures
Page 13: Kill the Search Button II - Mobile Gestures
Page 14: Kill the Search Button II - Mobile Gestures

Pictures Under GlassTransitional paradigm dictated by technology, not human capabilities Bret Victorworrydream.com/ABriefRantOnTheFutureOfInteractionDesign

Page 15: Kill the Search Button II - Mobile Gestures

Alternative Paradigm

Direct Manipulation Gesture Driven Palpable Tactile

Page 16: Kill the Search Button II - Mobile Gestures
Page 17: Kill the Search Button II - Mobile Gestures
Page 18: Kill the Search Button II - Mobile Gestures
Page 19: Kill the Search Button II - Mobile Gestures

Harrison, C. and Hudson, S. E. 2009. Providing Dynamically Changeable Physical Buttons on a Visual

Display

Page 20: Kill the Search Button II - Mobile Gestures

Not bad, huh?

Page 21: Kill the Search Button II - Mobile Gestures

Near Future?

+

Page 22: Kill the Search Button II - Mobile Gestures

Have a Moment

Page 23: Kill the Search Button II - Mobile Gestures

Our Mobile Projects

Page 24: Kill the Search Button II - Mobile Gestures

Mobile Search App(s)

HTML5 + iPhone app, Android?● search library data (10M + 800M)● request stuff, favourites● view own items● renew In beta, to be published really soon

Page 25: Kill the Search Button II - Mobile Gestures

Barcode to Map Location AppWith Silkeborg Public Library

Page 26: Kill the Search Button II - Mobile Gestures

● Augment search app with gestures

● Can gestures be combined with multi-touch interactions?

● Goals: ○ Produce alpha app○ Test usability

Now: Gestures

Page 27: Kill the Search Button II - Mobile Gestures

Smart Phone Interactions and Inputs

Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position

Page 28: Kill the Search Button II - Mobile Gestures

Focus on

Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position

Page 29: Kill the Search Button II - Mobile Gestures

Gestures

AdvancedCircle, cross, up-down, etcMovement hard to measure Can't reliably calculate movement from acceleration

SimpleTilt, flip, turn, rotate, shake, throwAccelerometer data

Page 30: Kill the Search Button II - Mobile Gestures

What Can Browsers do Accelerometer-wise?

Page 31: Kill the Search Button II - Mobile Gestures

So: Going Native iPhone app with gestures

HTML5 web app without gestures

Android?

Page 32: Kill the Search Button II - Mobile Gestures

Search App Interactions

Do search query, toggle search boxSwitch views compact, normal, expandendNext/previous page switch search results Show full record full info about itemRequest get the materialFavourites save material

Page 33: Kill the Search Button II - Mobile Gestures
Page 34: Kill the Search Button II - Mobile Gestures
Page 35: Kill the Search Button II - Mobile Gestures
Page 36: Kill the Search Button II - Mobile Gestures
Page 37: Kill the Search Button II - Mobile Gestures
Page 38: Kill the Search Button II - Mobile Gestures
Page 39: Kill the Search Button II - Mobile Gestures

Demo Time

Page 40: Kill the Search Button II - Mobile Gestures

What's next?

From Nokia

Page 41: Kill the Search Button II - Mobile Gestures

Challenges

No standard mobile gestures Gestures may be individualGestures may not be appropiate at allSophisticated gestures hard to codeObjective-C Argh!

Page 42: Kill the Search Button II - Mobile Gestures

Thank you!

Michael Poltorak [email protected]

twitter:@michaelpoltorak

Page 43: Kill the Search Button II - Mobile Gestures
Page 44: Kill the Search Button II - Mobile Gestures
Page 45: Kill the Search Button II - Mobile Gestures