Kill the Search Button II

The Handheld Devices Are Coming

Gestures for a Mobile Search App

Michael Poltorak Nielsen

Today's agenda

● Current Mobile Interaction Paradigm

● An Alternative

● Smartphone Gestures

● Demo: A Library Search App with Touch and Gestures

But, the Current Handheld Interaction Paradigm is based on:

Glass

The future is sliding, toomicrosoft.com/office/vision

Pictures Under GlassTransitional paradigm dictated by technology, not human capabilities Bret Victorworrydream.com/ABriefRantOnTheFutureOfInteractionDesign

Alternative Paradigm

Direct Manipulation Gesture Driven Palpable Tactile

Harrison, C. and Hudson, S. E. 2009. Providing Dynamically Changeable Physical Buttons on a Visual

Display

Not bad, huh?

Near Future?

+

Have a Moment

Our Mobile Projects

Mobile Search App(s)

HTML5 + iPhone app, Android?● search library data (10M + 800M)● request stuff, favourites● view own items● renew In beta, to be published really soon

Barcode to Map Location AppWith Silkeborg Public Library

● Augment search app with gestures

● Can gestures be combined with multi-touch interactions?

● Goals: ○ Produce alpha app○ Test usability

Now: Gestures

Smart Phone Interactions and Inputs

Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position

Focus on

Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position

Gestures

AdvancedCircle, cross, up-down, etcMovement hard to measure Can't reliably calculate movement from acceleration

SimpleTilt, flip, turn, rotate, shake, throwAccelerometer data

What Can Browsers do Accelerometer-wise?

So: Going Native iPhone app with gestures

HTML5 web app without gestures

Android?

Search App Interactions

Do search query, toggle search boxSwitch views compact, normal, expandendNext/previous page switch search results Show full record full info about itemRequest get the materialFavourites save material

Demo Time

What's next?

From Nokia

Challenges

No standard mobile gestures Gestures may be individualGestures may not be appropiate at allSophisticated gestures hard to codeObjective-C Argh!

Thank you!

Michael Poltorak Nielsenmn@statsbiblioteket.dk

twitter:@michaelpoltorak