Post on 12-Jan-2015
description
Take out your mobile phone,
dial a number,
but imagine you are blind.
Take out your mobile phone,
but imagine you are blind.
Krajnc E., Knoll M., Feiner J., Traar M.
And you don’t have
physical keys
Krajnc E., Knoll M., Feiner J., Traar M.
A Touch Sensitive User Interface Approach onSmartphones for Visually Impaired and BlindPersons
Elmar Krajnc, Mathias Knoll, Johannes Feiner, Mario TraarUSAB 2011, 25.-26. November 2011, Graz
A Touch Sensitive User Interface Approach onSmartphones for Visually Impaired and Blind
Elmar Krajnc, Mathias Knoll, Johannes Feiner, Mario Traar
Krajnc E., Knoll M., Feiner J., Traar M.
26. November 2011, Graz
Project Ways4all Completewww.ways4all.at
� Routing and way finding
� Indoor navigation
� Communication with public transport vehicles
� Integration in one device, a mobile phone� Integration in one device, a mobile phone
� This paper: a barrier free UI for Touch Screen Phones
Project Ways4all Complete
Communication with public transport vehicles
Integration in one device, a mobile phone
Krajnc E., Knoll M., Feiner J., Traar M.
Integration in one device, a mobile phone
This paper: a barrier free UI for Touch Screen Phones
Mobile Phone Market
� Smart Phones overtakes Mobile � Smart Phones overtakes Mobile Phones
� Android: 52.5% of theglobal smartphoneglobal smartphonemarket
http://articles.businessinsider.com/2011
Mobile Phone Market
Smart Phones overtakes Mobile Smart Phones overtakes Mobile
52.5% of theglobal smartphone
Krajnc E., Knoll M., Feiner J., Traar M.
global smartphone
http://articles.businessinsider.com/2011-11-15/tech/30400572_1_smartphone-android-ios
Accessibilty on Smart Phones
� Mostly Touchscreens � Mostly Touchscreens
� No Standards
� Examples
� Symbian - Talks
� Apple - Voice Over � Apple - Voice Over
� Android
� Talkback/Eyes Free Project/Self Voicing Apps
Accessibilty on Smart Phones
Mostly Touchscreens Mostly Touchscreens
Krajnc E., Knoll M., Feiner J., Traar M.
Talkback/Eyes Free Project/Self Voicing Apps
Previous Result
� Previous Version of the application� Previous Version of the application
� Java ME platform
� Screen reader Talks
� Transfer to Touchscreen
Previous Version of the applicationPrevious Version of the application
Screen reader Talks
Krajnc E., Knoll M., Feiner J., Traar M.
Transfer to Touchscreen
� General Concept
Ways4all App on Android
� General Concept
� Android
� Open Source
� Developer Friendly
� Built in TTS Engine� Built in TTS Engine
Ways4all App on Android
Krajnc E., Knoll M., Feiner J., Traar M.
� New View Componet
UI Talking View
� New View Componet
� Handling Touch Input
� Self Voicing
if ((touchEvent() … ){
tts.speak(itemTexts[0],… );tts.speak(itemTexts[0],… );
}
New View ComponetNew View Componet
Handling Touch Input
Krajnc E., Knoll M., Feiner J., Traar M.
� Gestures API
Gesture Input
� Gestures API
� Writing or Gestures as User Input
… GestureLibraries.fromRawResource(this, … GestureLibraries.fromRawResource(this,
R.raw.myGestures);
…
predictions = … recognize(gesture);
if (prediction.name.equals(“3")) {
doSomeThing();
}
Writing or Gestures as
… GestureLibraries.fromRawResource(this,
Krajnc E., Knoll M., Feiner J., Traar M.
… GestureLibraries.fromRawResource(this,
� Video or Demo
Talking User Interface
� Video or Demo
Talking User Interface
Krajnc E., Knoll M., Feiner J., Traar M.
� Thinking Aloud Test
Usability Testing
� Thinking Aloud Test
� 7 Testuser
� 2 Blind, 2 Visual Disorder
� Feedback� Feedback
� Intuitive UI
� Users could fullfil most Tasks
Thinking Aloud TestThinking Aloud Test
Disorder, 3 Normal
Krajnc E., Knoll M., Feiner J., Traar M.
Users could fullfil most Tasks
� Accessible Apps vs. Accessible
General Problems on Smartphones
� Accessible Apps vs. Accessible Smartphones
� 2D Touchscreen vs. 1D Lists
� No Standards
� Different Usage on Different Platforms� Different Usage on Different Platforms
Accessible Apps vs. Accessible
General Problems on Smartphones
Accessible Apps vs. Accessible
2D Touchscreen vs. 1D Lists
Different Usage on Different Platforms
Krajnc E., Knoll M., Feiner J., Traar M.
Different Usage on Different Platforms
Outlook
� SW Development is in progress� SW Development is in progress
� Text input
� More reviews and tests
� Converting to other platforms like iPhone
SW Development is in progressSW Development is in progress
More reviews and tests
Converting to other platforms like iPhone
Krajnc E., Knoll M., Feiner J., Traar M.
Conclusion
� Developing for special user groups is � Developing for special user groups is challenging
� New technologies needs new SolutionsSolutions
Developing for special user groups is Developing for special user groups is
New technologies needs new
Krajnc E., Knoll M., Feiner J., Traar M.
Thanks for your Attention
Elmar Krajncelmar.krajnc@fh
Mathias KnollMathias.knoll@fh
Johannes Feinerjohannes.feiner@fh
Mario TraarMario Traarmario.traar@fh
FH JOANNEUMUniversity of Applied
www.fh-joanneum.at/itm
Thanks for your Attention
Elmar Krajncelmar.krajnc@fh-joanneum.at
Mathias KnollMathias.knoll@fh-joanneum.at
Johannes Feinerjohannes.feiner@fh-joanneum.at
Mario Traar
Krajnc E., Knoll M., Feiner J., Traar M.
Mario Traarmario.traar@fh-joanneum.at
FH JOANNEUMApplied Sciences
joanneum.at/itm