Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction •...
Transcript of Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction •...
![Page 1: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/1.jpg)
UncertainInteraction
PerOlaKristenssonDepartmentofEngineeringUniversityofCambridge
Solution principles for
![Page 2: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/2.jpg)
VisionsoftheFuture
![Page 3: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/3.jpg)
VisionsoftheFuture
• Ubiquitoussensing– Smarthome,InternetofThings,etc.
• Pervasiveagents– Spokendialogue-basedcommandandquery
interfaces• Virtualreality– Portableoffice,training,immersivedataanalytics
• Phonewithoutaphone– Opticalsee-throughhead-mounteddisplayswithform
factorscomparabletoeverydayglasses
![Page 4: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/4.jpg)
VisionsoftheFuture
• Ubiquitoussensing– Smarthome,InternetofThings,etc.
• Pervasiveagents– Spokendialogue-basedcommandandquery
interfaces• Virtualreality– Portableoffice,training,immersivedataanalytics
• Phonewithoutaphone– Opticalsee-throughhead-mounteddisplayswithform
factorscomparabletoeverydayglasses
Allassumefluidinterfacesbasedonfundamentallyuncertaininteraction
![Page 5: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/5.jpg)
Computationalinteraction• Classichuman-computerinteraction(HCI)method
doesnothandleuserinterfacedesignunderuncertaintyverywell
• ClassicHCImethodisunderpinnedonelicitinguserneedsusingavarietyofprocessesandthenaniterativeprocessofdesignandevaluation,inwhichdesignisdrivenbydesigningenuityratherthanprinciples
• Thismeans:– Noautomateddesignwork– Noexplicitmodel– Datainfluenceddesignonlythroughthedesigner
• ComputationalinteractionisanemergingdisciplineinHCIwhichproposesuserinterfacedevelopmentbyallowingalgorithmstoperformwork,byexplicitmodelling,andbyallowingdatatodirectlyinfluencedesign.
![Page 6: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/6.jpg)
Computationalinteraction• Computationalinteractionwouldtypicallyinvolve
atleastoneof:I. anexplicitmathematicalmodelofuser-system
behavior;II. awayofupdatingthatmodelwithobserveddata
fromusers;III. analgorithmicelementthat,usingthismodel,can
directlysynthesiseoradaptthedesign;IV. awayofautomatingandinstrumentingthe
modelinganddesignprocess;V. theabilitytosimulateorsynthesiseelementsofthe
expecteduser-systembehavior.
![Page 7: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/7.jpg)
![Page 8: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/8.jpg)
Intelligenttextentryasanexampleofdesigninginteractionunder
uncertainty
![Page 9: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/9.jpg)
![Page 10: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/10.jpg)
Principlesofintelligenttextentry
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 11: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/11.jpg)
Principlesofintelligenttextentry
1. Letterssimplifiedtolinemarks
2. Commonwordstemscompressedintosimplelinemarksordots
3. Commonwordstemsidentifiedbywordfrequencyanalysisofthebookofpsalms
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 12: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/12.jpg)
Principlesofintelligenttextentry
1. Letterssimplifiedtolinemarks
2. Commonwordstemscompressedintosimplelinemarksordots
3. Commonwordstemsidentifiedbywordfrequencyanalysisofthebookofpsalms
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 13: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/13.jpg)
Principlesofintelligenttextentry
1. Letterssimplifiedtolinemarks
2. Commonwordstemscompressedintosimplelinemarksordots
3. Commonwordstemsidentifiedbywordfrequencyanalysisofthebookofpsalms
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 14: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/14.jpg)
Principlesofintelligenttextentry• Inotherwords:
1. Optimisespeedbyminimsingtheamountofinformationusershavetoarticulate
2. Exploitredundanciesinnaturallanguagesbycreatingalanguagemodel
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 15: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/15.jpg)
Principlesofintelligenttextentry• Inotherwords:
1. Optimisespeedbyminimsingtheamountofinformationusershavetoarticulate
2. Exploitredundanciesinnaturallanguagesbycreatingalanguagemodel
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 16: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/16.jpg)
Principlesofintelligenttextentry• Inotherwords:
1. Optimisespeedbyminimsingtheamountofinformationusershavetoarticulate
2. Exploitredundanciesinnaturallanguagesbycreatingalanguagemodel
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 17: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/17.jpg)
Principlesofintelligenttextentry• ...whichcanoftenbe
thoughtofasaninferenceproblem:
Kristensson,P.O.2009.Fivechallengesforintelligenttextentrymethods.AIMagazine30(4):85-94.
![Page 18: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/18.jpg)
Whydonearlyalltextentrymethodsfail?
![Page 19: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/19.jpg)
Mainstreammobiletextentrymethods
![Page 20: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/20.jpg)
Mainstreammobiletextentrymethods
Graffiti
![Page 21: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/21.jpg)
Mainstreammobiletextentrymethods
Graffiti Multi-tapandpredictivetext
![Page 22: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/22.jpg)
Mainstreammobiletextentrymethods
Graffiti Multi-tapandpredictivetext
Touchscreenkeyboards
![Page 23: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/23.jpg)
Mainstreammobiletextentrymethods
Graffiti Multi-tapandpredictivetext
Touchscreenkeyboards
Gesturekeyboards
![Page 24: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/24.jpg)
Mainstreammobiletextentrymethods
Graffiti Multi-tapandpredictivetext
Touchscreenkeyboards
Gesturekeyboards Physicalthumb
keyboards
![Page 25: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/25.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
![Page 26: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/26.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
![Page 27: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/27.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
![Page 28: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/28.jpg)
Mobiletextentry:thestateoftheart
Speed(wpm)
Yearsofmobiletextentryresearch
2006-2008 2014
![Page 29: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/29.jpg)
Mobiletextentry:thestateoftheart
Speed(wpm)
Yearsofmobiletextentryresearch
40-60wpm(ceilingrates)
2006-2008 2014
![Page 30: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/30.jpg)
Mobiletextentry:thestateoftheart
Speed(wpm)
Yearsofmobiletextentryresearch
40-60wpm(ceilingrates)
Mainstreamtextentrymethods(touchscreenQWERTY,thumbkeyboard,gesturekeyboard)
2006-2008 2014
![Page 31: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/31.jpg)
Mobiletextentry:thestateoftheart
Speed(wpm)
Yearsofmobiletextentryresearch
40-60wpm(ceilingrates)
Mainstreamtextentrymethods(touchscreenQWERTY,thumbkeyboard,gesturekeyboard)
2006-2008 2014
Researchtextentrymethods(slowerthancommercialsolutions)
![Page 32: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/32.jpg)
Mobiletextentry:thestateoftheart
Speed(wpm)
Yearsofmobiletextentryresearch
40-60wpm(ceilingrates)
Mainstreamtextentrymethods(touchscreenQWERTY,thumbkeyboard,gesturekeyboard)
2006-2008 2014
Researchtextentrymethods(slowerthancommercialsolutions) Optimised
keyboards
![Page 33: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/33.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
![Page 34: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/34.jpg)
Thecross-overpoint
Time
Performance
![Page 35: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/35.jpg)
Thecross-overpoint
Time
Performance
Familiarinterface
![Page 36: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/36.jpg)
Thecross-overpoint
Time
Performance
Unfamiliarinterface
Familiarinterface
![Page 37: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/37.jpg)
Thecross-overpoint
Time
Performance
Unfamiliarinterface
Familiarinterface
![Page 38: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/38.jpg)
Thecross-overpoint
Time
Performance
Unfamiliarinterface
Familiarinterface
Cross-overpoint
![Page 39: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/39.jpg)
Thecross-overpoint
Time
Performance
Unfamiliarinterface
Familiarinterface
Timeinvestment
Cross-overpoint
![Page 40: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/40.jpg)
Thecross-overpoint
Time
Performance
Unfamiliarinterface
Familiarinterface
Benefit
Timeinvestment
Cross-overpoint
![Page 41: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/41.jpg)
Thecross-overpoint
Time
Performance
![Page 42: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/42.jpg)
Thecross-overpoint
Time
Performance
![Page 43: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/43.jpg)
Thecross-overpoint
Time
Performance
![Page 44: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/44.jpg)
Thecross-overpoint
Objectivebenefit
Nicosia,M.,Oulasvirta,A.andKristensson,P.O.2014.Modelingtheperceptionofuserperformance.InProceedingsofthe32ndACMConferenceonHumanFactorsinComputingSystems(CHI2014).ACMPress:1747-1756.
![Page 45: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/45.jpg)
Thecross-overpoint
Perceivedbenefit
Nicosia,M.,Oulasvirta,A.andKristensson,P.O.2014.Modelingtheperceptionofuserperformance.InProceedingsofthe32ndACMConferenceonHumanFactorsinComputingSystems(CHI2014).ACMPress:1747-1756.
![Page 46: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/46.jpg)
Thenarrowdesignspace
![Page 47: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/47.jpg)
Thenarrowdesignspace
![Page 48: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/48.jpg)
Thenarrowdesignspace
![Page 49: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/49.jpg)
Thenarrowdesignspace
Interactionstrategies
![Page 50: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/50.jpg)
Thenarrowdesignspace
Efficientencodings
Interactionstrategies
![Page 51: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/51.jpg)
Thenarrowdesignspace
Optimisinglayouts
Efficientencodings
Interactionstrategies
![Page 52: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/52.jpg)
Thenarrowdesignspace
![Page 53: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/53.jpg)
Thenarrowdesignspace
![Page 54: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/54.jpg)
Thenarrowdesignspace
![Page 55: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/55.jpg)
Solutionprinciples• Fromclosedtoopen-loop
– Avoidtheneedforavisualfeedbackloop• Continuousnovice-to-experttransition
– Avoidexplicitlearning• Pathdependency
– Avoidredesigningtheinteractionlayer• Flexibility
– Enableuserstocomposeandeditinavarietyofstyleswithoutexplicitmodeswitching
• Probabilisticerrorcorrection– Usethehypothesisspacetodesignoptimalerrorcorrection
strategies• Fluidregulationofuncertainty
– Allowuserstoseamlesslyinfluencetheinferenceprocess• Efficiency
– Letusers’creativitybethebottle-neck
![Page 56: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/56.jpg)
FromClosedtoOpenLoop
![Page 57: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/57.jpg)
Reimagingthekeyboard
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 58: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/58.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 59: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/59.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 60: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/60.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 61: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/61.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 62: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/62.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 63: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/63.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 64: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/64.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 65: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/65.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 66: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/66.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 67: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/67.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 68: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/68.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 69: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/69.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
![Page 70: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/70.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
Priorprobability
![Page 71: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/71.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhite
Priorprobability
Likelihood
![Page 72: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/72.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhiterabbit
Priorprobability
Likelihood
Posteriorprobability
![Page 73: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/73.jpg)
Howgesturekeyboardswork
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Justthen,thewhiterabbit
Priorprobability
Likelihood
Posteriorprobability
Decodingnoisygesturesintotextusingacombinationofgesturerecognitionandlanguagemodelling
![Page 74: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/74.jpg)
Closed-andopen-loop• Closed-loop:
– Continuousfeedback-driveninteraction– Visually-guidedmotion– Slowandprecise– Modelledwellbythe“crossinglaw”
• Averagemovementtime=a+blog2(D/W+1);aandbarelinearregressioncoefficients;DandWarethedistanceandwidthtothecrossinggoalrespectively
• Open-loop:– Notfeedback-driven– Directrecallfrommotormemory– Fastandimprecise– Nogoodmodelexits
• Gesturekeyboardinteractionisamixofclosed-andopen-loopinteraction
![Page 75: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/75.jpg)
ContinuousNovice-to-ExpertTransition
![Page 76: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/76.jpg)
Continuoustransitionfromnovicetoexpertbehaviour
Skillacquisition
Fallingbackandrelearning
Consistentmovementpattern
Completenovice:TracinglettertoletterClosed-loopSlowandaccurate
Completeexpert:GesturingwordshapesOpen-loopFastandinaccurate
![Page 77: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/77.jpg)
PathDependency
![Page 78: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/78.jpg)
![Page 79: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/79.jpg)
Example:typingonasmartwatch
• Smallscreensizeisobviouslyaconstraint• Manynaïvesolutions:– Progressivezoomingtechniques– Reducekeyset(álatheoldtelephonekeypadtechniques)
– Variousmulti-strokestrategies• Allslow• Alldemanduserlearning(noimmediateefficacy)
![Page 80: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/80.jpg)
Thecross-overpoint
Time
Performance
Newsmartwatchinputmethod
Familiarinterface
Benefit
Timeinvestment
Cross-overpoint
![Page 81: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/81.jpg)
Thecross-overpoint
Time
Performance
Newsmartwatchinputmethod
Familiarinterface
Benefit
Timeinvestment
Cross-overpoint
=40hoursofdedicatedpractice
![Page 82: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/82.jpg)
Thecross-overpoint
Time
Performance
Newsmartwatchinputmethod
Familiarinterface
Benefit
Timeinvestment
Cross-overpoint
=40hoursofdedicatedpractice
Assumetheusertypesforfiveminutesontheirsmartwatcheveryday
![Page 83: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/83.jpg)
Thecross-overpoint
Time
Performance
Newsmartwatchinputmethod
Familiarinterface
Benefit
Timeinvestment
Cross-overpoint
=40hoursofdedicatedpractice
Userperformanceaftermonthsofuse
Assumetheusertypesforfiveminutesontheirsmartwatcheveryday
![Page 84: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/84.jpg)
Thecross-overpoint
Time
Performance
Newsmartwatchinputmethod
Familiarinterface
Benefit
Timeinvestment
Cross-overpointreachedafter480days
=40hoursofdedicatedpractice
Userperformanceaftermonthsofuse
Assumetheusertypesforfiveminutesontheirsmartwatcheveryday
![Page 85: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/85.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
![Page 86: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/86.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
• IttakesaverylongtimetolearnQWERTY(orlearnanewlayout)
![Page 87: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/87.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
• IttakesaverylongtimetolearnQWERTY(orlearnanewlayout)
• UsersarefamiliarwithtouchscreenQWERTY
![Page 88: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/88.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
• IttakesaverylongtimetolearnQWERTY(orlearnanewlayout)
• UsersarefamiliarwithtouchscreenQWERTY
• KeepQWERTY
![Page 89: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/89.jpg)
Mainstreammobiletextentrymethods
• Entryanderrorrate• Learningcurve,familiarity
andimmediateefficacy• Formfactor,preparation
timeandcomfort• Userengagement• Visualattentionand
cognitiveresources• Privacy• Singlevs.multi-character
entry
• Specificationvs.navigation
• One-handedvs.two-handed
• Taskintegration• Robustness• Deviceindependence• Computationaldemands• Manufacturingand
supportcost• Localisation• Marketacceptance
• Higheffectiveentryrate– Amongthefastestoftheirgeneration
• Highfamiliarityandhighimmediateefficacy– Eitherextremelyeasy-to-learnorverysimilartoexistingtechnology(orboth)
• IttakesaverylongtimetolearnQWERTY(orlearnanewlayout)
• UsersarefamiliarwithtouchscreenQWERTY
• KeepQWERTY
![Page 90: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/90.jpg)
Touchmodelling
2DGaussianscenteredateachkey.Separatevariancesinthex-andy-dimensions.
Vertanen,K.,Memmi,H.,Emge,J.,Reyal,S.andKristensson,P.O.2015.VelociTap:investigatingfastmobiletextentryusingsentence-baseddecodingoftouchscreenkeyboardinput.InProceedingsofthe33rdACMConferenceonHumanFactorsinComputingSystems(CHI2015).ACMPress:659-668.
![Page 91: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/91.jpg)
Languagemodelling
• Languagemodels:– 12-gramlettermodel– 4-gramwordmodelwithunknownword– Trainedonbillionsofwordsofdata
§ Twitter,blog,socialmedia,Usenet,andwebdata
– Optimizedforshortemail-likemessages– Letter+wordlanguagemodel=~4GBmemory
Vertanen,K.,Memmi,H.,Emge,J.,Reyal,S.andKristensson,P.O.2015.VelociTap:investigatingfastmobiletextentryusingsentence-baseddecodingoftouchscreenkeyboardinput.InProceedingsofthe33rdACMConferenceonHumanFactorsinComputingSystems(CHI2015).ACMPress:659-668.
![Page 92: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/92.jpg)
Decoding
Observation1 Observation2 Observation3fgc
z
ϵ
abz
Tokenstrack:probability,LMcontext,traceback
o
ϵ
a
z
X X
d
ϵ
o za
X
d
good
god
go
Beamprunetokeeptractable
X XX
X
![Page 93: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/93.jpg)
Entryanderrorrate
Condition
Normal Standardportraitkeyboard,60mmwide
Small Bigsmartwatch,40mmwide
Tiny Smallsmartwatch,25mmwide
![Page 94: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/94.jpg)
Typingonatinykeyboard
![Page 95: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/95.jpg)
Flexibility
![Page 96: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/96.jpg)
Speechrecognitionerrorcorrection:thestandardmethod
• User:“thecatsat”
![Page 97: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/97.jpg)
Speechrecognitionerrorcorrection:thestandardmethod
• User:“thecatsat”• System:“thebatsat”
![Page 98: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/98.jpg)
Speechrecognitionerrorcorrection:thestandardmethod
• User:“thecatsat”• System:“thebatsat”• User:“selectbat”
![Page 99: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/99.jpg)
Speechrecognitionerrorcorrection:thestandardmethod
• User:“thecatsat”• System:“thebatsat”• User:“selectbat”• System:“thebatsatdissectrat”
![Page 100: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/100.jpg)
Speechrecognitionerrorcorrection:thestandardmethod
• User:“thecatsat”• System:“thebatsat”• User:“selectbat”• System:“thebatsatdissectrat”• (User:“Ihatethis…”)
![Page 101: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/101.jpg)
Theflexiblemultimodalfusionapproach
• Userspeaks:“thecatsat”
![Page 102: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/102.jpg)
Theflexiblemultimodalfusionapproach
• Userspeaks:“thecatsat”• System:“thebatsat”
![Page 103: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/103.jpg)
Theflexiblemultimodalfusionapproach
• Userspeaks:“thecatsat”• System:“thebatsat”• Usergesturestheword:“cat”
![Page 104: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/104.jpg)
Theflexiblemultimodalfusionapproach
• Userspeaks:“thecatsat”• System:“thebatsat”• Usergesturestheword:“cat”• System:“thecatsat”
![Page 105: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/105.jpg)
Theflexiblemultimodalfusionapproach
• Userspeaks:“thecatsat”• System:“thebatsat”• Usergesturestheword:“cat”• System:“thecatsat”
• Thesystemautomaticallyidentifiestheerrorlocationandcorrectstheerror
Kristensson,P.O.andVertanen,K.2011.Asynchronousmultimodaltextentryusingspeechandgesturekeyboards.InProceedingsofthe12thAnnualConferenceoftheInternationalSpeechCommunicationAssociation(Interspeech2011).ISCA:581-584.
![Page 106: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/106.jpg)
Outputfromatextentrymodality
Gesturekeyboard
![Page 107: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/107.jpg)
Outputfromatextentrymodality
Gesturekeyboard
Timestep1
![Page 108: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/108.jpg)
Outputfromatextentrymodality
Gesturekeyboard
Timestep1
![Page 109: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/109.jpg)
Outputfromatextentrymodality
Gesturekeyboard
Timestep1 Timestep2
![Page 110: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/110.jpg)
Outputfromatextentrymodality
Gesturekeyboard
thee0.3
the0.6
three0.1
![Page 111: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/111.jpg)
Outputfromatextentrymodality
Gesturekeyboard
the0.3
ε0.6
thee0.1
![Page 112: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/112.jpg)
Outputfromatextentrymodality
Gesturekeyboard
thee0.3
the0.6
three0.1
![Page 113: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/113.jpg)
VAT0.2
Outputfromatextentrymodality
Gesturekeyboard
thee0.3
the0.6
three0.1
cat0.6
cart0.2
![Page 114: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/114.jpg)
at0.28rat0.28
Outputfromtwotextentrymodalities
the0.56
a0.38
cat0.82
at0.06fat0.06
ε0.87
at0.09
sat0.75
nat0.19
the0.94 bat0.57
cat0.09
sat0.47
ε0.21
![Page 115: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/115.jpg)
at0.28rat0.28
Softeningthewordconfusionnetworks:addingwild-cardtransitions
the0.56
a0.38*0.03
cat0.82
at0.06fat0.06*0.03
ε0.87
at0.09*0.03
sat0.75
nat0.19*0.03
the0.94
*0.03
bat0.57
cat0.09*0.03
sat0.47
ε0.21*0.03
![Page 116: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/116.jpg)
at0.28rat0.28
Softeningthewordconfusionnetworks:addingepsilontransitions
the0.56
a0.38*0.03ε0.02
cat0.82
at0.06fat0.06*0.03ε0.02
ε0.87
at0.09*0.03
sat0.75
nat0.19*0.03ε0.02
the0.94
*0.03ε0.02
bat0.57
cat0.09*0.03ε0.02
sat0.47
ε0.21*0.03
![Page 117: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/117.jpg)
at0.28rat0.28
Softeningthewordconfusionnetworks:addingwild-cardself-loops
the0.56
a0.38*0.03ε0.02
0.01*
0.01* cat0.82
at0.06fat0.06*0.03ε0.02
0.01* ε0.87
at0.09*0.03
0.01* sat0.75
nat0.19*0.03ε0.02
0.01*
the0.94
*0.03ε0.02
0.01*
0.01* bat0.57
cat0.09*0.03ε0.02
0.01* sat0.47
ε0.21*0.03
0.01*
![Page 118: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/118.jpg)
at0.28rat0.28
Searchforthehighestjointpathinbothrecognitionmodalities
the0.56
a0.38*0.03ε0.02
0.01*
0.01* cat0.82
at0.06fat0.06*0.03ε0.02
0.01* ε0.87
at0.09*0.03
0.01* sat0.75
nat0.19*0.03ε0.02
0.01*
the0.94
*0.03ε0.02
0.01*
0.01* bat0.57
cat0.09*0.03ε0.02
0.01* sat0.47
ε0.21*0.03
0.01*
![Page 119: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/119.jpg)
Speech-onlyflexiblerepair
![Page 120: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/120.jpg)
Probabilisticerrorcorrection
![Page 121: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/121.jpg)
Probabilisticerrorcorrection
• Foranyprobabilistictextentrymethod…– Capableofassigningposteriorprobability
distributionstowords• …thereexistsahypothesisspace• Thebestresultisthemaximumprobabilitypath
inthishypothesisspace– However,itneednotbetheonetheuserintended
• Byexposingpartofthehypothesisspacetousers,highefficienciescanbegainedwhenuserscorrectwords
![Page 122: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/122.jpg)
Fluidregulationofuncertainty
![Page 123: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/123.jpg)
Theauto-correcttrap• Auto-correctisgreatwhenitworks• However,whenauto-correctfailserrorcorrectionactivities
exhibitahighpenalty• Thesolutionistoprovideuserswithmoreagencyand
allowthemtoregulatetheircertainty
Weir,D.,Pohl,H.,Rogers,S.,Vertanen,K.andKristensson,P.O.2014.Uncertaintextentryonmobiledevices.InProceedingsofthe32ndACMConferenceonHumanFactorsinComputingSystems(CHI2014).ACMPress:2307-2316.
![Page 124: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/124.jpg)
Pressure-sensitiveauto-correct
• LikelihoodofaGaussianwithstandarddeviationregulatedbypressure
• StandarddeviationcomputedasC/ωT,whereCisaconstantandωTisthepressurefortouchT
• TunedCsothatthepressureofatypicaltouchhadastandarddeviationofhalfakeywidth
Weir,D.,Pohl,H.,Rogers,S.,Vertanen,K.andKristensson,P.O.2014.Uncertaintextentryonmobiledevices.InProceedingsofthe32ndACMConferenceonHumanFactorsinComputingSystems(CHI2014).ACMPress:2307-2316.
![Page 125: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/125.jpg)
Results• Enablinguserstoregulatetheircertaintybyforce
resultedina10%percentagedropinactivecorrections(fixingawordbybackspacingorretyping)
• Thisimprovedentryrateby20%
![Page 126: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/126.jpg)
Efficiency
![Page 127: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/127.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 128: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/128.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 129: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/129.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
125ms
![Page 130: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/130.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
250ms
![Page 131: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/131.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
375ms
![Page 132: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/132.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
500ms
![Page 133: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/133.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
625ms
![Page 134: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/134.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
750ms
![Page 135: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/135.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
875ms
![Page 136: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/136.jpg)
Eye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
1000ms
![Page 137: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/137.jpg)
Recordspeedsachievedwhenwritingbygaze
• Eye-typing– 5–10wpm(MajarantaandRäihä2002;Roughetal.2014)
• Eye-typingwithadjustable-dwell– 7-20wpm(Majarantaetal.2009;RäihäandOvaska2012;Roughetal.2014)
• Dasher– 12–26wpm(Tuiskuetal.2008;WardandMacKay2002;Roughetal.2014)
![Page 138: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/138.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
Kristensson,P.O.andVertanen,K.2012.Thepotentialofdwell-freeeye-typingforfastassistivegazecommunication.InProceedingsofthe7thACMSymposiumonEye-TrackingResearch&Applications(ETRA2012).ACMPress:241-244.
![Page 139: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/139.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 140: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/140.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 141: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/141.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 142: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/142.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 143: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/143.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 144: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/144.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 145: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/145.jpg)
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 146: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/146.jpg)
Thecat
Dwell-freeeye-typing
Q W E R T Y U I O P
A S D F G H J K L
Z X C V B N M
![Page 147: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/147.jpg)
Humanperformanceestimateofdwell-freeeye-typing
• Recorded400minutesofeye-tracedata• Participantsenteredatotalof2026phrases• Participantswerepromptedphrasesandaskedtocopy
themasquicklyandasaccuratelyaspossible• Oursystemknewwhattheuserwassupposedtowriteand
verifiedthattheuserisgazingatthelettersequencecorrespondingtothestimulus
![Page 148: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/148.jpg)
Entryrate
![Page 149: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/149.jpg)
Humanperformancemodel
![Page 150: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/150.jpg)
Humanperformancemodel
Eye-typingusingadjustabledwell,finalentryrate(mean=20wpm)
![Page 151: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/151.jpg)
Humanperformancemodel
Eye-typingusingadjustabledwell,finalentryrate(mean=20wpm)
![Page 152: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/152.jpg)
Humanperformancemodel
Eye-typingusingadjustabledwell,finalentryrate(mean=20wpm)
230%
![Page 153: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/153.jpg)
Entryrate,first10-15minutes
![Page 154: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/154.jpg)
Entryrate,first10-15minutes
Eye-typingusingadjustabledwell,entryrateinthefirstsession(mean=6.9wpm)
![Page 155: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/155.jpg)
Entryrate,first10-15minutes
Eye-typingusingadjustabledwell,entryrateinthefirstsession(mean=6.9wpm)
520%
![Page 156: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/156.jpg)
Astep-changeingazecommunication
• Existinggazecommunicationsolutions– Limitedtocirca20wpm
• Dwell-freeeye-typing– Empiricallymeasuredhumanperformancepotential:46wpmaverage
• Releasedasaproduct:Tobii-DynavoxI-Series+
![Page 157: Uncertain Interaction - University of Cambridge · 2019-01-30 · Computational interaction • Computational interaction would typically involve at least one of: I. an explicit mathematical](https://reader036.fdocuments.us/reader036/viewer/2022070917/5fb773e206ecca49807dda4c/html5/thumbnails/157.jpg)
Conclusions• Atextentrymethodlikelytobeadoptedbyusersis
probablysimilartoexistingsolutionsandatleastasfast• Itisstillpossibletomakeprogressbyusingafewsolution
principles:– Fromclosedtoopen-loop– Continuousnovice-to-experttransition– Pathdependency– Flexibility– Probabilisticerrorcorrection– Fluidregulationofuncertainty– Efficiency
• Ingeneral,thesecanbeviewedassolutionprinciplesforuncertaininteraction
Kristensson,P.O.2015.Next-generationtextentry.IEEEComputer48(7):84-87.