Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction....

36
Indirect Touch Manipulation for Interaction with Stereoscopic Displays Adalberto L. Simeone , University of Portsmouth, UK ADALS @ ACM . ORG @ A DAL _LS HTTP :// WWW . ADALSIMEONE . ME

Transcript of Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction....

Page 1: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Indirect Touch Manipulation for Interaction with Stereoscopic Displays

Adalberto L. Simeone, University of Portsmouth, [email protected] @ADAL_LS

HTTP://WWW.ADALSIMEONE.ME

Page 2: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Indirect 3D multi-touch interaction

Page 3: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Occlusion video

Comparing Indirect and Direct Touch in a Stereoscopic Interaction TaskA.L. Simeone and H Gellersen, 3D User Interfaces 2015

Page 4: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Navigation video

Page 5: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

TX+TX-

Ty+

Ty-

Tz+

Tz-

Page 6: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 7: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 8: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

4DOF docking task

• Three Techniques

• DS3 (Depth-Separated Screen Space)Martinet et al. 2012

Page 9: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 10: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

4DOF docking task

• Three Techniques

• DS3 (Depth-Separated Screen Space)Martinet et al. 2012

• Triangle CursorStrothoff et al. 2011

Page 11: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 12: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

4DOF docking task

• Three Techniques

• DS3 (Depth-Separated Screen Space)Martinet et al. 2012

• Triangle CursorStrothoff et al. 2011

• Indirect4

Page 13: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 14: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 15: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

First Study

• Goals

• Performance evaluation

Page 16: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

First Study

• Goals

• Performance evaluation

• Quality of the interaction experience

• Vision-related symptoms

• Fatigue

• Focus

• Manipulation

Page 17: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Results

• Both techniques were faster than the Triangle Cursor

0

5

10

15

20

Mean TaskCompletion Times (s)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean TranslationCoordination

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean RotationCoordination

Indirect4DS3

Triangle Cursor

Triangle Cursor

DS3Indirect4

Page 18: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Results

• Both techniques were faster than the Triangle Cursor

• The performance of Indirect4 was comparable to DS3

0

5

10

15

20

Mean TaskCompletion Times (s)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean TranslationCoordination

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean RotationCoordination

Indirect4DS3

Triangle Cursor

Triangle Cursor

DS3Indirect4

Page 19: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Results

• Both techniques were faster than the Triangle Cursor

• The performance of Indirect4 was comparable to DS3

• Indirect4 provided a better quality of vision and was less fatiguing

0

5

10

15

20

Mean TaskCompletion Times (s)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean TranslationCoordination

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean RotationCoordination

Indirect4DS3

Triangle Cursor

Triangle Cursor

DS3Indirect4

Page 20: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

What we learned…

• Absolute mappings

• Indirect selection was problematic

Page 21: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

What we learned…

• Absolute mappings

• Indirect selection was problematic

• Integrated rotation

Page 22: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

What we learned…

• Absolute mappings

• Indirect selection was problematic

• Integrated rotation

• The Triangle Cursor might be more suited to top-down rather than frontal interaction

Page 23: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 24: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction
Page 25: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Tz+

Tz-

Ry

Rz

TX+TX-

Ty+

Ty-

Rx

Indirect6

v

Page 26: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Results

• DS3 was faster overall

Surface6DS3Indirect60

5

10

15

20

25

30

35

Mean TaskComp n Times (s)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean Transla nCoordina

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean Rota nCoordina

Time Indirect6

DS3

Surface6

Page 27: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Results

• DS3 was faster overall

• However, selection in DS3 and Surface6 was instantaneous

• Whereas in Indirect6 selection took a significant amount of time

Surface6DS3Indirect60

5

10

15

20

25

30

35

Mean TaskComp n Times (s)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean Transla nCoordina

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean Rota nCoordina

Time Indirect6

DS3

Surface6

Page 28: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Results

• DS3 was faster overall

• However, selection in DS3 and Surface6 was instantaneous

• Whereas in Indirect6 selection took a significant amount of time

• Net manipulation times between DS3 and Indirect6 were comparable

Surface6DS3Indirect60

5

10

15

20

25

30

35

Mean TaskComp n Times (s)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean Transla nCoordina

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

Mean Rota nCoordina

Time Indirect6

DS3

Surface6

Page 29: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Future Directions

• Improve indirect touch selection

Page 30: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Future Directions

• Improve indirect touch selection

• Explore a two-stage manipulation technique

Page 31: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Future Directions

• Improve indirect touch selection

• Explore a two-stage manipulation technique

• Explore synergies between indirect touch and mouse/peninput

Page 32: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Future Directions

• Improve indirect touch selection

• Explore a two-stage manipulation technique

• Explore synergies between indirect touch and mouse/peninput

• Explore the indirect touch paradigm on devices with other form factors

Page 33: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Conclusion

• Indirect touch can turn ordinary tablets into 6DOF devices

Page 34: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Conclusion

• Indirect touch can turn ordinary tablets into 6DOF devices

• It does not have to be a replacement for direct touch but an alternative

Page 35: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Conclusion

• Indirect touch can turn ordinary tablets into 6DOF devices

• It does not have to be a replacement for direct touch but an alternative

• Advantages that indirect has over direct touch can provide new challenges that for direct touch

• and vice versa

Page 36: Indirect Touch Manipulation for Interaction with ...€¦ · Indirect 3D multi-touch interaction. Occlusion video Comparing Indirect and Direct Touch in a Stereoscopic Interaction

Indirect Touch Manipulation for Interaction with Stereoscopic Displays

Adalberto L. Simeone, University of Portsmouth, [email protected] @ADAL_LS

HTTP://WWW.ADALSIMEONE.ME