Post on 16-Jul-2020
Interactions in Virtual Reality
Copyright 2018 © Virtual Reality at Berkeley
2
Hardware
Gaze Gaze and tap Clickers
Hand tracking 6DOF controllers Eye tracking
Gaze and Hold
Makes the least hardware assumptions. 3
Gaze and Tap
Better, but make targets large and use sparingly. 4
Clickers
More versatile, but potentially a false affordance? 5
Hand Tracking
Most natural, but not necessarily the best. 6
Great compromise between intuitiveness and utility.
Tracked 6DOF controllers
7
Coming soon
Eye tracking
8
9
Presence
Personal: Illusion of Self-embodiment
Environmental: Illusion of Physical Interaction
Social: Illusion of Social Companionship
Presence
10
11
Interactions in Personal Space
Personal Presence
12
IK Arms
IK Arms
15
Environmental Presence
Beware of Metaphors
16
https://i.imgur.com/RjbxvQt.gifv
The more repeated the action, the easier it should be
17
18
Can we do better than reality?
Learnings on Maintaining Environmental Presence
19
● Large arms motions are tiring● If you give the users hands, give them something to do with them● If you let players swing around, they’ll break something (one in N times)
20
Social Presence
Hand-Eye Coordination
Interactive Eye Contact
Eye Tracking
21
Eye Tracking
22
Hand-Eye Coordination
Interactive Eye Contact
Eye Trackers on the Market
23
Full Body Presence
(You can finally kick things!)
Body Tracking
24
Body Tracking
25
Full Body Presence
(You can finally kick things!)
Body Trackers on the Market
26
Tracking
27
Track and show what we can, leave the rest to the brain.
Believable NPCs
A big part of social VR is interacting with other people, but VR is also a powerful tool for interacting with other virtual people.
28
Immersive Journalism
“That was my goal. Take a story about people who are hungry, who I felt were invisible, and make them visible in a way that was so compelling that people would really get what the fuck was going on out there. So that works. And it works in a way that has blown my mind.”
Nonny de la Peña
29
VRChat
31
VRChat
32