Virtual Environments Tracking Systems
Transcript of Virtual Environments Tracking Systems
![Page 1: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/1.jpg)
Salim Modi, David Nguyen, Mitul Patel
Virtual Environments
Tracking Systems
![Page 2: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/2.jpg)
Outline
• Introduction– What is Tracking?– Performance Measures – The Ideal Tracker
• Different Technologies:– Technical Overview– Pros / Cons– Hybrids
• Conclusions
![Page 3: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/3.jpg)
What is Tracking?
Trackers are used for five primary purposes:• View Control
– Position & Orientation– Virtual Camera
• Navigation• Object Selection
– Handheld Devices– Grab + Manipulate virtual objects
• Instrument Tracking– Physical objects to match virtual representations– Computer-aided surgery
• Avatar Animation– Motion Capture
![Page 4: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/4.jpg)
Performance
How do we measure a good tracker?
• Size• Degrees of Freedom (x, y, z, roll, pitch, yaw)• Accuracy (resolution)• Speed (updates & latency)• Occlusion Handling• Resistance to Interference• Range• Cost
![Page 5: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/5.jpg)
Performance
What are the kinds of tracking errors?
• Static Tracked Object– Spatial Distortion (inaccuracy)– Spatial Jitter (noise)– Creep
• Dynamic Tracked Object– Lag (time delay, tracker + subsystems complex relation)– Latency Jitter (variations in latency)– Dynamic Errors (other inaccuracies, e.g. prediction algorithms)
![Page 6: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/6.jpg)
The Ideal Tracker
Magical, ideal tracker would have these characteristics:
• Tiny (transistor size)• Self-Contained• Complete (6 DoF)• Accurate (1mm position, 0.1 degree orientation)• Fast (1000Hz, <1s latency)• Immune to occlusions (no line-of-sight requirement)• Robust (no interference)• No range limitation• Cheap
![Page 7: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/7.jpg)
Tracking Technologies
• 5 main types: mechanical, inertial, acoustic, optical, magnetic.• Most can be classed as:
• Outside-In: user emits signal to indicate its location to the system• Inside-Out: systems emits signal to user which senses location
Outside-in Inside-out
![Page 8: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/8.jpg)
Mechanical Trackers
• First & simplest systems
• Use prior knowledge or rigid mechanical pieces and measurements from sensors.
• Typically boom-type tracked displays with counterweights.
![Page 9: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/9.jpg)
Mechanical Trackers
• Pros– Accurate– Low latency– Force-feedback– No Line of Sight or Magnetic Interference Problems
• Cons– Large & cumbersome– Limited range
![Page 10: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/10.jpg)
Mechanical Trackers
• Some example systems
![Page 11: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/11.jpg)
Inertial Trackers
• 3 linear accelerometers measure acceleration vector• Rotated using current rotation matrix (orientation)
determine by gyroscopes
![Page 12: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/12.jpg)
Inertial Trackers
• Pros– Small (chip form), self-contained.– Immune to occlusions– No interference– Low latency (typically <2ms)– High sample rate
• Cons– Drift is the show stopper– Accelerometer bias of 1 milli-g 4.5m drift after 30s– Close, but no silver-bullet
• High potential as part of hybrid systems…
![Page 13: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/13.jpg)
Acoustic Trackers
• Uses sound waves for transmission and sensing
• Involves pulses at intervals• SONAR is best known,
determining time of a pulse• Uses ultrasound• Outside-In (microphone
sensors)• (Logitech Acoustic Tracker)• (Samba De Amigo Maracas)
![Page 14: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/14.jpg)
Acoustic Trackers
• Pros– Very small so can be worn– Line of sight less of an issue than with optical systems– Better range than mechanical systems
• Cons– Size proportional to range– Environment considerations (temperature, humidity)– Acoustic issues can cause slow update rate (10Hz) (5-100ms)– Attenuation at desirable high frequencies (reduced interference)– Jingling of keys
![Page 15: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/15.jpg)
Optical Trackers
• Measures reflected or emitted light• Involves a source (active or passive) and
sensor• Sensors can be analogue or digital• Photo sensing (light intensity) or Image
forming (CCD)• Triangulation with multiple sensors• Possible to be both outside-in and inside-
out
![Page 16: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/16.jpg)
Optical Trackers
• Pros– Analogue sensors with active light source gives high update and
spatial precision– Passive with image-forming sensors could be used in an unaffected
environment– Image forming sensors provide closed-loop feedback of real
environment and tracker
• Cons– Line of sight is critical– Target’s orientation harder to determine
![Page 17: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/17.jpg)
Magnetic Trackers
• Measures changes in the magnetic field• Can be done by magnetometers (for DC)• Or by induced current in an
electromagnetic field (for AC)• 3 sensors orthogonally arranged will
produce a 3D vector• In tracking, a multi-coil source unit with
each coil energised (excited) and when measured results in position and orientation.
• Compass: uses the earth’s naturally occurring DC magnetic field to determine heading, can be used here
• (Ascension spacePad)
![Page 18: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/18.jpg)
Magnetic Trackers
• Pros– User-worn component small– No line of sight issues (magnetic fields go through us)– One source unit can excite many sensor units– Very low latency (~5ms)– Ability to track multiple users using a single source unit
• Cons– Field distortions (foreign objects, natural magnetic field)
– Requires some compensation– Jingling of keys (or anything magnetically conductive)– Need to wait for energised excitation of coil to subside before the
next one so update is slow– Jitter increases over distance from emitter/sensor
![Page 19: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/19.jpg)
Hybrid Trackers
• No ideal solution that suits all applications
– Many different approaches, each with advantages and limitations
– Can address the limitations by building hybrid systems which combine the advantages of each approach
• Inertial sensors have provided the basis for several successful hybrid systems due to their advantages
• Example, the AVCATT-A flight simulator uses the InterSenseSimTracker, an acoustic-inertial hybrid
![Page 20: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/20.jpg)
Hybrid Trackers
• InterSense IS-900– Tracking system for VR-Walkthrough
applications– Inertial (orientation & position) &
Ultrasonic (drift correction) hybrid tracker which has highly accurate 6 degree of freedom tracking in a wide area.
– Features fast updates, low latency, filtering to reduce jitter and advanced prediction algorithms to reduce latency very smooth and precise
– The four sensors, including a head tracker, a hand tracker, a wand (with four buttons and an integrated joystick), and a stylus (with two buttons).
– Used in UCL’s very own ReaCTor
![Page 21: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/21.jpg)
Real Summary
• Quite a complex and challenging problem– No real ideal solution (“Silver Bullet”)
• Several tracking technologies exist with different levels of suitability based on the application in question. All of the technologies display both pros and cons. – The ultimate tracker will probably not be developed from a single
technology, but as a hybrid of these technologies.
• A VR application should provide the following:– High data rates for accurate mapping without lag– High tolerance to environmentally induced errors– Consistent registration between physical and virtual environments– Good sociability so that multiple users can move freely
![Page 22: Virtual Environments Tracking Systems](https://reader033.fdocuments.us/reader033/viewer/2022042401/625d5ac6abc142318e5c785c/html5/thumbnails/22.jpg)
Reading Material
• Motion Tracking: No Silver Bullet, but a Respectable Arsenal– G. Welch and E. Foxlin (2002)– IEEE Computer Graphics and Applications
• A Survey of Position Trackers– Kenneth Meyer, Hugh L. Applewhite and Frank A. Biocca (1992)– MIT Press