Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps...
-
Upload
adela-crawford -
Category
Documents
-
view
212 -
download
0
Transcript of Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps...
![Page 1: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/1.jpg)
Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems
Problem: Building mobile AR apps that work in realistic environments is too hard One key problem: spatial and temporal errors
Project: Develop techniques/toolkits for building AR interfaces that adapt to changing errors Enable more complex/realistic AR
applications to be built
![Page 2: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/2.jpg)
Scientific Issues
Quantify error in a way that is useful to toolkit and application programmers
Develop techniques to adapt interfaces based on these errors
Define a useful programming model for AR interfaces Framework + components
![Page 3: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/3.jpg)
Challenges
Understanding error of various tracking technologies a complete AR system (e.g., latency,
calibration)
Developing a robust AR system Calibration, performance
Developing realistic test applications
![Page 4: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/4.jpg)
Technical Approach
Interative DesignStandard HCI Methodology
Repeat: {Design, Prototype, Generalize}Simultaneous activities
Model error, augmentation characteristics Design, build toolkit APIs Develop prototype applications,
infrastructureTest and extend toolkits
![Page 5: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/5.jpg)
Accomplishments:Presenting Error To Programmers
Compute registration error (pixels) for 3D locations
Provide appcontinuousvalue of reg. error
Distance to point
Pose
Erro
r of V
iew
er’s
Head
![Page 6: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/6.jpg)
AccomplishmentsAPI for Dealing with Changing Error
Low-level API: Level-of-Error (LOE) Analogous to LOD
Change augmentation based on registration error
Low Reg. Error(accurate outline)
Larger Reg. Error(coarse outline)
Large Reg. Error(refer to object,
no outline)
![Page 7: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/7.jpg)
AccomplishmentsIntegrating Video Actors in 3D AR
Tool to support complex content for AR Integrate actions of video narrator (ie.
tutor, guide) with real and virtual 3D objects
Synchronize videopitcher’s throw with
virtual ball
Synchronize videopoet’s words withcreation of falling
virtual words
Video editor for specifying actions
![Page 8: Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems zProblem: Building mobile AR apps that work in realistic environments is too hard yOne.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bff81a28abf838cbf25e/html5/thumbnails/8.jpg)
FY01 Goals
Develop a prototype of a complete toolkit All components in place, most simplified
Develop better error models Trackers (incl. vision-based), application
dataContinue application development