Thuong HoangSupervisor: Prof. Bruce Thomas
Wearable Computer LabSchool of Computer and Information
Science
In-situ Model Refinement and Hands-free Interaction Techniques
for Outdoor AR
ContentsLiterature reviewResearch questionContributionsConclusion
Literature review
Surveying current research in the field of Augmented Reality
Augmented Reality (AR) Immersively supplement real world with
virtual information, using Head-mounted display.
TinmithWearable outdoor
AR systemBackpack
computer Immersive head
mounted display (HMD)
State-of-the-art wearable outdoor immersive AR system
Menu systemPinch glove menu for command executions
ApplicationsARQuakeX-Ray VisionARWeather
ApplicationsModelling
Infinite planesPlace existing
models
Limitations
Modelling Interaction
Coarse modelling, no support for details
Simple model
Pinch glove menu system
Require both handsOccupied screen
space at all times
Modelling in AR
Benefits Challenges
In-situation contextual information
Instantaneous verification and visualisation of models
Limitations in input devices
Lack of methods for sampling real world artefacts
Interaction
Aims Challenges
Menu systemHands-freeUnobstrusive
Input devices or interaction techniques
Visualisation
Research QuestionWhat is the most suitable techniques to • assist modelling tasks• perform hands-free menu interactionin outdoor augmented reality?
Contribution
Offering the solutions to the research questions
Technique for model refinements
Laser rangefinderImaged-based reconstruction (Sequeira et al. 1999)
‘Left: Automatic capture robot
Right: Mesh model of environment
Virtual pointerOrientation sensor + Laser rangefinder
Modelling refinements - Laser Rangefinder Use of laser rangefinder for AR modelling
BenefitsOther 3D scanner methods Current Tinmith
Selective modellingOnly model the
required partDifferent density
No post processingModels are created
using triangulation.No off-site
processing
Small, high detailed feature.
Complex polygonal modelsDepending on the
triangulation algorithm used
Technique for hands-free interaction via a menu system
3D MenuRing menu (Liang
& Green 1993)Spin menu (Gerber
& Bechmann 2005)
Walkin’ Menu• 3D menu items placed within the environment
• Activate by looking down
• Execute by stepping onto menu item
BenefitsHands-free
Tracking user position, step on menu to activate
UnobtrusiveConstructed on demandPart of the environment
Multi-purposeCommand executionTextual and image display
Publications Hoang, TN, and Thomas, BH 2009, “In-situ refinement techniques for outdoor
geo-referenced models using mobile AR”, to appear in Proceedings of the 10th International Symposium on Mixed and Augmented Reality” (ISMAR2009), Orlando, USA, October 2009.
Hoang, TN, Porter, SR, Close, B, and Thomas BH 2009, “Web 2.0 meets augmented reality”, in Proceedings of the Thirteenth International Symposium on Wearable Computers (ISWC2009), Linz, Austria, pp 151-152.
Hoang, TN, Porter, S, and Thomas, B 2009, “Augmenting image plane AR 3D interactions for wearable computers”, Proceedings of the Tenth Australasian User Interface Conference (AUIC2009), Wellington, New Zealand.
Hoang, TN 2009, “Augmented reality in-situation menu of 3D models”, Proceedings of the 3rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide.
Hoang, TN 2009, “Augmenting reality 3D interactions for wearable computers”, Proceedings of the 3rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide.
Hoang, TN and Thomas, B 2008, “Augmented reality In-situ 3D model menu for outdoors”, Proceedings of the 7th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR2008).
ConclusionTechniques for:• Model refinements using an orientation-sensed single-point laser rangefinder• Hands-free interaction via walkin’ menu
DisclaimerThe contents of this presentation should only be viewed in conjunction with the minor thesis document to be published online from 26th October 2009, at http://www.cis.unisa.edu.au/wiki/Hoang-minorthesis
Top Related