Thuong HoangSupervisor: Prof. Bruce Thomas

Wearable Computer LabSchool of Computer and Information

Science

In-situ Model Refinement and Hands-free Interaction Techniques

for Outdoor AR

ngocthuong@gmail.com Bruce.Thomas@unisa.edu.au

ContentsLiterature reviewResearch questionContributionsConclusion

Literature review

Surveying current research in the field of Augmented Reality

Augmented Reality (AR) Immersively supplement real world with

virtual information, using Head-mounted display.

TinmithWearable outdoor

AR systemBackpack

computer Immersive head

mounted display (HMD)

State-of-the-art wearable outdoor immersive AR system

Menu systemPinch glove menu for command executions

ApplicationsARQuakeX-Ray VisionARWeather

ApplicationsModelling

Infinite planesPlace existing

models

Limitations

Modelling Interaction

Coarse modelling, no support for details

Simple model

Pinch glove menu system

Require both handsOccupied screen

space at all times

Modelling in AR

Benefits Challenges

In-situation contextual information

Instantaneous verification and visualisation of models

Limitations in input devices

Lack of methods for sampling real world artefacts

Interaction

Aims Challenges

Menu systemHands-freeUnobstrusive

Input devices or interaction techniques

Visualisation

Research QuestionWhat is the most suitable techniques to • assist modelling tasks• perform hands-free menu interactionin outdoor augmented reality?

Contribution

Offering the solutions to the research questions

Technique for model refinements

Laser rangefinderImaged-based reconstruction (Sequeira et al. 1999)

‘Left: Automatic capture robot

Right: Mesh model of environment

Virtual pointerOrientation sensor + Laser rangefinder

Modelling refinements - Laser Rangefinder Use of laser rangefinder for AR modelling

BenefitsOther 3D scanner methods Current Tinmith

Selective modellingOnly model the

required partDifferent density

No post processingModels are created

using triangulation.No off-site

processing

Small, high detailed feature.

Complex polygonal modelsDepending on the

triangulation algorithm used

Technique for hands-free interaction via a menu system

3D MenuRing menu (Liang

& Green 1993)Spin menu (Gerber

& Bechmann 2005)

Walkin’ Menu• 3D menu items placed within the environment

• Activate by looking down

• Execute by stepping onto menu item

BenefitsHands-free

Tracking user position, step on menu to activate

UnobtrusiveConstructed on demandPart of the environment

Multi-purposeCommand executionTextual and image display

Publications Hoang, TN, and Thomas, BH 2009, “In-situ refinement techniques for outdoor

geo-referenced models using mobile AR”, to appear in Proceedings of the 10th International Symposium on Mixed and Augmented Reality” (ISMAR2009), Orlando, USA, October 2009.

Hoang, TN, Porter, SR, Close, B, and Thomas BH 2009, “Web 2.0 meets augmented reality”, in Proceedings of the Thirteenth International Symposium on Wearable Computers (ISWC2009), Linz, Austria, pp 151-152.

Hoang, TN, Porter, S, and Thomas, B 2009, “Augmenting image plane AR 3D interactions for wearable computers”, Proceedings of the Tenth Australasian User Interface Conference (AUIC2009), Wellington, New Zealand.

Hoang, TN 2009, “Augmented reality in-situation menu of 3D models”, Proceedings of the 3rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide.

Hoang, TN 2009, “Augmenting reality 3D interactions for wearable computers”, Proceedings of the 3rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide. 

Hoang, TN and Thomas, B 2008, “Augmented reality In-situ 3D model menu for outdoors”, Proceedings of the 7th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR2008).

ConclusionTechniques for:• Model refinements using an orientation-sensed single-point laser rangefinder• Hands-free interaction via walkin’ menu

DisclaimerThe contents of this presentation should only be viewed in conjunction with the minor thesis document to be published online from 26th October 2009, at http://www.cis.unisa.edu.au/wiki/Hoang-minorthesis