Mobile AR Lecture 5 - Location Based AR

LECTURE 5: LOCATION-BASED AR

Mark Billinghurst [email protected]

Zi Siang See [email protected]

November 29th-30th 2015

Mobile-Based Augmented Reality Development

AR Point of Interest


Video: Layar, Impactful Augmented Reality in Your Everyday Life


Video: Microsoft future

Challenges • Design and Development

• Content creation, authoring • Display platforms or systems •  Tracking approaches

Sensors

Wikitude World: location-based AR

Wikitude World: location-based AR • KML

• Keyhole Markup Language is a standardized format used in Google Earth. It can provide basic information for POIs and easily uploaded (or using hyperlink) into Wikitude.

• KML files can be created with the Google Earth user interface (in Google Map)

• Alternatively, it can be created using XML or simple text editor to work on raw KML scripts from scratch.

https://developers.google.com/kml/documentation/?hl=en

Wikitude World: location-based AR • ARML

• Augmented Reality Markup Language is an open exchange format based on KML but extends the format for useful data around AR data sets.

• ARML 2.0 is used in the live versions of the 3 leading Augmented Reality Browsers (Junaio, Layar and Wikitude), where it is used to make the AR Browsers interoperable.

• ARML 1.0 file format is currently used in the Wikitude World Browser.

http://openarml.org/wikitude4.html

Steps for Using Wikitude 1.  Register for Wikitude account

•  http://www.wikitude.com 2.  Register for web hosting account

•  http://www.000webhost.com • Own domain and server hosting

3.  Content authoring •  https://www.google.com/mymaps/ •  http://studio.wikitude.com • Scripting and customization

Publish in Wikitude • KML

•  [put stuff here] • ARML

•  [put stuff here]

Free Web Hosting • KML



Part 1: KML

https://www.google.com/mymaps/ • KML



KML (Google Map) • KML



KML: XML Scripting • KML



KML • Benefits

• Generated from Google Earth • Allows basic editing

• Current limitation •  Limited scripting option for Wikitude World •  Lack of options for POI details in Wikitude World • Range is confined to ~20km radius

Publish in Wikitude: KML • KML



Publish in Wikitude: KML • KML



provide URL, host the *.kml file from your own server

Wikitude Mobile App

Part 2: ARML

Publish in Wikitude • KML



ARML: XML Scripting • KML




wikitude-arml_workshop.xml <?xml version="1.0" encoding="UTF-8"?> <kml xmlns="http://www.opengis.net/kml/2.2" xmlns:ar="http://www.openarml.org/arml/1.0" xmlns:wikitude="http://www.openarml.org/wikitude/1.0"> <Document> <ar:provider id="utm-workshop-arml"> <ar:name>UTM AR Workshop (ARML)</ar:name> <ar:description>Creating POI location-based AR</ar:description> <wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl> <wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo> </ar:provider> <Placemark id="123"> <ar:provider>utm-workshop-arml</ar:provider> <name>LEGOLAND</name> <description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description> <wikitude:info> <wikitude:thumbnail> http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png </wikitude:thumbnail> <wikitude:phone>+6075978888</wikitude:phone> <wikitude:url>http://www.legoland.com.my</wikitude:url> <wikitude:email>[email protected]</wikitude:email> <wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address> </wikitude:info> <Point> <coordinates>103.63179030000003,1.426637,0.0</coordinates> </Point> </Placemark> </Document> </kml>


Keep consistent


Allows replication (use unique numeric id) For example <Placemark id=“124”> or <Placemark id=“125”>


Longlitude, Latitude, Altitude (altitude is optional)

ARML: Tags


Publish in Wikitude: ARML • KML



Publish in Wikitude: ARML • KML



provide URL, host the *.xml file from your own server

Wikitude Mobile App

ARML • Benefits

• Extended scripting option for Wikitude World • Additional POI details in Wikitude World

• Current limitation • Propagation: Wikitude World may take time to be

visible. • Range is confined to ~20km radius

•  Future possibilities • AR link may be interoperated with other AR browser.

Discussion • Potentials

•  Location-based AR experience may extend beyond vision (Nurminen, 2015) – multisensory augmentation.

• Sensor such as GPS can be unstable.

Nurminen, A. (2015) Mobile multisensory augmentations with the CultAR platform. SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications.

Discussion • Potentials

• User interface that provides rich audio-visual AR/VR experience, multiple devices (Matomura et al., 2015).

Matomura, W., Yamanaka, M. and Yamamoto, T. (2015) Mobile-based Streaming System of Spatial Audiovisual Contents and Web-based Design System. SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications.

Implication

• Possibilities • Explore other solutions suitable for hybrid approaches

that combine vision-based tracking and sensor input. • Design industry - user interface, content development. • Mixed-reality experience (taste, scent, haptic, touch,

audio, motion).

Explore • Design and Development

• Content creation • Display platforms or systems •  Tracking approaches

Mobile AR Lecture 5 - Location Based AR

Technology

Transcript of Mobile AR Lecture 5 - Location Based AR