Post on 18-Apr-2018
WT: AUGMENTED REALITY BROWSERS
Eduardo Veas
Graz University of Technology December 2017
Eduardo Veas Dec. 2017
AR … WHAT?
WHAT AR ??
2
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
3
AUGMENTED REALITY MOBILE INTERACTION
AR … WHAT?
Eduardo Veas Dec. 2017
AR … WHAT?
Attach to a person’s surroundings computer generated information
- registered in 3D
- in real-time.
4
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR … WHAT?
5
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR … WHAT?
Attach to a person’s surroundings computer generated information
- registered in 3D
- in real-time. 6
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR – TOPICS.
• Accurate registration = tracking.
• Rendering content in 3D
• Adapting to real world conditions
• View management
• Interaction with physical / virtual content
7
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
• Rendering content in 3D
• Adapting to real world conditions
8
AUGMENTED REALITY MOBILE INTERACTION
AR – TOPICS.
Eduardo Veas Dec. 2017
9
AUGMENTED REALITY MOBILE INTERACTION
• View management
• Interaction with physical / virtual content
AR – TOPICS.
Eduardo Veas Dec. 2017
AR … WHY?
mobile (wearable) computer + display
+ computers and sensors everywhere
= seamless gateway to a digital world about the physical world.
10
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR … WHY?
• Natural interaction
• Information integrated in single space
• Reveal the invisible
11 AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR VISION
• Show video here
12
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR - Technology
13
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Tech: History
14
AUGMENTED REALITY MOBILE INTERACTION
[Sutherland, 1965] Sutherland, I. E. (1965). The ultimate display. In
Proceedings of the IFIP Congress, pages 506–508.
Eduardo Veas Dec. 2017
AR Tech: History
15
AUGMENTED REALITY MOBILE INTERACTION
[Rekimoto, 1995] Rekimoto, J. (1995). The Magnifying Glass Approach to Augmented Reality Systems. In International
Conference on Artificial Reality and TeleExistence, volume 95, pages 123–132.
Eduardo Veas Dec. 2017
AR Tech: History
16
AUGMENTED REALITY MOBILE INTERACTION
1995 -------------------------------- 2002 -------------------------------- 2007
Eduardo Veas Dec. 2017
AR Tech: History
17
AUGMENTED REALITY MOBILE INTERACTION
Columbia University: MARS ‘97
Eduardo Veas Dec. 2017
MARS BARS TINMITH
18
AUGMENTED REALITY MOBILE INTERACTION
AR Tech: History 1995 -------------------------------- 2000 -------------------------------- 2002
Eduardo Veas Dec. 2017
AR - Technology
19
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR - Technology
20
AUGMENTED REALITY MOBILE INTERACTION
1995 -------------------------------- 2008 ------------------------------------------- 2017
CPU:300 Mhz HDD: 9 GB RAM: 512Mb Camera: VGA 30FPS Graphics: 500k poly/sec
CPU: 600 Mhz HDD: 16GB RAM: 128Mb Camera: VGA 30FPS Graphics: ~7 Mio poly/sec
Eduardo Veas Dec. 2017
AR - Applications
• Advertisement
• Navigation
• Tourism
• Entertainment
• UI for appliances
• Maintenance
• Military
21
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Navigation
22
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
Subsurface information: Motivation
Visualize location of underground infrastructure, to determine position of asset.
23
AR INTERFACES FOR MOBILE SPATIAL INTERACTION
Eduardo Veas Dec. 2017
Subsurface information
Goals: survey position of new asset. Estimate position of existing asset.
24
AR INTERFACES FOR MOBILE SPATIAL INTERACTION
Eduardo Veas Dec. 2017
Subsurface information
• (GIS provider)
• Clients: Utility companies ( electricity, water, gas), government, railroad companies.
• Requirements: precise registration.
25
AR INTERFACES FOR MOBILE SPATIAL INTERACTION
Eduardo Veas Dec. 2017
AR Browsers
• Real World Overlay – GPS + compass
– Graphics on live video
• SDKs – Metaio
– Wikitude
– Layar
– AccrossAir
26 AUGMENTED REALITY MOBILE INTERACTION
• Overlay Real Object – Computer Vision
– Graphics on live video
• SDKs – Qualcomm’s
VUFORIA
– Metaio/Junaio
– Layar
Eduardo Veas Dec. 2017
AR Browsers:
27
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Browsers:
28
AUGMENTED REALITY MOBILE INTERACTION
Open Channel
Open Channel
Request POI
Request POI
Display POI
Display POI
Parse/ Load content
Parse/ Load content
Callback channel Callback channel
XML Fwd XML Fwd
Create POI
Create POI
Format XML
response
Format XML
response
Eduardo Veas Dec. 2017
AR Browsers: Client
29
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Browsers
30
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Browsers
• Comercial outdoor LB applications – Metaio, Layar, Wikitude
• No uniform language – Wikitude: ARML
– Junaio: XML
31
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
VUFORIA SDK
32
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
33
AUGMENTED REALITY MOBILE INTERACTION
VUFORIA SDK
Eduardo Veas Dec. 2017
AR Browsers: Limitations
• Slow Memory
• Poor access to camera (but IOS camera API)
• Bad camera quality
• No floating point unit
34
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Browsers
• Layar (http://www.layar.com/)
• Metaio (http://www.metaio.com/)
• Wikitude (http://wikitude.com/)
• Ausrasma (http://www.aurasma.com/)
• AR Lab (http://www.arlab.com/)
• Argon (http://argon.gatech.edu/)
• MixARe (http://www.mixare.org/)
35
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
AR Projects
• AR Spaces: using space around you to display information ad-hoc.
• AR Reading Aid: using wearable devices to show information related to a piece of text
• AR Guide: using wearable devices to collaboratively build LEGO stuff together.
• Interested? Know C++? Contact eveas@know-center.at
36
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
Closing video
37
AUGMENTED REALITY MOBILE INTERACTION
Eduardo Veas Dec. 2017
Thank you
38
Eduardo Veas | eveas@know-center.at