Mobile AR for Urban Design
-
Upload
mark-billinghurst -
Category
Technology
-
view
1.227 -
download
4
description
Transcript of Mobile AR for Urban Design
![Page 1: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/1.jpg)
Using Mobile Augmented Reality for Urban Design
Mark Billinghurst, Gun Lee HIT Lab NZ
University of Canterbury
September 2012
![Page 2: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/2.jpg)
![Page 3: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/3.jpg)
Christchurch Before and After
![Page 4: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/4.jpg)
![Page 5: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/5.jpg)
![Page 6: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/6.jpg)
![Page 7: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/7.jpg)
3D graphics solutions available Autodesk REVIST, ESRI ArcGIS, Grass,etc
![Page 8: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/8.jpg)
Emerging Novel User Interfaces Immersive visualization Multi-touch screens Gesture interaction Etc..
![Page 9: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/9.jpg)
Limitations Interface
Complex to use Unintuitive interaction 2D display for 3D content
Context of Use Remote visualization Separation from the real world Unable to show life-sized content
![Page 10: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/10.jpg)
1983 – Star Wars
![Page 11: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/11.jpg)
Augmented Reality Combines Real and Virtual Images
- Both can be seen at the same time Interactive in real-time
- The virtual content can be interacted with Registered in 3D
- Virtual objects appear fixed in space
![Page 12: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/12.jpg)
AR for Urban Design
![Page 13: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/13.jpg)
MagicCup: Urban Design Intuitive Virtual Object Manipulation
on a Table-Top Workspace
Design your own city Tangible User Interface
- Intuitive Manipulation
![Page 14: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/14.jpg)
Mobile AR for Urban Design Enhancing plans/documents
Indoor AR use, meeting support Overlaying virtual content on physical objects
- Visual tracking
Showing content on-site Outdoor AR use, on-site visualization Geo-located points of interest (POI)
- Sensor based tracking (GPS, compass)
![Page 15: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/15.jpg)
Enhanced City Plans
CERA – CCDU Plan Using tablet to track off printed maps Overlay 3D city models onto real maps
![Page 16: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/16.jpg)
User Experience
Touch interaction Pointing selection Animated objects
![Page 17: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/17.jpg)
Outdoor AR (2003)
Backpack system Laptop, HMD, camera
Highly accurate tracking GPS, inertial, RTK system 2-3 cm accuracy
![Page 18: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/18.jpg)
User Views
Stakeout survey application Users able to find survey points twice as fast
![Page 19: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/19.jpg)
2008 - Location Aware Phones
Nokia Navigator Motorola Droid
![Page 20: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/20.jpg)
Real World Information Overlay Tag real world locations (POI)
GPS, compass input Overlay graphics data on live video
Applications Travel guide, Advertising, etc
Eg: Layar (www.layar.com) > 20 million users > 3,000 information channels
![Page 21: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/21.jpg)
3DOn
Onsite Visualization Single Building GPS + Compass input Overlay graphics data on live video/Photos
![Page 22: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/22.jpg)
HIT Lab NZ Outdoor AR Platform
Cross platform Android, iPhone
3D onsite visualization 3D model loading Intuitive user interface
Positions content in space Camera, GPS, compass
Targeting museum guide/outdoor site applications
![Page 23: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/23.jpg)
CityViewAR Application (2011)
Visualize Christchurch before the earthquakes
![Page 24: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/24.jpg)
User Experience
Multiple Views Map View, AR View, List View
Multiple Data Types 2D images, 3D content, text, panoramas
![Page 25: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/25.jpg)
Time Usage
Percentage time spent in different views AR used more then 50% of time when available
![Page 26: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/26.jpg)
Navigation Patterns
Red: AR users Blue: Non-AR users
![Page 27: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/27.jpg)
Survey Results Use of AR improved the user experience
But no difference between AR and non-AR usefulness
Favourite features AR and Panorama views most popular Users also enjoyed having rich data available
Main Problems (50% reported no problems) UI design not intuitive (24%) System not responsive (16%)
![Page 28: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/28.jpg)
AR Urban Design Tool (2012) CERA CCDU Application
Enhanced CityViewAR application
Add VR view mode 3D model viewing/interaction
Add concept models of buildings Multiple buildings at single site
Client/Server architecture Support for user generated feedback
![Page 29: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/29.jpg)
VR View
![Page 30: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/30.jpg)
Differing Views
List View, Content View, Map View
![Page 31: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/31.jpg)
Interaction Touch interaction
Information filtering Building information Model panning, zoom, rotation
![Page 32: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/32.jpg)
Looking to the Future
![Page 33: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/33.jpg)
Next Steps Subsurface Visualization
See underground infrastructure
User evaluation Architects, Urban Designers, Public
Develop authoring tool Web-based content management system
Improve technology Tracking, 3D rendering
![Page 34: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/34.jpg)
Subsurface Visualization
Using AR to view underground infrastructure
![Page 35: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/35.jpg)
Client/Server Architecture
Android application
Web application java and php server
Database server Postgres
Web Interface
Add models
![Page 36: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/36.jpg)
Web based Outdoor AR Server Web interface
Showing POIs as Icons on Google Map
PHP based REST API XML based scene
data retrieval API Scene creation and
modification API Android client side
REST API interface
![Page 37: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/37.jpg)
BASIC VIEW
![Page 38: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/38.jpg)
PERSONAL VIEW
![Page 39: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/39.jpg)
Augmented Reality 2.0 Infrastructure
![Page 40: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/40.jpg)
Leveraging Web 2.0 Content retrieval using HTTP XML encoded meta information
KML placemarks + extensions
Queries Based on location (from GPS, image recognition) Based on situation (barcode markers)
Syndication Community servers for end-user content Tagging
AR client subscribes to data feeds
![Page 41: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/41.jpg)
iceFest (2012)
Outdoor AR for Antarctic Experience Visit Antarctica in real world Using handheld tablet
![Page 42: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/42.jpg)
Map Views
![Page 43: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/43.jpg)
Content Views
![Page 44: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/44.jpg)
AR View
View of ice superimposed over real world
![Page 45: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/45.jpg)
Panorama
Immersive 360 panorama
![Page 46: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/46.jpg)
Feedback
A = Satisfying, B = Ease to use C = Useful for learning, D = Better learning than internet
![Page 47: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/47.jpg)
Conclusions AR provides for geo-spatial visualization in place
Text, Images, 3D models
Hardware and software platforms widely available Many possibilities for urban design applications
Indoor, outdoor AR enhancements
Important research problems need to be solved Improved tracking, user interface, authoring tools,
social interaction, user experience, etc.
![Page 48: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/48.jpg)
More Information Mark Billinghurst
Gun Lee [email protected]
Websites www.hitlabnz.org www.hitlabnz.org/cityviewar www.hitlabnz.org/mobileAR
![Page 49: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/49.jpg)
Try It Yourself iOS (iPhone/Android)
Search for CCDU on app store
Android – Search on Android Market CityViewAR – outdoor AR view CCDU 3D – outdoor AR and 3D view CCDU AR – AR view
![Page 50: Mobile AR for Urban Design](https://reader034.fdocuments.us/reader034/viewer/2022042714/555ae555d8b42a4c7d8b4776/html5/thumbnails/50.jpg)
Thanks People
Julian Looser Jason Mills
Organizations