Visualisation & Interactive Prototyping Mentor Session - Gold Coast Mayors

Technology Awards 2015

Dr James Birt

Time(mins) Session Outline

30

Presentation: - Visualisation & Interactive Prototyping with practical advise on developing interactive virtual & physical prototypes across platforms using Unity 3D

30

Technology Hands on (Present your ideas!):•3D Printer•3D Scanner•Virtual Reality•Mobility•Robotics

Dr James BirtAssistant Professor of Interactive Media and Design (Games & Multimedia)

BIT (Hons), PhD (Software Engineering & Artificial Intelligence)

2014 Australian Office for Learning and Teaching Citation for Outstanding Contribution to Student Learning

15+ years industry & academic experience

http://bond.edu.au/profile/dr-james-birt

2014 Emerging Technologies

Hype Cycle

Why Visualisation and Interaction? Humans perceive images & audio faster than raw data

Bond Web Design & Investigative Journalism collaboration to use Census data highlight human stories on “unhappy” places in

Australia

2D static images can be misleading

From this vantage point we actually cant see this portion of the

building

Virtual Reality

Education Blended Learning

Mobile Devices, 3D Manipulation & Augmented

Reality

Stirling, A., & Birt, J. (2014). An enriched multimedia eBook application to facilitate learning of anatomy. Anatomical sciences education, 7(1), 19-27.

9

3D Printing & Augmented Reality Distance Education

https://youtu.be/vTRsnn-76mM?t=1m40s

Cowling, M. A., Moore, E., Birt, J. (2015). Augmenting Distance Education Skills Development in Paramedic Science through Mixed Media Visualisation, Proceedings of EUROMEDIA'2015, IST,

Lisbon, Portugal, April 27-29.

10

Interactive Mobile Stereoscopic Augmentation

Move the marker closer to the phone and see inside the

object

Gaze (using a Raycast) at the 2D Representation and instantiate 3D

model

11

Exploring Mixed Media Prototyping with Unity

Unity 3D http://unity3d.com/

cross-platform creation system

2D/3D visualisations

includes game engine, programming IDE (C#, Javascript)

Amazing community

Free & Licensed http://unity3d.com/unity/licenses

scene view

game view

scene objects

project assetsobject details

3D Model OBJ (STL) Format

Keep poly count low

• For the best portability save your model in obj file format

• Please note that many 3D printers e.g. UP require an .stl file format

3D PrinterTips:Covert all Nurbs to

polygonsKeep Low polygon countCombine mesh using

Boolean UnionTriangulate MeshFill HolesCheck vertex normalsBase surface flatCheck physical scaleAvoid overhanging

surfaces (results in support material)

Smooth DesignDelete Object HistoryExport as obj (stl)

Vertex normal shown Scale: mm

Unity 3D + Oculus Rift Setup

developer.oculus.com/downloads/

Download Windows Runtime

Download Unity Package

Install Windows Runtime

Import OculusUnity package

For interactive 1st Person OVRPlayerController is added to your scene

Add a platform or terrain to walk on the controller has gravity applied

Unity 3D + Augmented RealityResourcesQualcomm Vuforia 5 includes

(Stereoscopic AR): developer.vuforia.com/

Marker generator: www.brosvision.com/ar-marker-generator/

Guides: developer.vuforia.com/library/getting-started

Android + UnityResources Unity3D Setup:

docs.unity3d.com/Manual/android-sdksetup.html

Android SDK: developer.android.com/sdk/

Developer Guides - Android: developer.android.com

Java Development Kit: www.oracle.com/

Tips

1. Install Java (JDK) - Administrator

2. Install Android (SDK) - Administrator

3. Run Unity3D – Android Build & Player Settings