How to Develop VR Applications and Publish from Phone to Dome - Nils Andersson

Copyright 2016 EON Reality.Inc All rights reserved

How to develop VR applications

and publish

from phone to dome


By using the EON software platform it is possible to develop one application and publish to many platforms from phone to dome display systems.

During the last 20 years the EON Software platform has been built to help create advanced interactive 3D applications and enable them to be published on various platforms including Windows with support for multiple rendering nodes and mobile platforms like iOS and Android.


➢ VR support in EON software

➢ Publishing from phone to dome

➢ Advanced VR display systems

➢ Use cases and experiences

In this talk, I'll describe:


➢ 20 years experience within Virtual Reality/Interactive 3D

➢ 30+ years experience in software development

➢ Responsible for software development at EON Reality

➢ Master of Science in Electrical Engineering from Chalmers University of Technology in Gothenburg, Sweden, 1992.

Nils Andersson, CTO, EON Reality


EON Reality has based on +15 years of R&D become the world leader in VR based Knowledge Transfer in Industry, Education And Edutainment with > 450 industry customers, > 400 academic organizations & 55 government partners

EON Reality the Global leader in VR based Knowledge Transfer

#1 VR/AR Software for Knowledge Transfer > 29Publishing Formats

#1 VR/AR Library for >7000 applications

#1 VR/AR Network >11 offices and 14 Centers

#1VR/ARAudience for Knowledge Transfer with 36 million viewers

http://youtu.be/q800UgcNXFM

http://youtu.be/q800UgcNXFM

http://youtu.be/GjcVMfEOwJo

http://youtu.be/GjcVMfEOwJo

http://youtu.be/WqPjmKBj3kw

http://youtu.be/WqPjmKBj3kw

http://youtu.be/K0jWzr7aAeM


VR support in EON software


➢ Immersive multimedia or computer-simulated reality

➢ Replicates an environment that simulates a physical presence in places in the real world or an imagined world

➢ Allowing the user to interact with that world.

➢ Virtual realities artificially create sensory experience, which can include sight, touch, hearing, and smell.

What is VR?


➢ Stereoscopic Viewing

➢ Perspective handling

➢ Tracking: Vicon, A.R.T., Kinect...

➢ Interactions: Gloves, game pads, Wand

➢ Special effects: Smell, wind, vibration

Ingredients in Virtual Reality


Publishing from phone to dome


➢ Template holds information about a specific display system: display configuration, tracker system etc

➢ One template per display system➢ Same content file can then be used on many

different display system setups

Advanced template injection system for configuration


➢ Create an app directly from the EON Software suite➢ App will include necessary app information for

publishing➢ Automatic optimization of texture formats

Deployment tool for Android and iOS


➢ Build one application and publish on any platform

➢ Use more or less all functionality from the EON software platform in any hardware platform

Publishing from phone to dome

http://www.youtube.com/watch?v=q800UgcNXFM


Advanced VR display systems


ICube - cave environment


●

● EON IBench - zSpace stereoscopic display


➢ Traditional - Sony Glasstron➢ Current

○ Google Glass, MS Hololens - and

many other smaller companies➢ Desktop

○ Oculus, HTC Vive

➢ Mobile○ Cardboard, Samsung Gear VR, Zeiss

VR One, Epson Moverio BT 200

VRH - Virtual Reality Headsets

Important technical considerations➢ Field of View

➢ Image size - on See Through Glasses

➢ Memory limitations on mobile devices

➢ GPU limitations on mobile devices


Use cases and experiences


Experiences

Budget!!!

Texture format

Texture resolution

Memory usage


ExxonMobil

Rex W. Tillerson, Exxon Chairman and Chief Executive Officer

EON Icube can be used for operator training similar

to how flight simulators are used.

EON was selected since they delivered everything:

software, content, hardware.

Operators can with an emergency response team

train for low probability/high-consequence

scenarios.

Rex W. Tillerson, ExxonMobil Chairman and Chief

Executive Officer

Tillerson wanted to be convinced VR

this is a good thing to do. ExxonMobil is

spending a lot of money on making their

plants reliable. The more reliable you

make your plants, the more important it

is to train low probability/highcost

events (anomalies).


➢ Develop a 3D immersive virtual reality simulator for training operators in oil and gas production, processing, and transportation facilities

➢ Users shall have an experience of being on site➢ Use state of the art technology➢ Process control integration➢ Routine operations➢ Emergency response for

low-probability / high-consequence scenarios

➢ Team training capability

ExxonMobil - Objectives with training simulator


➢ EON Icube – 4-sided immersive virtual reality environment

➢ Vicon Optical Tracking of Human for perspective handling, avatar and gesture tracking

➢ Process control integration (Honeywell etc)➢ Voice control➢ Odor, Vibration and Directional Wind system to

create realistic environment➢ Multiuser/Team Training –

multiple EON Icubes and other display systems

➢ LMS integration

ExxonMobil - Visualization and Virtual Reality equipment


● Single or multiuser display● Need to render 2 - 9 times depending on number fo

users● Loose resolution - high pixel density is great

Glasses free 3D Display


ExxonMobil - Visualization and Virtual Reality equipment


➢ Very large modelThe current model contain more than 50 000 000 polygons. EON can navigate seamlessly in this model.

➢ Incomplete 3D CAD modelsUsed for designReal plant has been modified after CAD model

ExxonMobil - Challenges and solutions

https://www.youtube.com/watch?v=Bd6vek84eUo


World’s largest Virtual Reality Library for Knowledge Transfer!

EON Experience VR

http://www.eonreality.com/eevr/

➢ EON Mobile HTML Framework

➢ Optimize models!

➢ Three modesAR Marker is found here:http://www.eonreality.com/cardar/It’s the map in top-right corenr of the web page

http://www.eonreality.com/cardar/

http://www.eonreality.com/cardar/


EON Experience AVREON Creator AVR

http://www.eonreality.com/eon-experience-avr/


EON Experience AVR/EON Creator AVR


Most complex EON Mobile application built

EON Mobile HTML Framework - extended

Technical challenges:

➢ GPU memory usage - Optimize content - texture formats

➢ Complex logic - optimized Script support


EON Experience AVR/EON Creator AVR


On Google Play from March 25, App Store from mid April

https://www.youtube.com/watch?v=8G4EyRhSsHwhttps://www.youtube.com/watch?v=HyNgTj2Lyps


http://www.youtube.com/watch?v=8G4EyRhSsHw

How to Develop VR Applications and Publish from Phone to Dome - Nils Andersson

Technology

Transcript of How to Develop VR Applications and Publish from Phone to Dome - Nils Andersson