Post on 22-Dec-2015
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Fusality:
An Open Framework for Cross-platform
Mirror World Installations
Nicholas F. PolysBenjamin Knapp
Matthew BockChristina LidwinDane Webster
Nathan WaggonerIvica Bukvic
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Institute for Creativity, Arts and Technology (ICAT)
• http://www.icat.vt.edu/• The building is the instrument• Mirror Worlds of public, gallery and performance
spaces (NSF, VA) http://www.icat.vt.edu/impact/project/mirror-worlds
• The CreateCube http://www.icat.vt.edu/content/cube-0 – Optical tracking– 128 channel sound– HMD and Tablet views
http://www.theverge.com/2015/3/13/8204193/virginia-tech-icat-vr-research-oculus-rift
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
One Dimension (Milgram et al.)
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Scope• Mirror Worlds
– the fusion of real and virtual realities
– Sensor Systems and Smart Buildings– Online and local users have visual
and audio displays – Distributed and local users share
the space and its events• Design dimension:
– Reflecting events across participant *alities
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Requirements
• Work with 3D content pipelines taught in School of Visual Arts
• Work with the WWW ecology and other rendering engines
• Enable faculty and visiting artists to quickly prototype and build Mirror Worlds installations at VT’s Center for the Arts
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Approach
• Leverage Web3D Architecture – X3D / X3DOM – Websockets – node.js, socket.io– Start w TCP/IP for lossless communication
• Support adaptable message content, worlds and user roles– ‘Mirror worlds channels’ via node.js– Position, orientation, … gestures and UI events– JSON encoding of messages
• Build base 3D model of Moss Arts Center building with common naming and coordinate system– Express.js for spawning new mirror worlds as channels
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Design
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Realization
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Further Development
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Next Steps
• Examining levels of event logging, replay, feedback• User roles and distributed event management• Examine new X3DOM efforts for WebRTC and DIS
and custom event representations• Cluster rendering to thin CreateCube clients (e.g.
nVidia GRID w/ Instant Reality and Unity, Paraview)
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Future Research
• Fidelity and Presence• Sensors and displays in Ubiquitous Computing • Scalability of MMOGs• Embodiment and Affect• Occupancy and traffic patterns• Collaborative decision making / social
communication
Heraklion, Crete, Greece 18 - 21 June 2015
Web3D 201520th International Conference
on 3D Web Technology
Questions?
Collaborations Welcome!
npolys@vt.edu