Post on 27-Jul-2020
Sean Safreed Cofounder | Product Owner
Forest Key, CEO
Product Manager for V1 end-to-end video stacks of both Adobe Flash and Microsoft Silverlight: server, client, authoring, DRM, partner ecosystems. Lucasfilm CGI artist. 2x prior media-tech founder/CEO with public company exits.
Jim Eadie, CBO
Business and corporate development executive at Viacom, Time Warner, AOL. Architected digital, social and mobile monetization strategies.
Sean Safreed, CMO
Graphics processing and pipeline tooling veteran at Apple, SGI, and founder of leading motion graphics and VFX tools vendor Red Giant (products currently in used by 200k+ artists).
Scott Squires, CTO
Former Lucasfilm VFX Supervisor and technology lead, multi-film Academy Award nominee for VFX, recipient of Science & Technology Academy Award. Founder of Dreamquest Images (now Disney) and Puffin Designs (now Avid).
Bill Hensler, CPO
Engineering lead for Adobe Creative Suite video product and servers technologies, and photography tools at Apple. Early digital video editing tools and hardware pioneer.
Aaron Rhodes, Exec Producer
Producer of numerous corporate film projects for clients such as Adobe, HP, Oculus, and Nvidia. CGI artist and supervisor credits include: Ironman, The Avengers, Sin City, Harry Potter, Pirates of the Caribbean, etc.
• Cloud Video Authoring and Delivery Platform for X-Reality Storytelling (Virtual, Augmented, Mixed)
• Business model – Software Platform
• Founded late 2015
• Backed by Madrona, Vulcan Capital, Raine, and angel funding
Pixvana SPIN Studio
An end-to-end platform for spherical video processing in the cloud
Mission Solve the issues that break immersions with VR video softness:Lack of resolution, stereo acuity and color depth.
FOCUS ON STREAMING VR
Solution: Increase resolution where the viewer is looking at any time and decrease resolution where you are not, this is Field of View Adaptive Streaming (FOVAS).
Equirectangular Image - 10K
What You See in the HMD
Field of View is Narrow and Resolution is Low
Most HMDs have a 96° field of view
Today’s 4K Resolution is NOT Enough
Table 1
4K 5.5K 8K 12K ~16K
Horizontal 4096 5400 8192 12288 15360
Vertical 2048 2700 4096 6144 7680
Pixel/degree 11 15 23 34 43
FOV 96 96 96 96 96
Resolution 1092 1440 2185 3277 4096
HMD Now Late 2017 2019 2022 ?
OPF Projections and Viewports
Viewboxes Viewports A individual video stream that is optimized for a given field-of-view within the entire spherical video
A projection through which a viewer perceives a video stream in Virtual Reality
OPF Mapping - Frustum
The small face of the frustum has the highest effective resolution, and includes high-res faces on the top/bottom and sides of
The FOV and pixel density value for center-view of the current viewport
X
(Z) Highest Resolution
(X) Lowest
Resolution
(Y) Falloff Curve
The fall-off function, which affects the rate of decay of image quality as FOV of (A) approaches FOV (C)
YThe FOV and pixel density value for rear-180-view of the current viewport
Z
Viewport video stream --------------
The final projection map onto frustum shaped OPF viewing room
The large face at the back of the frustum has the lowest effective resolution
OPF Mapping - Frustum
Frustum Projection Highest Resolution Image Area
1
2
3 4
5
12 4
53
Processing Pipeline for 16K Jobs
• SuperNova image processing framework • Extended the engine to run on Linux servers • Jobs are driven with a JSON-based DAG w/OpenGL functions • A single GPU shader drives the projection process
FOVAS Process on AWS
10K Projection
HD HD HD HD HD HD
HD HD HD HD HD HD
HD HD HD HD HD HD
HD HD HD HD HD HD
S3
GPU
Hybrik Encoder
Pixvana SPIN runs a 50 node K2 GPU cluster to complete jobs in a reasonable timespan. Doing this same work on a desktop
HD HD HD HD HD HD
Looking Forward
• Revise processing framework for greater parallelism • Extended the engine to use on GPU encoders/decoders • Switch to CUDA for easier development for compute • Test on p2 instances for faster processing + I/O
Preview on Steam - HTC Vive and Oculus Rift
http://store.steampowered.com/app/623970/Pixvana_SPIN_Play/
Questions @pixvana, @seanpixvana