Sean Safreed Cofounder | Product Owner

Forest Key, CEO

Product Manager for V1 end-to-end video stacks of both Adobe Flash and Microsoft Silverlight: server, client, authoring, DRM, partner ecosystems. Lucasfilm CGI artist. 2x prior media-tech founder/CEO with public company exits.

Jim Eadie, CBO

Business and corporate development executive at Viacom, Time Warner, AOL. Architected digital, social and mobile monetization strategies.

Sean Safreed, CMO

Graphics processing and pipeline tooling veteran at Apple, SGI, and founder of leading motion graphics and VFX tools vendor Red Giant (products currently in used by 200k+ artists).

Scott Squires, CTO

Former Lucasfilm VFX Supervisor and technology lead, multi-film Academy Award nominee for VFX, recipient of Science & Technology Academy Award. Founder of Dreamquest Images (now Disney) and Puffin Designs (now Avid).

Bill Hensler, CPO

Engineering lead for Adobe Creative Suite video product and servers technologies, and photography tools at Apple. Early digital video editing tools and hardware pioneer.

Aaron Rhodes, Exec Producer

Producer of numerous corporate film projects for clients such as Adobe, HP, Oculus, and Nvidia. CGI artist and supervisor credits include: Ironman, The Avengers, Sin City, Harry Potter, Pirates of the Caribbean, etc.

• Cloud Video Authoring and Delivery Platform for X-Reality Storytelling (Virtual, Augmented, Mixed)

• Business model – Software Platform

• Founded late 2015

• Backed by Madrona, Vulcan Capital, Raine, and angel funding

Pixvana SPIN Studio

An end-to-end platform for spherical video processing in the cloud

Mission Solve the issues that break immersions with VR video softness:Lack of resolution, stereo acuity and color depth.

FOCUS ON STREAMING VR

Solution: Increase resolution where the viewer is looking at any time and decrease resolution where you are not, this is Field of View Adaptive Streaming (FOVAS).

Equirectangular Image - 10K

What You See in the HMD

Field of View is Narrow and Resolution is Low

Most HMDs have a 96° field of view

Today’s 4K Resolution is NOT Enough

Table 1

4K 5.5K 8K 12K ~16K

Horizontal 4096 5400 8192 12288 15360

Vertical 2048 2700 4096 6144 7680

Pixel/degree 11 15 23 34 43

FOV 96 96 96 96 96

Resolution 1092 1440 2185 3277 4096

HMD Now Late 2017 2019 2022 ?

OPF Projections and Viewports

Viewboxes Viewports A individual video stream that is optimized for a given field-of-view within the entire spherical video

A projection through which a viewer perceives a video stream in Virtual Reality

OPF Mapping - Frustum

The small face of the frustum has the highest effective resolution, and includes high-res faces on the top/bottom and sides of

The FOV and pixel density value for center-view of the current viewport

X

(Z) Highest Resolution

(X) Lowest

Resolution

(Y) Falloff Curve

The fall-off function, which affects the rate of decay of image quality as FOV of (A) approaches FOV (C)

YThe FOV and pixel density value for rear-180-view of the current viewport

Z

Viewport video stream --------------

The final projection map onto frustum shaped OPF viewing room

The large face at the back of the frustum has the lowest effective resolution

OPF Mapping - Frustum

Frustum Projection Highest Resolution Image Area

1

2

3 4

5

12 4

53

Processing Pipeline for 16K Jobs

• SuperNova image processing framework • Extended the engine to run on Linux servers • Jobs are driven with a JSON-based DAG w/OpenGL functions • A single GPU shader drives the projection process

FOVAS Process on AWS

10K Projection

HD HD HD HD HD HD

HD HD HD HD HD HD

HD HD HD HD HD HD

HD HD HD HD HD HD

S3

GPU

Hybrik Encoder

Pixvana SPIN runs a 50 node K2 GPU cluster to complete jobs in a reasonable timespan. Doing this same work on a desktop

HD HD HD HD HD HD

Looking Forward

• Revise processing framework for greater parallelism • Extended the engine to use on GPU encoders/decoders • Switch to CUDA for easier development for compute • Test on p2 instances for faster processing + I/O

Preview on Steam - HTC Vive and Oculus Rift

http://store.steampowered.com/app/623970/Pixvana_SPIN_Play/

Questions @pixvana, @seanpixvana