Sean Safreed Cofounder Product Owner

Transcription

1 Sean Safreed Cofounder Product Owner

2 Cloud Video Authoring and Delivery Platform for X-Reality Storytelling (Virtual, Augmented, Mixed) Business model Software Platform Founded late 2015 Backed by Madrona, Vulcan Capital, Raine, and angel funding Forest Key, CEO Product Manager for V1 end-to-end video stacks of both Adobe Flash and Microsoft Silverlight: server, client, authoring, DRM, partner ecosystems. Lucasfilm CGI artist. 2x prior mediatech founder/ceo with public company exits. Bill Hensler, CPO Engineering lead for Adobe Creative Suite video product and servers technologies, and photography tools at Apple. Early digital video editing tools and hardware pioneer. Scott Squires, CTO Former Lucasfilm VFX Supervisor and technology lead, multi-film Academy Award nominee for VFX, recipient of Science & Technology Academy Award. Founder of Dreamquest Images (now Disney) and Puffin Designs (now Avid). Sean Safreed, CMO Graphics processing and pipeline tooling veteran at Apple, SGI, and founder of leading motion graphics and VFX tools vendor Red Giant (products currently in used by 200k+ artists). Jim Eadie, CBO Business and corporate development executive at Viacom, Time Warner, AOL. Architected digital, social and mobile monetization strategies. Aaron Rhodes, Exec Producer Producer of numerous corporate film projects for clients such as Adobe, HP, Oculus, and Nvidia. CGI artist and supervisor credits include: Ironman, The Avengers, Sin City, Harry Potter, Pirates of the Caribbean, etc.

3 Pixvana SPIN Studio An end-to-end platform for spherical video processing in the cloud

4 FOCUS ON STREAMING VR Mission Solve the issues that break immersions with VR video softness: Lack of resolution, stereo acuity and color depth. Solution: Increase resolution where the viewer is looking at any time and decrease resolution where you are not, this is Field of View Adaptive Streaming (FOVAS).

5 Equirectangular Image - 10K

6 What You See in the HMD

7 Field of View is Narrow and Resolution is Low Most HMDs have a 96 field of view

8 Today s 4K Resolution is NOT Enough Table 1 4K 5.5K 8K 12K ~16K Horizontal Vertical Pixel/degree FOV Resolution HMD Now Late ?

9 OPF Projections and Viewports Viewboxes A projection through which a viewer Viewports A individual video stream that is optimized for a perceives a video stream in Virtual Reality given field-of-view within the entire spherical video

10 OPF Mapping - Frustum Viewport video stream The final projection map onto frustum shaped OPF viewing room OPF Mapping - Frustum The large face at the back of the frustum has the lowest effective resolution (Y) Falloff Curve (X) Lowest Resolution (Z) Highest Resolution The small face of the frustum has the highest effective resolution, and includes high-res faces on the top/bottom and sides of X The FOV and pixel density value for center-view of the current viewport Y The fall-off function, which affects the rate of decay of image quality as FOV of (A) approaches FOV (C) Z The FOV and pixel density value for rear-180-view of the current viewport

11 Frustum Projection Highest Resolution Image Area

12 Processing Pipeline for 16K Jobs SuperNova image processing framework Extended the engine to run on Linux servers Jobs are driven with a JSON-based DAG w/opengl functions A single GPU shader drives the projection process

13 FOVAS Process on AWS GPU HD HD HD HD HD HD HD HD HD HD HD HD S3 10K Projection HD HD HD HD HD HD HD HD HD HD HD HD Hybrik Encoder HD HD HD HD HD HD Pixvana SPIN runs a 50 node K2 GPU cluster to complete jobs in a reasonable timespan. Doing this same work on a desktop

14 Looking Forward Revise processing framework for greater parallelism Extended the engine to use on GPU encoders/decoders Switch to CUDA for easier development for compute Test on p2 instances for faster processing + I/O

15 Preview on Steam - HTC Vive and Oculus Rift

16 @seanpixvana