Specialists in CG large format immersive experiences. At-Bristol Data Dome Workshop - 22 May Paul Mowbray - Head of NSC Creative

Transcription

1 Specialists in CG large format immersive experiences At-Bristol Data Dome Workshop - 22 May 2015 Paul Mowbray - Head of NSC Creative Tweet

2

3 Image: BAP Conference 2012

4

5

6 Immersive formats: 360 Fulldome video VR Stereoscopic 3D Multi-channel video walls Pepper s ghost 4D cue design including; aroma, light, wind and motion Plus Broadcast, HD flat screen video and Online

7 Largest producer of high-quality digital planetarium shows in the world. Licensed content to over 600 venues around the world in 30 countries. Over 10 million people have experienced NSC Fulldome films worldwide.

8

9

10

11

12

13

14

15

16 Custom show room dome and content for architectural visualization

17 Live-action integration into CG environments Breakdown movie >

18 Cross platform immersive science documentary Fulldome and VR, upto 8k 3D 60fps

19 What is Fulldome?

20

21 Many dome configurations: Uni-directional Omni-directional Tilted No-tilt Big Small Portable Brightness Resolution

22 Many projector configurations: 2 projectors 6 projectors 20 projectors 12 projectors Double stacked systems for brightness Single projectors, Fisheye, Mirror

23 Many projector technologies: DLP LCOS LCD LED Laser

24 The technolgy and configuration is mostly irrelevant to content producers Most planeterium domes are 360 x 180 Uni-directional seating Average tilt of 15 degress Average resoloution for 15m+ domes 2.5k- 4k No-one knows the exact numbers of digital domes Estimated to be over 1200 internationally 75% of these are smaller, under 2k resoloution and mostly portable.

25 Never assume any standard in the dome world! If making a piece for a specific dome get the specs first

26

27

28 Technical challenges 4096x4096 8x more pixels than HD content 40x more pixels than regular DVD The resolution of the domes is growing 8k, 16k...

29 4096 x 4096 Fulldome 4096 x 2304 RED ONE / 4K Digital Cinema 1920 x 1080 True HD / Blu-ray 720 x 480 NTSC DVD

30 4096 x 4096 Fulldome 4096 x 2304 RED ONE / 4K Digital Cinema 1920 x 1080 True HD / Blu-ray 1280 x 720 WEB HD 720 x 480 NTSC DVD

31 4096 x 4096 Fulldome 4096 x 2304 RED ONE / 4K Digital Cinema 1920 x 1080 True HD / Blu-ray 1280 x 720 WEB HD 720 x 480 NTSC DVD

32 4096 x 4096 Fulldome 4096 x 2304 RED ONE / 4K Digital Cinema 1920 x 1080 True HD / Blu-ray 1280 x 720 WEB HD 720 x 480 NTSC DVD

33 4096 x 4096 Fulldome 4096 x 2304 RED ONE / 4K Digital Cinema 1920 x 1080 True HD / Blu-ray 1280 x 720 WEB HD 720 x 480 NTSC DVD

34

35 The first rule of Fulldome is... there are (hardly any) Fulldome rules yet

36 Traditional techniques don t work as expected New film language required domography

37 Analyse, learn from others Lots of previews on FDDB.org

38 Camera Movements Start slow You are moving the audience Things appear faster on the dome than on screen Slow things down

39 Not all Fulldome display systems are created equal! Avoid black Avoid white Avoid blue Generally avoid solid colours Avoid subtlety! Avoid forcing people to dislocate their neck for long periods!

40 Editing Cutting is possible but has a different effect Keep the flow Dissolves can help, instead of 1 second try 3

41 Keeping focus vs exploring the frame

42 Characters Hard to get right Even harder in a dome

43 No-one can read on a rollercoaster

44 Balance between visual / music / narration

45 And don t forget... TEST TEST TEST!

46 Desktop Dome Visualisation Tools Dome View - Navegar Dome Port - SAT *AllSky Viewer (Japanese) *German one, can t remember name! Use your 3D Package (3dsmax etc) *free Mostly superseded by Oculus Rift now

47

48 VR Visualisation Tools Whirligig - Player and Publisher for Rift PlayblastVR - Quickly push content to players from Maya Lots of other tools now coming due to VR push There are differences so important to test in a dome also

49

50

51 Computer Generated 3D and 2D Real-time engines Live Capture Timelapse

52 Computer Generated 3D and 2D Software Tools 3D 3ds Max Maya Softimage Cinema 4D Lightwave Blender (Open Source) 2D After Effects Nuke Digital Fusion Premiere Pro Final Cut Pro Motion

53 Peripheral Packages Mudbox Zbrush Vue Terragen Realflow Motion Builder Photoshop

54 Render Engines Mental Ray V-Ray Final Render Arnold

55 Camera Rigs vs Lens Shaders Camera Rigs Can be cumbersome More software supported Lens Shaders Quick and easy Straight to the dome

56 Real-time engines Unity Unreal Engine Blender VJ tools - Touch Designer, vvvv Projection mapping tools - vdome, Blendy Dome

57 Don t forget the audio! 5.1 surround sound is almost a standard but each dome has unique characteristics making mixing challenging 3D spatial sound is one of the next big things in dome creatively but very few systems in the world at the moment Dolby ATMOS, Isono, Wavefield Synthesis, Object Based Audio

58 2D Dome Space Plugins Navegar - Fulldome SAT - Dome Cam 2.0 Andrew Hazelden Scripts E&S - Virtual Projectors Sky Skan - DomeFX

59 Fulldome Stereoscopic 3D Parallel Camera Technique Highly developed existing flat screen technique Use any render system Flipped when looking behind No S3D to the sides All depth budget inside the dome No negative stereo without post-convergence

60 Fulldome Stereoscopic 3D Stereoscopic Lens Shader Requires specific render engines and raytracing (Mental Ray, Vray) Full panoramic S3D everywhere you look Higher degree of control of stereoscopic effect Allow for head tilt and roll which is important in the dome enviroment DomeMaster3D -

61 BRAIN SHEAR The DISPARITY between what the brain SHOULD be seeing and what it s ACTUALLY seeing is what causes PAIN. Divergence - When your eyes move outwards Vertical Disparity - Things not matching up Accommodation - Fast changes in stereo depth

62 Photogrammetry Autodesk 123D Catch Microsoft Photosynth Xrez Green screen Regular flat capture integrated into CG fisheye footage

63 Live capture First decision is decide what size and resoloution dome your work will be screened on Single camera vs multi camera vs budget

64 Cameras iphone Compact with lens adapter - Canon G Series GoPro DSLR - Canon, Nikon 4k+ Digital Cinema Cameras - Red Epic, Canon C500

65 Lenses Circular Fisheye Truncated/Cropped Fisheye Wide angle

66 For cropped sensors (Canon 650D, 60D, 7D For full-frame sensors (Canon 5D, Nikon FX Format) Nikon DX format) Sigma 8mm Sigma 4.5mm Sunex 5.6mm Canon 8mm-15mm Pelang 8mm Nikon 8mm Nikon 6mm

67 Multi-camera rigs GoPro Freedom GoPro Hero Ladybug Totavision Immersive Media Dodeca SA360 Panoramic Camera

68 Stiching and Processing PTgui KRpano LRtimelapse Photomatrix

69 Timelapse Intervelometer Tripod Spherical/Gigapixel Capture Gigapan Nodal Ninja Freestlye and fix in post

70

71 Resources Freedom 360 Kolor Fulldome Festival Jena SAT ix Symposium Google groups - Dome-L, FAR: Fulldome Animators Resource Yahoo groups - Fulldome, small_planetariums Facebook Video Professionals, Fulldome

72 tw Specialists in CG large format immersive experiences Thanks Paul Mowbray Tweet nsccreative.com