The double hybrid planetarium: VIOSO & existing systems

Transcription

1 The duble hybrid planetarium: VIOSO & existing systems Scenaris fr prductive integratin f VIOSO fulldme systems in existing planetariums 1. Applicatin scenaris fr a VIOSO system 1.1. Backup system fr an existing pwer dme vide system: The mst imprtant and mst frequently used prgrams in planetariums can be saved n the VIOSO system as 4K vides. In the event f a technical failure f the primary system, the VIOSO system server plays these vides in the same r even better quality. The system uses the WingsVIOSO sftware and makes this pssible thrugh its cmprehensive features, which range frm the supprt f very mdern vide cdecs t the ability t play uncmpressed cntent. The cntent used by pwer dme can be used withut any changes Music visualizatin fr (live) cncerts: Visual backing f live music with immersive generative real-time graphics is ne f the features that make this planetarium unique. Many planetariums are technlgically limited t nly astrnmical cntent. The VIOSO system serves as a platfrm fr numerus applicatins that make it pssible t custmize music and cncerts withut any limitatins r need fr cmplex preparatins. Such applicatins can be realized transparently using secndary playback devices, such as laptps, and ther devices that are ften brught by the artists. Devices in which a pwerful live vide capturing applicatin is integrated in the VIOSO system. The WingsVIOSO sftware allws fr mixing f such playback cntent with pre-prduced clips and sequences in real-time withut any limitatins Develpment f cntent using cmmn real-time engines such as Unity and CryEngine: Interactive real-time engines are increasingly being used t replace cnventinal 3D media prductin methds in many 3D visualizatin applicatins. One majr functin f the VIOSO system is making different real-time engines usable with the planetarium dme either thrugh direct rendering by the VIOSO system r real-time vide capturing using separate playback systems The VIOSO system as an interface between VR applicatins and fulldme: The VR cntent develpment field is still in its initial stages, and the crrespnding market still trying t differentiate between the varius methds and technlgies. Lng-term develpments are therefre difficult t fresee at the mment. A VIOSO system can serve the planetarium as a flexible platfrm fr seizing technlgical develpments in the VR field. One exemplary scenari wuld be a live cnnectin between a VR headset and the fulldme system, e.g., fr live gaming events r special fulldme live presentatins VIOSO system as an pen and rbust develpment platfrm: Many everyday applicatins, such as Ggle Maps and Ggle Earth, will mst likely be enhanced t include at least a VR cmpnent if nt cmpletely transfrmed thrugh immersive technlgy. 1

2 The VIOSO system can be used as a platfrm ver which such cntent is cnveyed t the dme nce apprpriate tls have been develped. In a brader sense, the VIOSO system can als serve as a rbust platfrm n which experimental sftware prjects, such as thrugh targeted cllabratin with universities, can be cnducted withut psing any risks t the regular peratins f the planetarium Live transmissin f immersive cntent: With the current develpments in drne technlgy and livestreaming f high-reslutin vide cntent, spectacular dme casts are well cnceivable. A VIOSO system can hereby als prvide a basis fr prjects and enable such develpments in the future Interactivity: A VIOSO system lays the grundwrk fr enhanced live interactins in the planetarium dme. This enables use f a cmbinatin f different theater technlgies, such as Max/MSP and high-sensitivity cntrllers, fr interactive manipulatin f dme cntent t significantly enhance the features f the planetarium and transfrm it int a digital theater fr lectures and artistic prjects. 2

3 2. Offered slutin T achieve the desired applicatin scenaris, we ffer a standard prduct, the VIOSO DOMEMASTER, with the fllwing additinal ptins: Prjectr calibratin with a fisheye camera that is temprarily installed at the dme center r fur fixed cameras that are fixed n the dme s hrizn Dual display prt capturing r DVI-D capturing GPU upgrade M5000 r M6000 SSD upgrade: RAID10 fr OS and data partitining The DOMEMASTER cncept is a wrkstatin platfrm develped by VIOSO and ptimized fr fast prcessing f graphic cntent. VIOSO ffers autmatic, camera-based prjectr calibratins fr dmes and ther display types n this platfrm Dme calibratin Mbile calibratin kit: Prjectin images are calibrated using a camera that is temprarily placed at the center f the dme. Here, the prerequisite is that the psitin nt be altered by an ptmechanical prjectr. It must therefre be checked t see the extent t which placement f a fisheye camera next t r abve such a prjectr allws fr a sufficiently gd calibratin. Advantage f the ne camera slutin: It is significantly cheaper than a multi-camera calibratin kit Fixed calibratin kit cnsisting f fur IP cameras: Prjectr images are calibrated using fur IP cameras that are permanently fixed n the lwer dme hrizn. Depending n the dme design, these cameras can be registered autmatically (=initially set up fr use in calibratin f prjectr images), which requires a netime temprary placement f a fisheye camera. Advantage f the multi-camera slutin: Recalibratins f the prjectrs can be dne with a single press f a buttn r even autmatically (e.g., based n a scheduler). It is nt pssible t use a fisheye camera fr the initial setup, which makes the setup significantly mre cmplicated WingsVIOSO sftware Every DOMEMASTER server cmes with the WingsVIOSO sftware. This is a cmprehensive slutin fr playback f highreslutin vides, arranging and cntrlling f cntent in tracks (e.g., separatin f audi and vide cntent, superimpsing f vide cntent with images such as lgs, etc.), as well as cntrl f external devices Supprted vide cdecs WingsVIOSO supprts numerus vide frmats. It uses the MainCncept prfessinal cdec suite that is used in many cmplex applicatins as the industry standard. The supprted cdecs include: - MPEG2 - H.264/AVC - H.265/HEVC in prcess The supprt f MPEG2 means that dwnward cmpatibility is guaranteed fr existing cntent in this frmat. The H.264, which is currently ne f the mst widely used vide encding standards (e.g., in the MP4 cntainer), is significantly mre efficient in terms f cding quality, supprted reslutin, and adaptability. Thus, we recmmend it fr playback f cntent in the dme. VIOSO has develped a very genetic cncept fr simplified cding f dme cntent. Once cded, cntent can be used n any dme regardless f the number and psitin f the prjectrs. There is basically n limitatin t the supprted reslutin. Hwever, the perfrmance limit f a single Dmemaster server is reached when playing back 4096 x 4096 pixels f cmpressed vide cntent Special mdules fr dme prjectrs: VIOSO has develped a series f additinal mdules with which WingsVIOSO can be even mre prductive fr dme prjectin: a) Mapping f standard frmats in the dme: Standard cntent, such as 16:9 vides and images as well as live cntent frm external surces, can be placed n the dme surface interactively and aligned gemetrically. Fr instance, yu can add a live PwerPint presentatin at several pints in the 3

4 dme, embedded in an agreeably animated backgrund. 2.3 Live input via display prt r DVI-D / DVI A DOMEMASTER server can be equipped with the fllwing live inputs: b) Mapping f equirectangular cntent in the dme [under develpment]: Cntent that is designed fr 360 x 360 displays i.e. fr standard VR glasses can be played back directly in the dme. Fr this t be pssible, a crrespnding cnversin is perfrmed in real-time. Since the view field f the dme is smaller than that f the available cntent, the current view can be influenced interactively thrugh varius cntrl ptins (keybard, muse, keypad, etc.) Dual display prt capturing Such a server can receive tw vide signals via Displayprt 1.2. A bandwidth f 616 megapixels per secnd is available fr each signal channel. This makes it pssible t prcess up t 4096 x 2160 pixels at an update rate f 60 Hz. If yu use bth channels, yu can prcess signals with a ttal reslutin f up t 4096 x 4096 pixels at an update rate f 60 Hz. The signal being played must cnfrm t Displayprt 1.2. Cnversin frm DVI, HDMI, etc. des nt wrk. Thus, capturing in this case is limited t a specific type f playback device. This type f capturing is therefre suitable fr playback f dme cntent frm an external system (e.g., star simulatin, data visualizatin, etc.). Playback n the dme can either be 1:1 (ptimizatin fr lwest latency) r via WingsVIOSO and a mixed cmpsitin cnsisting f images r vides DVI-D capturing This methd prcesses numerus signal types such as DVI-I, DVI-D, r HDMI. This type f capturing is therefre ideal fr prcessing f laptps, tablets, cnsles, and the like. Signals recrded this way can either we displayed n the dme 1:1 (e.g., if the cntent already cnfrms t the Dmemaster) r using WingsVIOSO in any frmat and cmbined with ther cntent. Nte: Simultaneus use f the capturing slutin may be restricted depending n the cnfiguratin f the DOMEMASTER server. 4

5 2.3. "Anyblend sftware: Platfrm fr any third-party applicatins One imprtant feature f a Dmemaster server is its suitability fr GPU based warping and blending. Every Dmemaster server cmes with the VIOSO Anyblend sftware Creatin f cntent in the dme This principle can be intriguing fr the cntent prductin prcess since the utput windw f design and mdeling applicatins can be displayed directly and in native dme reslutin: - Cinema4D, Maya, etc. - Blender - Adbe AfterEffects, Premiere, etc. VIOSO Anyblend can be used t embed individual prjectr adjustments (cntent assignment, gemetrical alignment, sft edge) in the perating system tgether with the graphics card structure used with the Dmemaster. Fr the user, prjectrs then appear as ne lgical display, i.e. as a separate Windws desktp with a 1:1 rati. The dme is therefre nthing else than an extended, square desktp n which any Windws applicatin can be run. Sling, warping, and sft edge blending runs in the backgrund, n the fly and withut any latency. This allws fr the display f any Windws applicatins directly in the dme in real-time. This is particularly useful fr all applicatins that ffer utput in the Dmemaster frmat: Playback f media and interactin This principle simplifies the prductin implementatin fr playback f media cntent and interactive applicatins every prgram that can prduce utput n such an extended desktp is suitable fr playback in the dme: - Alternative vide player, e.g., fr testing cdecs, displaying DRM-prtected cntent, etc. - Interactive audi-visual cmpsitins, e.g., with MaxMSP, Matrix Optimizer, BlendyVJ, etc. - All types f data visualizatins - All types f self-develped applicatins Astrnmical applicatins Any applicatins designed fr single fisheye planetariums r mirrr-based planetarium prjectins can be used: - Micrsft Wrldwide Telescpe - Stellarium - Mitaka 4D2U - Nightshade, etc Playback f VR cntent and streaming Besides WingsVIOSO, any ther vide player can be used fr playback f typical VR cntent (360 vides) directly in the dme. - VR players that enable mapping t spherical r fisheye frmat such as Klr Eyes, VR Player, etc. - Cntent that is streamed t the server via the netwrk/internet. This includes recrdings f VR camera rigs (Fraunhfer Omnicam, etc.) as well as individual cameras with fisheye lenses Use f Unity3D, CryEngine, etc. The ppular framewrk fr the develpment f graphically appealing interactive applicatins, Unity3D, des nt allw fr utput generatin f mre than ne screen. Currently, it nly supprts ne render utput. Althugh there are additinal tls that make this pssible, their licenses are ften sld at relatively high csts (e.g., MetaVR: license csts in five-digit range in eurs fr distributed rendering). With the Dmemaster principle, a single render utput is enugh t fill the dme cmpletely. This means that applicatins develped with Unity3D are directly playable in the dme. The same applies t ther engines that are als designed fr single-screen systems such as CryEngine, Havk Engine, etc. 5