UHD Herausforderungen an die Bildaufnahmetechnik und Lösungsmöglichkeiten FKTG Regionalgruppe Thüringen / November 2016

Transcription

1 UHD Herausforderungen an die Bildaufnahmetechnik und Lösungsmöglichkeiten FKTG Regionalgruppe Thüringen / November 2016 Klaus Weber Senior Product Marketing Manager, Cameras

2 Agenda UHD and the challenges to image capture Higher pixel count, extended color gamut, HFR, and more CMOS based imaging solutions Why CMOS imaging is the best solution HDR in Live production applications Why its required, what it offers and how to realize Direct IP and IP connectivity Supporting new workflows and delivering future proof solutions Questions and answers

3 UHD options And we want to have it ALL! More Pixel 4K resolution Better Pixel High Dynamic Range More Pictures High Frame Rate Better Colors Extended Color Gamut

4 More Pixel The more the pixel the lower the sensitivity Higher pixel count (on a given imager size) means smaller pixels Pixel size in 2/3 (diagonal 11mm) Pixel count 2K 4K 8K Pixel dimensions 5.0µm 2.5µm 1.25µm Pixel area 25.0µm² 6.25µm² 1.56µm² Smaller pixels means lower sensitivity (and dynamic range)

5 More Pictures The more the pictures the shorter the exposure High frame rate might be required for sport productions Motion blur limit the resolution on a moving object Motion blur is format independent Keeping the same ratio between static resolution and dynamic resolution higher resolution formats require a higher frame rate Higher frame rate = shorter exposure Shorter exposure = lower sensitivity

6 Better Colors How wide a gamut needs to be Pointer s gamut Represents all real colors that can be (diffused) reflected from a surface BT.2020 almost envelopes Pointer s gamut BT.709 covers 69.4% Pointer s gamut

7 Why CMOS imaging is the best solution With CMOS imagers many of the current and future requirement can be realized better Progressive operation Larger pixel count High speed operation High dynamic range Higher sensitivity Better S/N performance Higher integration Lower power consumption All new cameras are based on CMOS imaging technology!

8 Rolling shutter Challenges to CMOS Imagers Image integration Only Global Shutter offer undisturbed results in all conditions Global shutter

9 More Information is available on our Website LDX Series Cameras with Xensium-FT Imagers: A Superior Replacement for CCD Technology White Paper While CCD technology was the best choice for imagers in broadcast applications for many years, the latest generation of CMOS imagers now offers a range of advantages over CCD. This includes better sensitivity in progressive video modes today, and the potential for higher resolution, extended dynamic range and higher frame rates in the future. CMOS is setting the new standard for high-end broadcast applications. Posted Oct (GVB A-EN-WP) File Size: 1.1 MB Read more»

10 Challenge: How can I get the best results possible from all the different shooting positions? Close up shots Wide angel shots

11 Strength comparison - Processed 4K versus Native 4K Use the technology which fit best to the specific requirements For wide angle shooting positions typically resolution is most important To see all the small details in the image For telephoto shots over large distance typically sensitivity is of highest importance Being able to reach a large depth of field

12 Processed 4K UHD imaging with Highest Sensitivity Xensium FT Imagers with large 5µm x 5µm pixel for highest sensitivity and dynamic range in all formats FT CMOS imagers with 5T pixels for global shutter operation avoiding rolling shutter artifacts High sensitivity allows operating the lens in the best possible range and getting a large depth of field under all conditions

13 Processed 4K UHD imaging with Highest Sensitivity 4K images derived from 3x full HD imagers 2K RGB in 4:4:4 4K RGB in 4:4:4 4K Y/Cr/Cb in 4:2:2 Upconversion from 2K to 4K by bicubic interpolation algorithm and basic contouring for improved sharpness Conversion from RGB into Y/Cr/Cb final signal processing onto the 4K signal including final 4K contouring

14 Native 4K UHD imaging with highest possible resolution Xensium HAWK Imagers with native UHD pixel (3840 x 2160) with 2.5µm x 2.5µm for highest possible resolution Highest resolution in all UHD formats for all the demanding wide angle shots with many small details DPM Ultra allow to combine inside the imager four UHD pixels into full performance 3G/HD pixels

15 Xensium HAWK imagers with DPM Ultra Native 4K or native HD just as required For switchability a pixel with 4 photo sites is sharing one readout amplifier For 4K the photo sites can be read out individually PD0-PD3 one by one through TG0-TG3 For HD all four photo sites will be read out at the same time TG0-TG3 all activated together Signal storage in C fd enables global shutter operation in HD

16 Xensium HAWK imagers with DPM Ultra Comparing Native HD with Down-converted HD Native HD capturing HD down-converted from 4K Modulation depth Good Better Sensitivity Better Reasonable S/N-ratio Better Reasonable Dynamic range Better Good Global / rolling shutter Yes / Yes No / Yes High speed capability Native capturing Zoom-in or missing pixels (not used at Xensium HAWK imagers)

17 There are multiple challenges in UHD acquisition Some limitations can t be solved in near future CMOS imagers are the only future proof solution There is a wide range of imaging applications They all have their specific set of requirements Mixed operation might be the best option

18 Many broadcasters believe a 4x higher pixel count won t deliver the wow factor needed from a new broadcast format HDR opens up the potential for more engaging, more beautiful content, as well as future proofing

19 Why HDR - For artistic reasons High scene contrasts are often requested by the production

20 Why HDR Because of challenging lighting conditions High scene contrasts are most challenging in live broadcast applications Lighting conditions are typically are not under control Pictures must be perfect at any time and can t be fixed in post

21 Challenge: How can I do live HDR productions in HD, 3G or 4K with a dynamic range fulfilling all requirements today and tomorrow?

22 Imaging with highest possible dynamic range The latest generation of 2/3 CMOS imagers offer the required dynamic range of >15 F-stops Adopted signal processing for native HDR operation Modified OETF New controls for modifying the OOTF More flexible gain and contouring control

23 Camera to display transfer functions OOTF Distribution OETF EOTF OETF => Opto-Electronic transfer function EOTF => electronic-optical transfer function OOTF => Opto-Optical transfer function => Camera transfer function => Display transfer function => Artistic intent

24 HDR solutions BBC/NHK Hybrid log-gamma In the upper half the signal is mapped in a logarithmic curve The lower half of the HLG signal is close to a regular gamma curve To a SDR monitor the HLG signal look like a regular signal where the knee point is set to a very low level Source: BBC

25 HDR solutions SMPTE 2084 (Dolby PQ) The Dolby PQ uses the bit range in its most optimum way Depending on the brightness, the human eye has a different resolution for the differences in brightness PQ uses the bit range available to avoid any visibility of step edges, contouring or banding Source: Dolby

26 Comparison of different OETF and EOTF

27 New contrast curve controls are added The controls Gamma Low, and Gamma High are available for both SMPTE 2084 and HLG Gamma High control Gamma low control

28 From all the different UHD topics HDR has the best cost / performance ratio HDR in live production need 10 bit end-to-end Different OETF / EOTF will be used Conversions between them need to be avoided Native generation inside the camera is preferred Additional control of the OETF will be needed To adopt the look of the images

29 Direct IP and IP connectivity Supporting new workflows and delivering future proof solutions

30 Explanation IP streams - XCU HD/4K XF IP 10 GigE XF transmission - Communication between camera and XCU - Supports Direct IP Licence - Uses Layer 2 Discovery - Unicast support only 10 GigE IP output - Communication between XCU and cloud - Routable (Layer 3 ; not released yet) - SMPTE support - Multicast / Unicast support

31 Why the XCU is still needed the XCU generate all the base band signals the XCU does all the conversions / processing of UHD / HD the XCU is required for simultaneous SDR / HDR operation the XCU provide the AnyLightXtreme flicker reduction

32 Traditional point-to-point camera transmission Each camera has its own cable to a dedicated base station

33 Traditional camera configuration Each camera direct connected to XCU Per production 1x Control room needed Per production separate crew needed Un-economical use of camera equipment No central storage (Video content) High investments (Long ROI) Production site 1 Production site 2 Production site n

34 At typical OB-van productions much (expensive) equipment is on the road for most of the time. and a lot of operational people need to travel too.

35 XF Transmission with Direct IP Fiber A Fiber B SMPTE Hybrid Fiber cable incl. 2x single mode fiber Audio ( ) embedded I-com (Prod. + Eng) embedded I-com (Prog. + Prod. + Eng) embedded Main Video Fiber A Main ; 1 Channel SMPTE i50/59 = 1,8Gb 1080p50/59 = 3,4Gb Fiber B Return Gb IP Analog Audio Stereo 24bits Digital Audio Stereo 24bits Return ; 1 Channel SMPTE i50/59 = 1,8Gb 1080i50/59 = 1,8Gb I-com Prog. Audio 16bits 10Gb IP I-com Prod. Audio 16bits I-com Eng. Audio 16bits C2IP Private Data IP Trunk 10/100/1G C2IP + Private Data + I-com + Analog Audio + Digital Audio = ~ 8Mb IP Trunk = 0Mb (when not connected) I-com Prod. Audio 16bits I-com Eng. Audio 16bits C2IP Private Data IP Trunk 10/100/1G

36 XF Transmission with Direct IP

37 Use Case - Cloud production at NEP-Netherlands NEP owns the fiber network Redundancy in the network (Spine-Leaf) Network also used for Audio VSM Control for secure switching between studio s Separate VLAN for all cameras Operational since Nov. 2015

38 IP connectivity delivering future proof solutions Allowing a smooth change from baseband to IP Migrate with your own pace Direct IP bring remote productions to the next level Optimize usage of the hardware resources Creating maximum production flexibility Help reducing operational cost

39 Thank you!