IP Networking for Studio and Outside Broadcasting Production Applications

Transcription

1 IP Networking for Studio and Outside Broadcasting Production Applications Hugo Gaggioni CTO, V.P. Technology Professional Solutions of America 1 Vision: Creation of IP-based A/V Production Workflows Transition of production A/V Interfaces from SDI to IP Co-existence of Video, Audio and Control signals with File-based Systems Today s Live Production System IP Live Production System Network Manager SDI Router 1

2 Vision Enabling IP-based AV Production Workflow Regional Station Central Broadcast Station Contribution /Ingest Multi Media (IPTV etc.) Master Control /Distribution News Program Network Stadium/Arena IP-based AV Router News Production (Ingest + Edit + Playout) Studio A, B, C, Archive Sports Event HD/4K AV & IP Live - Future Direction - Fully integrated IP Live Production : Multi-resolution & expandability: Mixture up to 4K or more, Easy I/O expansion, High-reliability & SI efficiency: Full-redundant network & switch, Cable reduction, Total-cost reduction: COTS products, Remote production, RMS based maintenance, System Camera & Server Router & Switcher System Manager & RMS Studio Camera BPU+HDCU Partner s Multi-viewer F65+CA PWS-4400 New Panel F55+CA Partner s Graphics Production Switcher 2

3 HD/4K AV & IP Live Live Production Environment Fully integrated IP Live Production : Multi-resolution & expandability: Mixture up to 4K or more, Easy I/O expansion, High-reliability & SI efficiency: Full-redundant network & switch, Cable reduction, Total-cost reduction: COTS products, Remote production, RMS based maintenance, Fetures: Camera & Server Switching matrix IP router Switcher unit focuses on video processing All devices are New IP connected 4K Camera Unlimited I/Os; over 1,000s Unit size & cost reduction BPU+HDCU Scalable video process F65+CAby multi unitspws-4400 Super-Resolution technology for Up/down-conv. IP partner integration F55+CA Partner s Graphics Production Environment System Manager & RMS Common Matrix Partner s Multi-viewer New Panel Video Process Production Switcher Why Apply IP to Live Production Now? IP is NOT a new technology even in the AV industry: Monitoring / Controlling / File transfer (File-based System) Live Production may be the last challenge for IP because it requires: Real time operations with minimum latency Synchronous processing Video stream switching without picture disruption Technology improvements are now resolving these challenges: Rapid increase of available network bandwidth Introduction of sub-microsecond-accurate time distribution protocol IEEE1588 PTP (Precision Time Protocol) 3

4 Introduction to Network Synchronization Network synchronization is realized by the combination of: IEEE 1588 PTP for time synchronization SMPTE draft ST 2059 for AV signal synchronization PTP Grandmaster Tx Sync(t 1 ) Time t 1 Rx Time t 4 Delay_Req Delay_Res(t 4 ) PTP Slave Rx Time t 2 Tx Time t 3 t 1, t 2, t 3, t 4 Synchronization Control Video Signal 1. Define SMPTE Epoch :00:00 2. Define AV signal phase at the SMPTE Epoch 3. The AV signal phase can be determined at any time. A certain point in time Video Signal Time Any AV signals can be generated if the exact time is known. Network Synchronization 1 Synchronize time in the system by PTP 2 Generate an A/V signal from the time, and output as an A/V data. PTP Slave AV Data PTP Messages PTP Master LAN PTP Messages 3 AV Data Time Time Synchronization Time Re generate the A/V signal from the A/V data using the time. PTP Messages PTP Slave A/V Signal A/V Data A/V Signal PTP based genlocking is under SMPTE standardization process based on SMPTE ST2059 draft. 4

5 SDI-based Live Production System Sync Signal Generator TC Generator Three Planes Media Timing Control Camera Camera Timing SDI Router Production Switcher Media Monitor Camera When trying to replace with an IP-based, the question is how to apply these three planes to an IP-based Live Production system. System Managers Control Remote Controllers Monitor IP-based Live Production System PTP Grandmaster Three Planes Media Timing Control SDI - IP Converter (embedded or external) Camera Fabric Timing Production Switcher Camera Camera Fabric can be used as an AV Router in conjunction with an AV Router Controller and with the cooperation of each piece of production equipment. IP-based AV Router Media AV Router Controller Control Remote Controllers Monitor Monitor 5

6 IP-based AV Router Sample Implementation PTP Grandmaster Network Synchronization Network LSI IP-based AV Router AV Router (Controller) Network System Manager Technical Requirements Standardization Approach Input AV Signals SDI-IP Converter (AV Stream Sender) Fabric SDI-IP Converter (AV Stream Receiver) Output AV Signals Input AV Signals SDI-IP Converter (AV Stream Sender) AV Network Node SDI-IP Converter (AV Stream Receiver) Output AV Signals Input AV Signals SDI-IP Converter (AV Stream Sender) SDI-IP Converter (AV Stream Receiver) Clean Video Switching Output AV Signals Synchronous Zone Packet Zone Synchronous Zone Technical Requirements General Requirements The current operational practice should not be changed Use existing and emerging standards wherever possible in order to ensure interoperability. Use Standard IT-Technology, especially generic Ethernet Switches available in the market at reasonable price. can improve system performance as standard IT technologies improve. in order to maximize the benefits, use only functions that are supported by multiple vendors. 6

7 Technical Requirements Requirement for the Timing Plane Network synchronization able to achieve sub-microsecond accuracy Sub-microsecond accuracy is required over the IP network for some applications such as clean video switching. Technical Requirements Requirements for the Media Plane Frame-accurate clean video switching Video switching should be performed at the specified time point during the vertical blanking interval on the specified video frame. Essence-independent mapping in order to process essences at packet level e.g. video signal can be compressed in order to save network bandwidth. Mechanism to protect against transmission errors UDP/IP is commonly used, which does not ensure transport reliability. 7

8 IP Live Production Technologies IP-based AV routing IP Live System Manager Multi-format: SD, HD, 4K and 8K IP Multicast & QoS for AV, Metadata, Control and File transfers. They all must co-exist Genlock over IP -- Based on Precision Time Protocol SMPTE profile: ST2059 draft -- Clean video switching Baseband or Low-latency video codec HD-SDI mapping (ST2022-6) or Advance mode Visually lossless picture quality & Ultra low latency video codec Network Redundancy Hitless failover based on ST IP Live System Manager Manages AV devices, routing and network resources Most Difficult Challenge: 4K Live Production Cabling 8

9 Future Vision of 4K Live Production 3G SDI x 4 Tx (for 4K/422/10bit/60p x 1ch) 4K Parallel Data 3G SDI x 4 3G SDI 3G SDI Transmitte Transmitte 3G SDI Transmitte r r 3G SDI Transmitter r 3G SDI x 4 Rx (for 4K/422/10bit/60p x 1ch) Explosive Increase BNC Connecter x 4 3G SDI 4K Parallel Data 3G SDI x 4 Receiv 3G SDI 3G SDI Receiv 3G SDI of BNC er Equaliz 3G Cable SDI 3G SDI Receiv er 3G SDI Equaliz er Equaliz 3G SDI Receiver er er Equalizer BNC Connecter x 4 BNC Cable x4 BNC Cable x4 IP Network Solution (4K over single 10GbE cable) LSI SFP+ Network LSI (w/ Low Compression 4K Codec) 10GBASE-SR SFP+ Optical Module 4K Video Stream Optical Cable Production Truck SDI Based 4K System 4K Live Camera System x8 8 Camera Example 4K/60p (3G x4) SDI Router 4K/60p x30 4K Switcher F55+CA+BPU+HDCU... F55+CA+BPU+HDCU 4K Server x5 Mon/Ret (1.5G x2) 4K/60p x4 U/C & Mon (1.5G x6) 4K/60p x4 MVS-8000X 4K Monitor x4 PVM-X300 Cable Number SDI Based BNC: 362 pcs XAVC Server Mon x4 Mon x42 HD Monitoring Multiview Proc Cable Weight 268 kg. (590 lb.) (5C2V: 74g/m) 9

10 Production Truck IP Live Based 4K System 4K Live Camera System x8 8 Camera Example 4K/60p (10GbE x1) IP based AV Router 4K/60p x30 (10GbE x30) 4K Switcher F55+CA+BPU+HDCU... Mon/Ret (GbE x1) Network Manager Software U/C & Mon (GbE x2) MVS-8000X F55+CA+BPU+HDCU 4K/60p x4 (10GbE x4) 4K Monitor x4 PVM-X300 Cable Number Cable Weight SDI Based BNC: 362 pcs 268 kg. (590 lb.) (5C2V: 74g/m) IP Live Based LAN: 88 pcs 40 kg. / 11kg. (89 lb. / 24 lb.) (Copper: 45g/m, Fiber: 13g/m) 4K Server x5 XAVC Server 4K/60p x4 (10GbE x4) Mon x4 (GbE x1) Mon x42 (GbE x11) SDI/IP Conv HD Monitoring Multiview Proc Total cable weight reduced by 85% * *Example only. Actual weight reduction will vary by situation. Configurable SDI ports: - 4 x HD-SDI - 2 x 3G-SDI - 2 x 4K Network LSI 30 Network Layer Structure Application Protection (FEC / Hitless) Codec SDI Port SDI Port SDI Port SDI Port SDI-IP Mapping A/V Process Network LSI Clean Switching IP Process Network Engines Codec FEC MAC Network Synchronization PCI Express (Ver.2 (5G) x4) Legacy Synchronization Signal 1G 1G 1G 1G 10G 10G L4 L3 L2 L1 Clean Switching Network Synchronization SDI-IP Mapping RTP UDP/TCP IP 1G/10G MAC 1G/10G PHY Covered by Network LSI 10

11 Video Format Support Ultra Low-Latency codec to keep high efficiency in network 4K Base Band 4K RAW Chipset Encode 10GbE Network Chipset Decode 4K Base Band 4K RAW HD x4 Chipset Encode 1GbE Network Chipset Decode HD x4 Video Format Number of Channels 1920x1080/422/50i,60i 4ch/1GbE 1920x1080/422/50p,60p 3860x2160/422/24p,30p 4096x2160/422/24p,30p IP Live Interface Box 3860x2160/422/50p,60p 4096x2160/422/50p,60p 4K RAW 2ch/1GbE 1ch/1GbE x3 2ch/10GbE IP Live Interface Module 2ch/10GbE 2ch/10GbE Three main services: Network System Manager AV Stream Management Question is how to identify 'AV network streams'? Manage the cross point matrix and Control AV stream routing Network Resource Management Maintain network topology and Manage network resources Device Management Manage AV network streams and Device capability A network by nature carries a multiplicity of AV network streams. 11

12 Resource Reservation Control High Priority AV Session 1 (Reserved) Middle Priority AV Session 2 (Reserved) File File Transfer Best Effort Link Bandwidth Reliable Streaming by Bandwidth Reservation and Priority Setting AV Network Node AV Network Node is a new concept to identify an AV network stream at each node. AV Network Node 10G Port A A1 Stream A1 Fabric Stream D1 D1 10G Port D 10G Port B B1 Stream B1 Stream E1 E1 10G Port E 10G Port C C1 Stream C1 Stream F1 Stream F2 Stream F3 F1 F2 F3 10G Port F 12

13 Cross Point Matrix Cross Point Matrix can be defined based on the AV Network Node. Source AV Network Node A1 B1 C1 F3 Destination AV Network Node D1 E1 F1 F2 Cross Point Matrix Cross Point Matrix can be defined based on the AV Network Node. Source AV Network Node A1 B1 C1 F3 Destination AV Network Node D1 E1 F1 F2 13

14 Cross Point Matrix Control of the IP-based AV Router can be realized without changing Cross Point Matrix can be defined based on the AV Network Node. the current operational practice using AV Network Node. Source AV Network Node A1 B1 C1 F3 Destination AV Network Node D1 E1 F1 F2 Problems in Clean Video Switching using general IP method Using Multicast IGMP (Internet Group Management Protocol) is accepted method to start/stop stream packets However as Ethernet Switches do not know the video frame boundary, streams may start or stop in the middle of video frame -- It leads to a picture disruption Also Ethernet Switches do not know the exact video frame to be switched -- One video frame consists of a few thousand packets depending on the video format Header Payload Header Payload Header Payload Header Payload Padding IGMP leave/join Stream packet may start or stop in the middle of video frame as Ethernet Switches do not know the video frame boundary. It leads to picture disruption 14

15 Clean Video Switching Four steps are used in order to realize the 'clean video switching': 1. Frame Information Insertion 2. Rough Video Switching 3. Clean Video Switching 4. Synchronization between input signals and output signals 1. Frame Information Insertion Stream sender extracts frame information from input AV signal and puts it into a network header. i.e. All AV stream packets contain frame information. Stream sender put frame information into a network header. All input AV signals are synchronized. 1 2 Input AV Signal A Stream Sender A (Network LSI) Input AV Signal B Stream Sender B (Network LSI) Synchronous Zone Packet Zone 15

16 2. Rough Video Switching IP multicast IGMP (Internet Group Management Protocol) is used: In order to realize rough video switching, stream receiver joins a new multicast group and leaves its current multicast group Leave Fabric Stream Receiver (Network LSI) Join Overlap Period Overlapped stream 3. Clean Video Switching Switching Point Unnecessary Packets Unnecessary Packets Stream receiver discards the unnecessary packets on the fly using the frame information Packet Zone Stream Receiver (Network LSI) Clean Switched AV Signal 2 3 Synchronous Zone 16

17 4. Synchronization between Input and Output Fabric Stream Sender A (Network LSI) Stream Sender B (Network LSI) Stream Receiver (Network LSI) The output AV Signals are synchronized with the input AV signals delayed by exactly one frame All latencies including - network link - video encoding/decoding - buffering are absorbed in this one frame Input AV Signals Output AV Signal As a result, any video format, SDI, HD-SDI, 3G-SDI, 4K, uncompressed or compressed, can be handled in the same manner. Clean Video Switching Summary 2. Network System Manager Fabric can issues be switching used requests. as an AV Router in conjunction with an AV Router Controller Network and with System Manager the cooperation of each piece of production equipment. 1. Stream sender puts video frame information into a network header 3. Stream receiver issues IGMP messages. Input AV Signal A Input AV Signal B Stream Sender A (Network LSI) Stream Sender B (Network LSI) Fabric Overlap Period Stream Receiver (Network LSI) Clean Switched AV Signal 4. Ethernet Switch joins/leaves the correspondent streams. 5. Stream receiver discards unnecessary packets. 17

18 Consideration of Clean Video Switching This solution requires double network bandwidth during the overlap period. A big advantage of this solution is that any generic Ethernet Switch can be used. This is an issue of cost of es Input AV Signal A Input AV Signal B All necessary functions and performances are already satisfied. This is most cost effective way to realize the clean video switching for now. Another approach which does not require double bandwidth will be adopted in the future when it will be realized using generic Ethernet Switches. Stream Sender A (Network LSI) Full bandwidth can be used. Stream Sender B (Network LSI) Fabric Overlap Period Stream Receiver (Network LSI) Clean Switched AV Signal Only half bandwidth can be used. General IP technique Failover e.g. LAG (link aggregation) Network Redundancy Main Backup Network failure Picture distortion When switching active network, data is interrupted temporarily. Sony A/V/D over IP interface A/V Stream Transmitter LSI Packet Duplication Main Backup Network failure Packet loss Receiver LSI Packet Selection A/V Stream Hitless failover Even if one stream packet is missed, the other packet outputs seamlessly. 18

19 In principle, the following SMPTE (draft) standards are used: For the media plane ST : ST : Standardization Approach SDI - IP mapping Hitless Switchover For the timing plane ST (draft) : ST (draft) : SMPTE Epoch, AV signal alignment SMPTE PTP Profile In addition, several extensions are proposed in order to fully satisfy all the requirements of IP Live Production. SMPTE ST and Proposal SMPTE ST maps the whole SDI payload information including video, audio and metadata as a package. It cannot deal with video, audio, metadata independently at packet level. Our proposal (Essence-Independent Mapping): A mapping in which video, audio, and metadata are placed in separate packets so that they can be dealt with independently. Frame Boundary SMPTE ST Header Payload Header Payload Header Payload Header Payload Padding Essence-Independent mapping Header Video Payload Header Audio Payload Header Metadata Payload Header Video Payload Padding 19

20 SMPTE ST and Proposal SMPTE ST is not aware of video frame boundaries and a single FEC block may contain information related to two frames Our proposal (Frame-Boundary-Aware FEC) : A FEC block is terminated when a frame boundary is detected. SMPTE ST FEC Block (2 x 2) FEC Block (2 x 2) Frame-Boundary- Aware FEC Frame Boundary Network Synchronization ( Genlocking ) Implementation of sufficient synchronization accuracy ( genlocking ) using general Ethernet switches One of the major reasons to adopt IP technology is the "use of standard IT technologies", in other words, the use of COTS. However, when seeking to realize high accuracy synchronization under high network load, the use of specialized time-aware network devices such as Transparent Clock Switches is commonly considered to be necessary. Adoption of SMPTE PTP (ST2059-2) rather than AVB gptp (IEEE802.1AS). SMPTE PTP allows either ordinary clocks (general Ethernet switches) or time-aware clock such as Transparent clock switches. While gptp allows only time-aware devices (End stations or Bridges). 20

21 Issues of AVB Technologies AVB mainly consists of the following two technologies: Network Synchronization (gptp): IEEE802.1AS Stream Reservation (inc. shaping): IEEE802.1Q, IEEE1722, IEEE1733 gptp requires specified time-aware switches (AVB Bridges). Although stream reservation function is extended to cover an IP (IEEE1733), gptp is still a L2 technology. Only time-aware devices are allowed in the AVB domain. AVB Bridges are based on L2. PTP endpoint is either PTP master or PTP slave. Either general switches or time-aware switches can be used. Also either L2 switches or L3 switches can be used. AVB Bridge AVB Bridge Ethernet Switch Ethernet Switch AVB Endpoint AVB Endpoint AVB Endpoint PTP Endpoint PTP endpoint PTP Endpoint AVB Domain SMPTE PTP Domain Architecture Proposal SOA approach is also applicable to IP Live Production system. Application Service Device AV Stream Router Network Resource Management Remote Controller Multi Viewer Business Level Interfaces PTP Grandmaster Device Management AV Stream Management Device Level Interfaces Fabric Standardizing Industry Common Business Level Interfaces is essential. Control Plane Media Plane Timing Plane 21

22 IP Live Production System Overview Remote Maintenance Service 4K/HD Cameras Partner s Multi-viewers Network I/F LSI Network I/F LSI Built-in Remote Cameras IP based AV Router System Manager Software GUI Production Switcher Network I/F LSI Built-in Anycast Workstation Control Panel XAVC Server Partner s Video Server FPGA IP PCIe Board Partner's Graphics SDI-IP Converter for Deck, etc. Network Media Interface key components IP LIVE SYSTEM MANAGER Setup, Matrix Config. & Cross-point Switching, System Maintenance, SDK for Alliance Partners, Integration with Evertz and other router manufacturers SIGNAL PROCESSING UNIT Rack mountable frame for Networked Media Interface Converter boards, 18 slots, Redundant PSU, 3RU SDI-IP CONVERTER BOARDS Convert SDI from/to Networked Media Interface, Frame Sync, AES/EBU Audio supported 22

23 Network Media Interface Supporters ODA Systems 23

24 Optical Disc Archive Technology Overview Based on Blu-ray with key attributes from Sony s XDCAM 50 Year archival life Large volume media Growing Line-up of Sony and 3rd Party Solutions! Optical Disc Drive and Cartridge Each cartridge mounted as single large volume 12 bare discs in a media cartridge Several cartridge types offered Capacity range 300GB 1.5TB* Write Once/Re-Writeable media Ultra high durability 50 year rated media life Open File System (UDF) Future drive generation backward (read) compatibility 24

25 Optical Disc Archive Technology Ideal for Data Permanence Audio, video and graphics preservationfile agnostic Removable data exchange and transport Simplified management-single large volume with directory Media managemet applications for drives and robotic libraries Cartridge Line-up and Capacity R=Write-once RE=Re-writable 25

26 Optical Disc Archive Ultimate File Protection File Agnostic Optical Disc Cartridge R&D Roadmap as bare disc format 300GB x12 3.6TB 26

27 ODA technology continues to evolve 2016 NAB Optical Archival Systems X-Disc Archive System ODS-D77U/F ODS-L30M Scalable PetaSite Library ODS-D77U/F ODS-D55U USB 3.0 Drive ODS-L10 Compact Library Combined Archive Management System ODS-L30 Library Bundled External Drive and Content Manager App 10 slot library NAS Appliance Solution File Manager/API Interface V1.60 Supports ODA drive (ODS-D55U) ODS-D55U Ready! XDA v1.7/ support for ODS-L10/30 coming Nov 2013! 30 slot library, 5U ODS-D77U Drive NAS Appliance Solution File Manager/API Interface Scalable PetaSite library ODS-D77F Library Drive MBB Production Archive Dalet MAM, FPD Archive and other 3rd party software support 27

28 How to Interface ODA With IP Live (NetMedia) PWS-4400: 4K XAVC Server 4K x 4 ports (Configurable I/O) 4K/HD simultaneous recording HD 360p HFR recording 4K to HD cutout and D/C HD output Internal memory storage 2TB as standard 5H@4K/60p 600Mbps 24H@HD/60i 100Mbps Expandable to 8TB (Option) Video & Audio format 4K XAVC-I 60p) HD XAVC-I 60i) Audio : L-PCM 24bit 16CH Network Interface 1GbE as standard & 10GbE as an option Production Control Software Workstation MSQ-S321 HD SDI 4K/HFR Workstation Media Gateway Software ODA USB Control Device USB 1GbE Multi Port AV Storage Unit 4K/HFR 10GbE HDD 28

29 PWS-4400: 4K XAVC Server Tape Digitization Server Enables video tape encoding, QC and preservation of digitized content PWS-100TD1 Easy to use Web browser interface Multiple VTR control and direct recording to Optical Disc Archive media 29

30 Main Features PWS-100TD1 Channel condition monitor Selectable SD/HD SDI ports-control up to 4 VTR s Embedded Auto and Manual QC Front Rear Main Features PWS-100TD1 Multi Codec support High resolution preview PWS-100TD1 Front/Rear Details File transfers across network Stream to multiple Optical Disc Archive drives simultaneously 30

31 Main Features PWS-100TD1 API for external system control Control VTRs via RS422 Configure IN/OUT ports: 1IN/1OUT, 2IN/2OUT, 3IN/1OUT, 4IN Error condition check RS422 SD/HD-SDI XML Export DB and proxy to external MAM Quick & simple Auto QC Digitize Server Proxy Multi codec support MAM Archive System Manual QC Monitor Write verification Optical Disc Archive drives Replacement of SDI-based live production system with IP-based can be realized without changing the current operational practices with: Generic Ethernet Switches Existing and emerging standards Conclusion There are several standardization proposals to fully satisfy all the requirements such as: Essence-Independent mapping Frame-Boundary-Aware FEC Industry Common Business Level interfaces There are still some issues to be improved: One of the biggest advantages of adopting IT technology is that system performance can be improved as IT technologies improve. 31

32 Thank You! 32