ARCHITECTS OF VIRTUALIZED MEDIA PRODUCTION

Transcription

1 ARCHITECTS OF VIRTUALIZED MEDIA PRODUCTION

2 ST2110 the emerging standard and its practical application Andy Rayner, Chief Technologist

3 Are you in the right place?

4 Networking the moving picture II 2 nd November am-4pm London transport museum nevion.com/news/events/network-moving-picture-2/

5 VideoIPath Management & Orchestration Virtuoso Software-defined media node

6

7 The digital video journey SDI TR

8

9 In the beginning Betty Bolton

10 Composite video has value!

11 Composite Essence HANC VANC

12 Cost of Bandwidth & Latency 1400km = ~7ms

13 Composite transport WAN Different timing domains - adaptive Comprehensive Protection Mature 15+ years Essence transport CAMPUS Common timing domain SMPTE2059 Protection? In its infancy still maturing

14 Connectivity Security Content Security

15 SMPTE Packet pacing RTP clock

16 VSF TR-04 SMPTE

17 SMPTE2110 based on existing standards SYSTEM VIDEO AUDIO ANC DATA AES3- TIMING! bit

18 The audio guys got there first mostly! 6 7

19 SMPTE2110 SYSTEM VIDEO AUDIO 24 bit ANC DATA AES3- TIMING! bit

20 SYSTEM ST UDP octets with 8060 octets option Multicast with IGMP and Unicast IPv4 & IPv6 PTP to SMPTE ST with SMPTE ST Epoch RTP clocks & timestamps locked to media clock Zero offset on timestamp mandated One SDP object (IETF RFC 4566) per RTP Stream 90kHz RTP clock

21 VIDEO ST RTP based Subset of RFC4175 Watch out for line numbering! Sampling YCbCr-4:4:4, YCbCr-4:2:2, YCbCr-4:2:0, ICtCp-4:4:4, ICtCp-4:2:2, ICtCp-4:2:0 Bit depth 8, 10, 12, 16, 16f Colorimetry BT601, BT709, BT2020, BT2100, ST2065-1, ST2065-3, DCI-D65, DCI-D60 TCS (Transfer Characteristic System): SDR PQ HLG LINEAR DENSITY

22 AUDIO ST Based on AES67 24 bit linear PCM, 48kHz or 96 khz 1ms packet period with option of 125us Up to 8 audio channels per stream with option of up to 80

23 TIMING! ST When I need to send the IP packet data How I need to send IP packet data

24 ANC DATA ST Based on (IETF) RFC RTP Payload for SMPTE ST 291 Ancillary Data V=2 P X CC M PT sequence number timestamp synchronization source (SSRC) identifier Extended Sequence Number Length ANC_Count reserved C Line_Number Horizontal_Offset reserved DID SDID Data_Count User_Data_Words Checksum_Word word_align C Line_Number Horizontal_Offset reserved DID SDID Data_Count User_Data_Words Checksum_Word word_align

25 AES3-32 bit ST Full AES3 transport Based on AM824 Ravenna

26 ST ST Integration of legacy composite ST SMPTE2022-6

27 Other ST2110-?? Compressed video transport VC-2 J2K

28 Media payload RTP UDP IP VLAN MAC/PoS/GFP/MPLS IETF RFC

29 Media origination timing Media payload RTP UDP IP VLAN MAC/PoS/ GFP/MPLS 29

30 Media presentation timing Media payload RTP UDP IP VLAN MAC/PoS/ GFP/MPLS 30

31 Media Synchronisation history frequency & phase alignment GENLOCK Black burst/ tri-level sync FREQUENCY & PHASE ALIGNMENT SMPTE 2059 using PTP IEEE 1588 Sub us accuracy FREQUENCY & PHASE ALIGNMENT

32 SMPTE 2059 revision now in progress SMPTE 2059 using PTP IEEE

33 PTP scalability security PTP Master Transparent Switch PTP Master Transparent Switch Boundary Switch Boundary Switch Boundary Switch Transparent Switch Transparent Switch Transparent Switch Transparent Switch Device Device Device Device Device Device Device Device Device

34 NOTE: this timing approach is different to Transport Streams with PCR TS

35 Data transit time

36 System processing time

37 System processing time with multiple sources

38 Graceful performance with timing reference issues essential!

39 Scaling the number of media flows 1 x SMPTE x ST x ST x ST VIDEO = 20 flows! AUDIO ANC DATA

40

41 System timing- November 2, 1936

42 Linear stream flows our raster & hardware heritage Sample n Sample n+1 Sample n+2 Sample n+3 Sample n+4 Sample n+5 Sample n+6 Sample n+7 Sample n+8 Sample n+9 Sample n+10 Sample n+11 Sample n+12 Sample n+13 Sample n+14 Sample n+15 Packet x Packet x+1 Packet x

43 Pacing of arrivals is important

44 Linear video from SDI 44

45 Inherently less-linear flows. High bit rate video necessitates careful control & shaping. SMPTE > SMPTE 2110 already creates non linearity VBI ACTIVE FRAME HBI ACTIVE LINE LINEARISED FLOW LINEARISED FLOW 45 45

46 Packet egress from senders

47 Narrow & Wide senders N Narrow Typically hardware based Linked to linear raster-based video Small buffering requirement Capable of low latency chaining W Wide Typically software based using NIC Not linear raster related frame based Larger buffering required Only capable of frame-delay-based chaining 47 47

48 Why keep N? not 48 Nevion Confidential 30 October

49 Ideal & observed W & N sender behaviour W frame delivered in 95% of time Frame period N frame delivered in Active Picture time Frame period VBI 30 October 2017

50 Cumulative delay in system options N&W

51 The future is software based video sources Both native & virtualised 51 51

52 How many HD-SDI flows can you fit in 10GE? SMPTE /TR Gbps + RTP, UDP, IP, VLAN, MAC = ~ 1.65Gbps 10/1.65 = ~6? SMPTE2110 Essence based 1080i50 = Gb/s 10/1.04 = ~ 9? 52 52

53 Post-raster timing & non-linear sources 12 bit rate

54 Stream aggregation in switch fabric buffer buffer buffer 54 54

55 Data rates HD-SDI 1080i Gbps HD-SDI rate Gbps Gbps Video essence rate * β Video essence rate β is the multiplier used on the video essence rate to create a Committed Information Rate 55 55

56 IP packets per video line * HD-SDI 3 or 4 UHD 7 or 8 HS-SDI 3600 packets per video frame = 90,000 pkts/s * Ethernet frames size and line-continuation dependant 56 56

57 More queuing = more latency N-9 N-8 N-7 N-6 N-5 N-5 N-4 N-3 N-2 N-1 N 57 57

58 Packet formation time N-3 N-2 N-1 N N-3 N-2 N-1 N N-3 N-2 N-1 N N-3 N-2 N-1 N 58 58

59 Source bursting N-3 N-3 N-3 N-2 N-2 N-2 N-2 N-1 N-1 N-1 N-1 N N N N N N N N-9 N-8 N-7 N-6 N-5 N-5 N-4 N-3 N-2 N-1 N 59 59

60 Sender emission rate behaviour model SENDER Buffer model with max value Buffer drains at β * essence rate 60 60

61 Ideal sender

62 Gapped (narrow) sender Transmit at 3 Gbps during active line

63 Importance of beta Beta is required for long-term bitrate fluctuations (e.g. VBI) While beta cannot absorb short-term fluctuations, it allows for long-term bitrate excursions above the ideal rate. A gapped sender will start to overflow Cmax after ~60 video lines if beta is reduced to 1.0. This is due to the increased bitrate during the active frame.

64 Increasing sender burst size An example of bursty sender behaviour: accumulate 32 packets, then burst Once a burst from a sender exceeds Cmax, the Cfull buffer will drop packets. With a 10 Gbps line rate, a 24 packet buffer would be required to avoid loss following a 32 packet burst. For Cmax = 9 and beta = 1.1, we get 47% packet loss as Cfull cannot drain packets in time.

65 Packet pacing on sender egress NIC NICs with hardware flow control NICs with no hardware flow control NICs shared by VMs 65 65

66 Policing/shaping in switches SHOULDN T NEED TO DO THIS Switch policing has limited integration period flexibility Impossible to fully cross protect from rogue sender Harder at UHD rates 66 66

67 De-rating switch provisioning Necessary with W senders Switch-specific numbers Initial maths is pro-rata to the switch real buffering Restrict port loading in orchestrator to achieve required control 67 67

68 Orchestration layer needs to also plan for sub-optimal senders! VideoIPath orchestration Studio A IP Studio C Studio B Processing Farm 68

69 IP media edge PTP TIMING ALTERNATIVE TIMING DOMAINS DEVICE DISCOVERY & CTL RESTRICTED/PROXY DISCOVERY & CTL MEDIA FLOW IP ADDRESSING DIFFERENT IP ADDRESSING (NAT) ESSENCE FLOWS ESSENCE OR COMPOSITE FLOWS PROTECTION TERMINATION PROTECTION TERMINATION

70 Protection flow A n n+1 n+2 n+3 SOURCE Spatial DESTINATION (1,1) (2,1) (L,1) (1,2) (2,2) n+4 n+5 n+6 n+8 n+9 n+10 n+12 n+13 n+14 n+7 n+11 n+15 flow B (1,D) (L,D) n+16 n+17 n+18 n+20 n+21 n+22 n+19 n+23 flow A 1 2 L n+24 n+25 n+26 n+27 n+28 n+29 n+30 n+31 SOURCE delay Spatial + temporal DESTINATION FEC n+32 n+33 n+34 n+35 n+36 n+37 n+38 n+39 n+40 n+41 n+42 n+43 flow B

71 Leaf spine SPINE SPINE LEAF LEAF LEAF LEAF LEAF 71

72 Switch buffers handling flow non-linearity 1 video frame HD-SDI = 20ms (50P) = 3.7 MB = 2600 pkts HD 50P burst = 185KB = 130 pkts 4K100P burst = 30MB = 1040 pkts buffer buffer buffer aggregation 72 typically 10,000 packets buffering in total across switch ASIC?

73 Video packet sending profile 1080i Gbps 1.039Gbps Start of frame Start of frame Software sender phase aligned? 73

74 74 Explicit routing & control essential!

75 Full network simulation core & edges essential to prove scalability & performance Virtual Device n Virtual Device n+1 Virtual Device n+2 Virtual Device n+3 Virtual Device n+4 Virtual Device n+5 Virtual Device n+6 Virtual Device n+7 75

76 Switch fabric requirement Wire-speed Nonblocking Control Flow density PTP support Port density Buffer memory

77 Scalability - abstract user from the underlying technology Technology-agnostic user experience

78 Scalable orchestration VideoIPath

79 Orchestration hierarchy for very large scale VideoIPath VideoIPath VideoIPath

80 Scalability: Address Translation Media payload RTP UDP IP VLAN MAC/ MPLS/SR Media payload RTP

81 Control integration

82 NMOS is work in progress Media node registration, discovery and control Network topology discovery and control IS04/5/6

83 Registration, Discovery & Control

84 Scalability

85 Timing domains Master Clock Master Clock

86 Phase-Frequency offsets

87 VideoIPath management and orchestration Datacentre Datacentre Studio+Contr ol MCB, Live Points, etc. Studio Production #1 IP WAN studio Studio 3, Control 1&2, Studio A Contribution / Processing studio Studio B, Operations Test Lab MCR, Studio 1&2, Control 3&4, Post Studio Production #2 Studio Production #3 Ingest / Video Servers Playout / Distribution Contribution / Servers Studio Production #4

88 Complete end to end linear IP workflow Non real-time processing (with time stamping) UDP flows on interconnect?! 88 88

89 Think about the scalability of your network 89

90 Think about speed and capacity 90 Nevion Confidential

91 91 And how to manage traffic effectively!

92 Networking the moving picture II 2 nd November am-4pm London transport museum nevion.com/news/events/network-moving-picture-2/

93

94 Andy Rayner, Chief Technologist

95