Misc , 1394 and AVB info for tutorial, discussion, brainstorming, etc. for AVBTP working group.

Transcription

1 Misc , 1394 and AVB info for tutorial, discussion, brainstorming, etc. for AVBTP working group. Editor s working slides version.3 March 8, 27 Editor: Alan K. Bartky, Bartky Networks, Alan@Bartky.net Web: Send comments to: AVBTP@listserv.ieee.org AVB transport SG Draft for Orlando FL USA March meeting 1

2 IEEE 1394 and IEC formats and info Alan K. Bartky Bartky Networks AVB transport SG Draft for Orlando FL USA March meeting 2

3 IEEE 1394 Cycle start Broadcast Destination ID (xffff) Source ID (Cycle Master) Transaction label () rt () tcode (8) pri (xf) Destination Offset (48 bit standard address of CYCLE_TIME register) Cycle time data Seconds (-127) 8 khz Cycle # (-7999) SPH Cycle Offset (-371) Header CRC (validates Header OK) Bus time in seconds, 8 khz cycle and MHz Cycle offset Cycle start packet is sent out by 1394 Cycle Master device every 8 khz delayed by a maximum of one Asynchronous packet. All Isochronous Packets immediately follow the cycle start packet for a given 8 khz cycle. AVB transport SG 3

4 Header always 2 quadlets, length field indicates data length in bytes IEEE 1394 Isochronous Packet Tag = 1 binary for CIP header present 1394 Isochronous channel ID DTCP sy field values: Field Value Comments Encryption Mode Indicator EMI (bits 3,2) b 1b 1b 11b Data Length 1 Channel (-63) isoch sy Header CRC (validates Header OK) Data Field (1 or more 32 bit Quadlets, zero padded at end as necessary) Data CRC (Validates Data Field OK) Tcode = 11 binary for Isochronous Copy Freely, No Authentication Required, Data not encrypted sy field Used by DTCP No More copies, Full or Restricted Authentication Required, Encrypted Data Copy One Generation, Full or Restricted Authentication Required, Encrypted Data Copy Never, Full Authentication Required, Encrypted Data Odd/Even (bit 1) b Use Even key to Decrypt Data 1b Use Odd key AVBto Decrypt transport Data SG 4 Reserved March, (bit ) Reserved, set to on transmit, ignore on receive

5 1394 CIP Isochronous Headers Tag = 1 binary for CIP header present Tcode = 11 binary for Isochronous Sy field Used by DTCP Isoch PKT hdr Header CRC CIP #1 Data Length 1 Channel (-63) isoch sy Header CRC SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC CIP #2 1 FMT FDF SYT cyc # SYT Cycle Offset (-371) () Format field indicates type of Isoch Packet Format Dependent Field varies by packet type Source Packet Header field set to 1 if Source Packet header present Isoch PKT hdr Header CRC CIP #1 CIP #2 Source PKT hdr 1 Data Length 1 Channel (-63) isoch sy SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC FMT Header CRC reserved SPH 8 khz Cycle # (-7999) SPH Cycle Offset (-371) AVB transport SG 5 FDF (1)

6 CIP Headers CIP #1 CIP #2 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) () CIP #1 CIP #2 Source PKT hdr 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC FMT FDF reserved SPH 8 khz Cycle # (-7999) SPH Cycle Offset (-371) (1) CIP#1 Quadlet always has the same format, remaining quadlets vary based on if SPH bit is or 1 Source ID: Senders ID: -63 Data Block Size (DBS): size in Quadlets of individual Data blocks within the packet (max 256) Fraction Number (FN): number of data blocks into which a source packet is divided: 1, 2, 4 or 8 ( 11 binary) Quadlet Padding Count (QPC): Indicates number of padding bytes in last quadlet of packet (if any, through 7) Reserved (r): Reserved Editor s note: Perhaps we can use this field to define a new time base of 82.1AS nanosecond time. Data Block Count (DBC): Sequence number modulo 256 of 1st Data block in this packet AVB transport SG 6

7 61883 variants and key fields Protocol Title DBS (Quadlets) FN Fractions/ source packet QPC SPH DBC Increment FMT FDF Source packet size bytes SD-DVCR 12, 1, 2, 4 x sect MPEG2-TS 6 8 1, 1, 2, 4, 8, 16, 24, etc. x4 sect Varies by formats, channels, number of sample periods, etc. Varies x1 clause 1 DBS * 4 Audio and Music Data ITU-R BO.1294 System B BT.61 Varies by video format, 1, 2, 4, 8, 12, etc. x41 14 varies by number of data blocks x1 Figure 6 DBS * 4 AVB transport SG 7

8 IEC formats and info Alan K. Bartky Bartky Networks AVB transport SG Draft for Orlando FL USA March meeting 8

9 Isochronous Header Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) () Field Value Comments FMT x1 (1b) Format: Audio/Music format FN Fragment Number: Always match of 1 to 1 between CIP packet and Source Packet (i.e. never fragmented) QPC Quadlet Padding Count : No dummy padding quadlets needed (or supported) SPH Source Packet Header: None DBC -255 Data Block Counter: Indicates modulo 256 sample count number of 1 st data quadlet of the packet. Used for detecting lost data, amount thereof. SYT xxxxxxxxxxxxxxx Synchronization Time: Time when the data block specified by DBC_NUMBER Modulo SYT_INTERVAL is presented at the receiver FDF -255 Format Dependent Field: See FDF data SYT Data: Delivery time of the first audio or Data bit to the application (codec, decoder, transmitter, etc.) Set by source of audio data Processed by sink of audio data Presentation Time Range 2 milliseconds 4 bit 8kHz Cycle 12 bit MHz Cycle offset Set to All ones (xffff) for entire 16 bit field as No info value AVB transport SG 9

10 Isochronous Audio Data Header Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT EVT N SFC SYT cyc # SYT Cycle Offset (-371) () When FDF = x-x3f, FDF field broken up into: EVT N SFC Editor s note, SFC also used in One bit audio which is x5- AVB transport SG 1

11 Isochronous Header (N=) Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC FMT EVT N SFC SYT cyc # SYT Cycle Offset (-371) () Value (binary) EVT (Event type) code definition Description AM824 data 1 24 bit * 4 Audio Pack 1 32 bit Floating Point data 11 Reserved for 32 bit or 64 bit data Editor s Note: 22 version indicated not indicated which appears removed in 25 version. Appears 25 version added concepts of sampling frequency, original sampling frequency, nominal sampling frequency up and down sampling ratios etc. Needs further investigation on which/what options we ll have to support and how. Default SFC (Nominal Sampling Frequency Code) definition Value (binary) N = Nominal Sampling frequency 32kHz kHz kHz (or not indicated??) khz khz (or not indicated??) khz khz 32 SYT INTERVAL AVB transport Reserved SG

12 Isochronous Header (N=1) Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC FMT EVT N SFC SYT cyc # SYT Cycle Offset (-371) () Editor s Note, need to know if we need to support this mode in Ethernet AVBTP and if so, how we will support setting, handling, etc. of N, how it would affect physical and virtual interfaces, etc. Default SFC (Nominal Sampling Frequency Code) definition Value (binary) Nominal Sampling frequency N = 1 SYT INTERVAL Sampling Frequency 32 khz 8 * n 32 khz * n khz 8 * n 44.1 khz * n 1 48 khz 8 * n 48 khz * n khz 16 * n 88.2 khz * n 1 96 khz 16 * n 96 khz * n khz 32 * n khz * n khz 32 * n 192 khz * n AVB transport SG Reserved

13 NO-DATA packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC r DBC FMT SYT cyc # SYT Cycle Offset (-371) () FDF field all ones indicates a NO-DATA packet. Used by transmitter only for blocking transmission method Mandatory for receiver to ignore all data in a CIP packet when received AVB transport SG 13

14 24 bit audio Pack 4 Etc. Sample A 24 bits Sample B 8 bits Sample B 16 bits Sample C 16 bits 8 Sample C 8 bits Sample D 24 bits DBS field for 24 bit x 4 Audio Pack Value Description (Decimal) Cluster Dimension = DBS / 3 Indicated by EVT field = 1 binary 4 24 bit samples packed together into 3 quadlets AVB transport SG 14

15 IEC 6958 format (S/PDIF & AES3) Sample Word SB SF P C U V 24 bit sample data SB S F Description Second sub-frame of IEC 6958 frames to First sub-frame of IEC 6958 frames 1 to 191 Equivalent IEC 6958 preamble codes W,Y M,X 1 Reserved N/A 1 1 First sub-frame of IEC 6958 frame B,Z Uses AM824 Data format (indicated in EVT code of binary in CIP header) 6958 frame data in first 8 bits 24 bit sample data is in remaining 24 bits Definitions SB: Start of Block SF: Start of Frame P: Parity C: Control word bit (bits combined to make 24 control words in 192 word frame) U: User Bit V: Validity Bit AVB transport SG 15

16 IEC 6958 stream example (stereo) FRM, 1 st subframe 1 1 P C U V 24 bit sample data Left FRM, 2 nd subframe FRM1, 1 st subframe FRM1, 2 nd subframe FRM2, 1 st subframe FRM2, 2 nd subframe FRM191, 1 st subframe FRM191, 2 nd subframe FRM, 1 st subframe FRM, 2 nd subframe P C U V 1 P C U V P C U V 1 P C U V P C U V 1 P C U V P C U V 1 1 P C U V P C U V (etc.) 24 bit sample data Right 24 bit sample data Left 24 bit sample data Right 24 bit sample data Left 24 bit sample data Right SB SF Description Text Equivalent TBDIEC 6958 preamble codes Second sub-frame of IEC 6958 frames to 191 W,Y 1 First sub-frame of IEC 6958 frames 1 to 191 M,X 1 Reserved N/A 1 1 First sub-frame of IEC 6958 frame B,Z 24 bit sample data Left 24 bit sample data Right 24 bit sample data Left 24 bit sample data Right AVB transport SG 16

17 Type Value (Hex) x-x3f x4-x4f x5-x57 x58-x5f -6-x67 x68-x7f x8-x83 x84-x87 x88-x8b x8c-x8f x9-xbf xc-xcf xd-xef xf-xff AM824 Format AM824 Type Description IEC 6958 format Multi-bit Linear audio Up to 24 bit Data AM824 Type One Bit Audio (plain) One Bit audio (encoded) High Precision Multi-Bit Linear Audio Reserved MIDI conformant Reserved SMPTE time code conformant Sample Count Reserved Ancillary data (common) Ancillary data (application specific) Reserved AM824 Sub-Type Up to 16 bit Data Editor s Notes: Need to investigate which of the data formats we support for egress to physical and virtual interfaces. AVB transport SG 17

18 Multi-Bit Linear Audio (MBLA) format 1 AS1 AS2 Up to 24 bit data AS1 (Binary) b Description Raw Audio format. The sample word can be fed direct to a D/A converter. Ancillary data may accompany elsewhere in the packet. The definition of ASI2 is identical to VBL (valid bit length) defined in IEC : b Application-specific information. The sample word may be fed direct to a D/A converter but, in some processing, required according to the application identified by applicationspecific ancillary data which shall appear in the same data block. AS2 (Valid Bit Length) (Binary) b 1b 1b 11b Description 24 bit, unknown or variable 2 bit 16 bit reserved AVB transport SG 18

19 AM824 Raw audio data format examples Valid Bit Length (VBL) Bits 25, bit, variable or unknown sample bit sample bit sample AS1 Bits 27, 26 equal for Raw audio MSB always bit23 LSBs Zero Padded as needed AVB transport SG 19

20 32 bit floating point data format 32 bit floating point sample word MSB Indicated in EVT code of 1 binary in CIP header 32 bit format takes up the entire quadlet with one sample per quadlet. AVB transport SG 2

21 32 bit generic data format 32 bit generic sample word MSB Indicated in EVT code of 11 binary in CIP header 32 bit format takes up the entire quadlet with one sample per quadlet. AVB transport SG 21

22 Example Empty Packet CIP #1 CIP #2 1 SPH Source ID (-63) DBS = 2 FN QPC Rsv FMT EVT N SFC SYT cyc # SYT Cycle Offset (-371) () DBC = 2 Example from Non-Blocking Data Flow diagram. DBS = size of data blocks in quadlets == 2 in this example DBC indicates 1 st data block (sample group) == 2 in this example SYT set to no info as there are no Data Blocks to have a timestamp corresponded to in this packet. Value set to all ones Editor s note: Need to look into more about empty packet versus NO-DATA packet, how they are sent, how DBC is manipulated, etc. AVB transport SG 22

23 Examples, packed format, 24 bit 24 bits source I 2 S stereo No padding 16 bits source I 2 S stereo Zero padding 24 bits source I 8 S TDM No padding Left Time X, full 24 bits Right Time X, 16 bits Right Time X, 8 bits Left, Time X + sample time, 16 bits Left, X + sample time Right, Time X + sample time 24 bits Left Time X 16 bits Right Time X, 8 bits Right Time X, 8 bits Left, Time X + sample time 16 bits Right, Time X + sample time 16 bits CH Time X, full 24 bits CH1 Time X, 8 bits CH1 - Time X, 16 bits CH2, Time X 16 bits CH2, time X, 8 bits CH3, Time X, 24 bits CH4 Time X, full 24 bits CH5 Time X, 8 bits CH5 - Time X, 16 bits CH6, Time X 16 bits CH6, time X, 8 bits CH7, Time X, 24 bits 1 st bit, sample time X, R to L Word Select transition AVB transport SG 23 1 st bit, sample time X, L to R Word Select transition

24 Examples, 32 bit format 32 bits source I 2 S stereo No padding Left - Time X, 32 bits Right -Time X, 32 bits Left, Time X + sample time 32 bits Right, Time X + sample time 32 bits 24 bits source I 4 S TDM No padding CH Time X, 32 bits CH1 - Time X, 32 bits CH2 - Time X, 32 bits CH3 Time X, 32 bits CH - Time X + sample time, 32 bits CH1 - Time X + sample time, 32 bits 1 st bit, sample time X, R to L Word Select transition 1 st bit, sample time X, L to R Word Select transition 1 st bit, sample time X++, R to L Word Select transition AVB transport SG 24

25 Examples, unpacked format, 24 bit 24 bits source I 2 S stereo No padding 2 bits source I 2 S stereo Zero Padding 24 bits source I 4 S TDM No padding 1 Left Sample Time X, 24 bits 1 1 Right - Sample Time X, 24 bits Left- Sample Time X++, 24 bits 1 1 Left Time X, 2 bits Right - Time X, 2 bits Left - Sample Time X++, 2 bits CH Sample Time X, full 24 bits CH1 Sample Time X, full 24 bits CH2 Sample Time X, full 24 bits CH3 Sample Time X, full 24 bits CH Sample Time X++, full 24 bits CH1 Sample Time X++, full 24 bits 1 st bit, sample time X, R to L Word Select transition AVB transport SG 25 1 st bit, sample time X, L to R Word Select transition

26 Examples, I 2 S fill values 24 bits or not 2 bits or not 16 bits or unknown Length source I 2 S stereo 2 bits source I 2 S stereo Zero Padding 16 bits source I 2 S stereo Zero Padding 1 Left Sample Time X, 24 bits 1 1 Right - Sample Time X, 24 bits Left- Sample Time X++, 24 bits 1 1 Left Time X, 2 bits Right - Time X, 2 bits Left - Sample Time X++, 2 bits 1 1 Left Time X, 16 bits Right - Time X, 16 bits Left - Sample Time X++, 16 bits AVB transport SG 26

27 Creation of a packet CIP #1 CIP #2 1 st Data Quadlet 2 nd Data Quadlet 1 Source ID (-63) DBS (size in quadlets) SPH FN QPC r FMT EVT N SFC SYT cyc # SYT Cycle Offset (-371) 32 bit data word 32 bit data word () DBC etc. Key: Calculated Set based on CIP data format and sample frequency Set based on stream ID and characteristics Fixed for all packets AVB transport SG 27

28 Creation of an Empty CIP packet CIP #1 CIP #2 1 Source ID (-63) DBS (size in quadlets) SPH FN QPC r FMT EVT N SFC SYT cyc # SYT Cycle Offset (-371) () DBC Key: Calculated Set based on CIP data format and sample frequency Set based on stream ID and characteristics Fixed for all packets An Empty CIP packet is: Data Block Size: Same as other packets in the stream Data Block Count (DBC): Sequence number, HW keeps local counter and increments per specification and stores into header. SYT field: All ones for Cycle and Cycle offset field. Length: 8 bytes, CIP header only, no payload. Editor s note: Need more detail and study here, there is also an invalid data AM824 type. AVB transport SG 28

29 End to End Network Flow Alan K. Bartky Bartky Networks Examples type flows of receiving a source stream, transmitting it via packets through the network to where it is reconstituted and sent out at the destination. AVB transport SG Draft for Orlando FL USA March meeting 29

30 Non-Blocking Transmission Time measured every SYT_INTERVAL Sample Group DBC=3 SYT for Sample Group 4 DBC=6 SYT for Sample Group 8 DBC=1 SYT for Sample Group 12 DBC=13 SYT for Sample Group 12 DBC=17 SYT = No Info DBC=2 SYT for Sample Group 2 RX Input Stream & Encypt 8kHz Packetize & TX 8kHz Isochronous TX Cycle etc Network transmit, mux/de-mux, store and forward delay RX and queue Scheduled Unpacketize, Decrypt & TX Transfer_Delay SYT_INTERVAL = 4 Receiver & Transmitter AVB transport SG 3

31 Example Data Packet CIP #1 CIP #2 Data Block 1 Data Block 11 Data Block 12 1 SPH Source ID (-63) DBS = 2 FN QPC Rsv FMT 1 VBL 1 VBL 1 VBL 1 VBL 1 VBL EVT N SFC Left Channel 24 bit sample word Right Channel 24 bit sample word () SYT cyc # SYT Cycle Offset (-371) Left Channel 24 bit sample word Right Channel 24 bit sample word Left Channel 24 bit sample word DBC = 1 1 VBL Right Channel 24 bit sample word Example from Non-Blocking Data Flow diagram. Data Length (from 1394 header, not shown above) == 64 bytes (8 quadlets, includes size of CIP header) DBS = Data Block Size of data quadlets == 2 in this example DBC indicates 1st data block (sample group) sequence number == 1 in this example SYT field used to timestamp the presentation time of the Data Block where Data Block number modulo SYT_INTERVAL ==, so in this example: SYT_INTERVAL = 4 Data Block 12 modulo 4 == SYT field used for Data Block 12 AVB transport SG 31

32 Non-Blocking Transmission, Packet loss Time measured every SYT_INTERVAL Sample Group DBC=3 SYT for Sample Group 4 DBC=6 SYT for Sample Group 8 DBC=1 SYT for Sample Group 12 DBC=13 SYT for Sample Group 12 DBC=17 SYT = No Info DBC=2 SYT for Sample Group 2 8kHz Isochronous TX Cycle RX Input Stream & Encrypt* 8kHz Packetize & TX RX and queue etc Lost Packet Network transmit, mux/de-mux, store and forward delay Editor s note: Need to update based on interaction between length, DBC and DBS Scheduled Unpacketize, Decrypt* & TX Transfer_Delay Note*: Encrypt/Decrypt optional SYT_INTERVAL Last Valid Block = 4 number is 12. Expecting Receiver 13 next & Transmitter Current RX Block number is 17 Blocks 13 through 16 lost, to keep uncompressed sample stream contiguous and in proper time, dummy samples must be AVB transport SG output 32

33 Blocking Transmission RX Input Stream, Encrypt* & Packetize Time measured every SYT_INTERVAL Sample Group 8kHz TX RX and queue 8kHz Isochronous TX Cycle DBC=12 SYT for Sample Group DBC=16 SYT for Sample Group DBC=2 SYT for Sample Group etc. No Data Pkt Network transmit, mux/de-mux, store and forward delay No Data Pkt DBC=24 SYT = No info Data field empty DBC=24 SYT for Sample Group 24 Editor s note: Need to update based on interaction between length, DBC and DBS Scheduled Unpacketize, Decrypt* & TX Note*: Encrypt/Decrypt optional Transfer_Delay SYT_INTERVAL = 4 Receiver & Transmitter AVB transport SG 33

34 formats and info Alan K. Bartky Bartky Networks Draft for discussion in general adapting to AVBTP AVB transport SG Draft for Orlando FL USA March meeting 34

35 MPEG-2 system timing model Video In Video Encoder Buffer Buffer Video Decoder Video Out System Coder and Multiplex Storage or Transmission System Decoder and Demultiplex Audio In Audio Encoder Buffer Constant Delay Buffer Audio Decoder Audio Out Variable Delay Variable Delay Key feature of EAV is to ensure predictable delivery of frames for streams. Key feature for is to ensure Constant constant end to end delivery time MPEG AVB Delay transport SGpackets for all devices on the network for 35 a given stream.

36 MPEG-2 Source stream to TS flow Video Source Audio Source MPEG-2 Elementary Encoder Uncompressed stream MPEG-2 Elementary Encoder Packetizer MPEG encoded stream Packetizer Packetized Elementary Stream (PES) Systems layer Mux Transport Stream (TS) Data Source Packetizer AVB transport SG 36

37 Transport Stream Fragmentation PES packet Header Packet Elementary Stream packet payload Fixed size packets 188 bytes Transport Packet Header Payload Fragment Adaptation Field (padding done here) AVB transport SG 37

38 Transport Packet Structure 188 bytes 4 bytes Header Adaptation field (may not be present) Payload (may not be present) 8: sync_byte(sync the decoder x47 8: Length hex start of TP) 1: discontinuity_indicator 1: transport_error_indicator 1: random_access_indicator 1: payload_unit_start_indicator (PSI or 1: ES_priority_indicator PES packet) 5: various flags (PCR_flag...) 1: transport priority (useful in scalable Optional fields MPEG2) Stuffing bytes 13: PID(ID for each stream) 2: transport_scrambling control 2: adaptation_field _control 4: continuity_counter(counts packets of PES) AVB transport SG 38

39 Base mechanism MPEG-2 Transport stream delivers 188 byte packets to the transmit function adds a four byte Transport Stream Header to create a 192 byte Source Packet The source packet header optionally contains the desired presentation time (MPEG packet local arrival time plus additional time added to specify presentation time on the remote device). Time is in Cycle number ( khz ticks) plus Cycle offset ( MHz ticks) Giving a max resolution of 1 second then divides up the 192 byte source packet into 8 fixed size Data Blocks (6 quadlets each) and if necessary fragments the packet into multiple CIP packets. Depending on rate of transport stream, zero, one or more CIP packets are sent out at 8 khz intervals. Valid values of Data blocks per Isochronous packet are: (empty packet), 1, 2, 4, 8, N times 8 (where N is an integer number of source packets) Data Block count increments for every 6 quadlet Data block as defined above AVB transport SG 39

40 1 data block per Isoch packet 188 byte MPEG-TS Packet 188 Byte MPEG-2 Transport Packet 192 byte Source Packet SP HDR x 32 byte 1 Data Block CIP Packets CIP SPH=1 SP HDR -19 CIP SPH= 2-43 CIP SPH= CIP SPH= CIP SPH= CIP SPH= CIP SPH= CIP SPH= 8 x 44 byte IEEE-1394 Isoch Packets ISOCH HDR CIP SPH=1 SP HDR -19 CRC ISOCH HDR CIP SPH= 2-43 CRC AVB transport SG CRC ISOCH HDR CIP SPH= CRC ISOCH HDR CIP SPH= CRC ISOCH HDR CIP SPH= etc.

41 2 Data blocks per Isoch packet 188 byte MPEG-TS Packet 188 Byte MPEG-2 Transport Packet 192 byte 8 Data Blocks Source Packet SP HDR x 56 byte 2 Data Blocks CIP Packets CIP SPH=1 SP HDR CIP SPH= CIP SPH= CIP SPH= x 68 byte IEEE-1394 Isoch Packets ISOCH HDR CIP SPH=1 SP HDR CRC ISOCH HDR CIP SPH= etc. AVB transport SG 41 CRC ISOCH HDR CIP SPH= CRC

42 4 Data Blocks per Isoch packet 188 byte MPEG-TS Packet 188 Byte MPEG-2 Transport Packet 192 byte 8 Data Blocks Source Packet SP HDR x 14 byte 4 Data Blocks CIP Packets CIP SPH=1 SP HDR CIP SPH= x 116 byte IEEE-1394 Isoch Packets ISOCH HDR CIP SPH=1 SP HDR AVB transport SG 42 CRC ISOCH HDR CIP SPH= CRC

43 8 Data Blocks per Isoch packet 188 byte MPEG-TS Packet 192 byte 8 Data Blocks Source Packet SP HDR x 2 byte 8 Data Blocks CIP Packet CIP SPH=1 SP HDR x 212 byte IEEE-1394 Isoch Packet ISOCH HDR CIP SPH=1 SP HDR Byte MPEG-2 Transport Packet CRC AVB transport SG 43

44 2 MPEG packets per Isoch packet 2 x 188 byte MPEG-TS Packets 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet 2 x 192 byte 8 Data Block Source Packets SP HDR SP HDR x Data Blocks CIP Packet CIP SPH=1 SP HDR SP HDR x 44 byte IEEE-1394 Isoch Packet ISOCH HDR CIP SPH=1 SP HDR SP HDR AVB transport SG 44 CRC

45 Issues with current MPEG packets at lower stream rates require more processing due to having to spread out the bandwidth across multiple In today s world probably better to optimize on NTSC and above streams for EAV and if necessary penalize slower streams from a relative point of view. Alternate proposal for 1394 and EAV to simplify to remove MPEG packet fragmentation. Still allows 1394 devices to evolve and for EAV to not pick up the current overhead/burden of MPEG packet fragmentation. Lower bandwidth streams can use class 4 EAV service and empty packets as necessary. Higher bandwidth streams can use class 5 service Both can use one or more MPEG packets per Ethernet frame and if nothing to send, send an empty packet instead. Diagrams on following slides AVB transport SG 45

46 EAV 1 CIP per MPEG example 1 x 2 byte + EAV overhead Ethernet Frame 188 byte MPEG TS Packet 192 byte Source Packet SP HDR 1 x 2 byte CIP Data Block CIP SPH=1 SP HDR Ethernet + AVBTP HDR CIP SPH=1 SP HDR 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet AVB transport SG CRC 46

47 2 MPEG by 1 EAV frame example 2 x 188 byte MPEG TS Packet 2 x 192 byte Source Packet SP HDR 2 x 2 byte CIP Data Packets CIP SPH=1 SP HDR 1 x 4 byte + EAV overhead Ethernet Frame AVBTP HDR CIP SPH=1 SP HDR 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet SP HDR SP HDR 188 Byte MPEG-2 Transport Packet SP HDR 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet 188 Byte MPEG-2 Transport Packet CRC AVB transport SG 47

48 Study of and processing requirements Alan K. Bartky Bartky Networks AVB transport SG Draft for Orlando FL USA March meeting 48

49 Ingress Frame Handling Frames to be parsed/detected for layer 2 processing by AVBTP end stations are: Ethernet AV stream 82.1AS Timing Control protocol 82.1Qat Stream Reservation Protocol AVB transport SG 49

50 Ingress processing Functions: Validate CIP header format. Discard if unknown or unsupported. Editor s Note 1394 says in certain cases, you have to send an error indication, I do not believe we should do this in AVBTP. Track data block count in relation to SYT_Interval. Detect lost frames/packets based on unexpected value in DBC field Extract Timestamp information from SYT field when valid, map to local time and use to process egress stream for case of real physical device. Discard/Ignore any unknown/unsupported payload formats Strip unused fields/data (e.g. AM824 8 bit header) For Encrypted data, feed into Decryption function. Also based on device type, do we have to discard data if copy protected. AVB transport SG 5

51 Ingress processing Functions: Recognize/parse Source Packet Header (SPH) for timestamp information. Editor s note: also has reassembly function for low speed streams, I d like to see if we could drop support for that function in AVBTP. Detect lost frames/packets based on unexpected value in DBC field Extract Timestamp information from SYT field when valid, map to local time and map to proper sample within the packet. For Encrypted data, feed into Decryption function. Also based on device type, do we have to discard data if copy protected. AVB transport SG 51

52 Ingress Decryption processing If DTCP supported and configured for a given stream: Take samples and optionally decrypt them prior to sending to egress physical or virtual device. Mandatory support of AES-128 TBD if M6 cipher also required. AVB transport SG 52

53 Egress Encryption processing If DTCP supported and configured for a given stream: Take data from ingress physical device and optionally encrypt them prior to being packetized. Mandatory support of AES-128 TBD if M6 cipher also required. AVB transport SG 53

54 Encapsulation Functions: Collect individual samples into packet/buffer/descriptor Optionally append correct AM824 type header Get timestamp information for the data block from the physical or virtual device to create presentation time based on the inbound sample data in relation to SYT_Interval. Build header, insert timestamp in proper format. Build Ethernet and AVBTP header based on stream ID and characteristics. Forward to Ethernet queuing function based on class 5 or class 4 service. AVB transport SG 54

55 Encapsulation Functions: Create initial CIP and Source Packet header based on timestamp of arrival of first byte from TSI interface of the 188 byte MPEG packet. Collect individual bytes into packet/buffer/descriptor Editor s Note: For AVBTP, I d like to have it so we don t have to fragment Source packets into as 2, 4 or 8 fragments as is currently required by over 1394 for lower rate MPEG-2 streams (and have us use empty packets as necessary to keep the bridges happy). Build Ethernet and AVBTP header based on stream ID and characteristics. Forward to Ethernet queuing function based on class 5 or class 4 service. AVB transport SG 55

56 Basics of I 2 S and variations on it Draft Alan K. Bartky Bartky Networks Alan@Bartky.net AVB transport SG Draft for Orlando FL USA March meeting 56

57 I 2 S connection options SCK SCK Transmitter WS SD Receiver Transmitter WS SD Receiver TRANSMITTER = MASTER RECEIVER = MASTER Controller Transmitter SCK WS SD Receiver CONTROLLER AVB transport = MASTER SG 57

58 I 2 S Timing diagram Clock rate varies by sample frequency times word length times number of channels (e.g. 44.1kHz*16*2 = MHz ) clock SCK word select WS data SD LSB MSB LSB MSB LSB MSB Word n-1 Right Channel delivery time x length y Word n Left Channel delivery time x length y Word n+1 Right Channel delivery time x length y Word n+2 Left Channel delivery time x++ length y Most Significant Bit Position is Delayed by one Clock (SCK) cycle after the Word Select Transition Word length Varies by sample Size (e.g. 8, 16, 24) Standard I 2 S alternates between left and right channel data with same delivery time per pair Words transmitted serially with Most Significant Bit first AVB transport SG 58

59 I 8 S variation using TDM Word Select transitions at the Least Significant Bit of the last word of the group. This is used to indicate start of the next group (i.e. high to low and low to high transitions) for multiplexing/demultiplexing using TDM on the data line. word select WS Ch. 7 Ch. Ch. 1 Ch. 2 Ch. 3 Ch. 4 Ch. 5 Ch. 6 Ch. 7 Ch. data SD Data clocked by sample frequency times word length times number of channels (e.g. 44.1kHz*16* 8 = MHz ) Word group n-1 Channels 4-7 delivery time x length y Most Significant Bit Position is Delayed by one Clock (SCK) cycle after the Word Select Transition Word group n Channels -3 delivery time x Same concept of multiple serial bit words per sample, but now grouped with other samples in the Word group n+1 Channels 4-7 delivery time x Word Group n+2 Channels delivery time x++ Number of channels (e.g. 8) transmitted as multiple words and grouped together by half the number of channels (e.g. 8/2 = 4). Words are time division multiplexed within the group. same group I 32 S works the same, it just has 32 AVB transport channels SG transmitted in 2 groups with words each.

60 Left Justified Serial Timing diagram Alternate to I 2 S as supported by some CODECs (TI, ADC). Uses Same physical interface as I 2 S (clock, data, word select) clock SCK word select WS data SD MSB LSB MSB LSB MSB Word n-1 Right Channel delivery time x length y Word n Left Channel delivery time x length y Word n+1 Right Channel delivery time x length y Word n+2 Left Channel delivery time x++ length y Most Significant Bit Position occurs at the Word Select Transition Word length Varies by sample Size (e.g. 8, 16, 24) Words transmitted serially with Most Significant Bit first AVB transport SG 6

61 Right Justified Serial Timing diagram Alternate to I 2 S as supported by some CODECs (TI, ADC) clock SCK word select WS data SD LSB MSB LSB MSB LSB Word n-1 Right Channel delivery time x length y Word n Left Channel delivery time x length y Word n+1 Right Channel delivery time x length y Word n+2 Left Channel delivery time x++ length y Word Right within word Select cycle. Word length Varies by sample Size (e.g. 8, 16, 24) LSB is last bit prior to transition of Word Select AVB transport SG 61

62 BT.61 over IEEE 1394 (to become ) Working slides Alan K. Bartky Bartky Networks AVB transport SG Draft for Orlando FL USA March meeting 62

63 BT.61 Isochronous Header Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) () Field Value Comments FMT x1 (1b) Format: BT.61 format FN Fragment Number: Always match of 1 to 1 between CIP packet and Source Packet (i.e. never fragmented) QPC Quadlet Padding Count : No dummy padding quadlets needed (or supported) SPH Source Packet Header: None DBC -255 Data Block Counter: Indicates modulo 256 sample count number of 1 st data quadlet of the packet. Used for detecting lost data, amount thereof. SYT xxxxxxxxxxxxxxx Synchronization Time: Time when the data block specified by DBC_NUMBER Modulo SYT_INTERVAL is presented at the receiver FDF -255 Format Dependent Field: See FDF data SYT Data: Delivery time of the first audio or Data bit to the application (codec, decoder, transmitter, etc.) Set by source of video data Processed by sink of video data Presentation Time Range 2 milliseconds 4 bit 8kHz Cycle 12 bit MHz Cycle offset Set to All ones (xffff) for entire 16 bit field as No info value AVB transport SG 63

64 BT.61 FDF field Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN() QPC() Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) () ND Reserved No Data (ND) Field If set to 1: Subsequent payload data is not valid and shall be ignored. Only used in blocking mode transmission. DBC equals count value of next valid data block If set to : Subsequent payload data is valid. For non-blocking mode transmission all Other bits in FDF reserved for future use Sending devices set to Receiving devices ignore AVB transport SG 64

65 Color Space Value Description YUV 4:2:2 (16 bits / pixel, 8 bits / sample) 1 YUV 4:4:4 (24 bits / pixel, 8 bits / sample) 2 RGB (24 bits / pixel, 8 bits / sample) 3 RGB (18 bits / pixel, 6 bits / sample) 255 Other color space Other Reserved for future specification AVB transport SG 65

66 General format of a source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) Type Specific Information r Ver Type () Source Packet Source Packet Data Data CRC Data CRC The Type field indicates the source packet type : Video Data 1: Stream information and metadata 2: Reserved for future specification for transport of audio data (currently recommends use of ) 3-255: Reserved The Ver field indicates the version of the specified source packet type The Type specific Information varies by source packet The r field is reserved for future use. AVB transport SG 66

67 Video Source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) Compression Mode Specific Information r Ver() Type() () Source Packet Source Packet Data Data CRC Data CRC The Type field set to. The Ver field set to The Type Specific Information varies by compression mode The r field is reserved for future use. AVB transport SG 67

68 Compression Mode Value Description Documentation reference Uncompressed Video Data N/A 1 Compressed video using Light Codec Oxford Semiconductor Light Codec Specification Version 1. 2 Compressed video using SmartCODEC Fujitsu SmartCODEC Specification Version Compressed video using other video codec N/A Other Reserved for future specification N/A AVB transport SG 68

69 SMARTCodec characteristics Public info from Fujitsu press release: Target images: Natural images, letter and line drawings, YUV 72 x 48 pixels; RGB 8 x 48 pixels, etc. Processing speed: Maximum: 6 frames/second; equivalent to RGB 8 x 48 pixels Delay time: Compression-decompression time is 2-3 milliseconds Compression ratio: Fixed rate of 1/3; (YUV 72 x 48 pixels; transmission rate 55 Mbps for 3 frames/second) AVB transport SG 69

70 Uncompressed Video Source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC VDSPC FMT FDF SYT cyc # SYT Cycle Offset (-371) sav sol Line number (14 bits) r () Ver() Type() Source Packet Source Packet Data Data CRC Data CRC Identified by Type field ==, size varies by video type Video Data source Packet Count (VDSPC): Running modulo 256 count of Source Packets. Start Of Line (sol): Packet contains first pixel of a video line Start of Active Video (sav): Packet contains first pixel of the first active video line of each frame (progressive) or each field (interlace) AVB transport SG 7

71 Color Space Video Source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC VDSPC FMT FDF SYT cyc # SYT Cycle Offset (-371) sav sol Line number (14 bits) r () Ver() Type() U Y V Y 1 U 2 Y 2 V 2 Y 3 Source Packet U 4 Y 4 V 4 Y 5... Data CRC Color Space YUV 4:2:2, 8 bits/sample 1 Y sample per pixel Each U and V sample is used for 2 pixels. U n-5 Y n-5 V n-5 Y n-4 U n-3 Y n-3 V n-3 Y n-2 U n-1 Y n-1 V n-1 Y n Data CRC AVB transport SG 71

72 Color Space 1 Video Source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC VDSPC FMT FDF SYT cyc # SYT Cycle Offset (-371) sav sol Line number (14 bits) r () Ver() Type() U Y V U 1 Y 1 V 1 U 2 Y 2 Source Packet V 2 U 3 Y 3 V 3... Data CRC Color Space 1 YUV 4:4:4, 8 bits/sample 1 U, Y, V sample per pixel U n-3 Y n-3 V n-3 U n-2 Y n-2 V n-2 U n-1 Y n-1 V n-1 U n Y n V n Data CRC AVB transport SG 72

73 Color Space 2 Video Source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC VDSPC FMT FDF SYT cyc # SYT Cycle Offset (-371) sav sol Line number (14 bits) r () Ver() Type() R G B R 1 G 1 B 1 R 2 G 2 Source Packet B 2 R 3 G 3 B 3... Data CRC Color Space 2 RGB, 8 bits/sample 1 R, G, B sample per pixel R n-3 G n-3 B n-3 R n-2 G n-2 B n-2 R n-1 G n-1 B n-1 R n G n B n Data CRC AVB transport SG 73

74 Metadata Source packet Isoch PKT hdr Header CRC CIP #1 CIP #2 Source Packet Data Length 1 Channel (-63) isoch sy Header CRC 1 SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) reserved Metadata total length r Metadata Packet Data () Ver(1) Type(1) Reserved Packet Data Data CRC Data CRC Identified by Type field ==, size varies by video type Metadata total length: Total length in bytes of Metadata Reserved packet data: Reserved/Unused data to create source packet of same size as normal video data source packet. AVB transport SG 74

75 Example Metadata source packet r P/I r reserved Total length = 56 reserved Ver(1) Type(1) reserved Video Mode reserved TC tens of minutes Day of week r Tens Of month RT tens of seconds Stream info Length = 14 Vertical Size Compression Mode r reserved Horizontal Size Color Space Transported Vertical Size r Transported Horizontal Size TC units of minutes units of month RT units of seconds Frame rate Auxiliary Data Length = 14 TC tens of hours tens of year AR TC units of hours units of year TC VAL RD VAL TC tens of frames DS tens of time zones thousands of year TC units of frames units of time zones hundreds of year Drop r RT VAL TC tens of seconds tens of day RT tens of frame RT tens RT units RT tens TC units r r reserved of minutes of minutes of hours of hours TC units of seconds units of day RT units of frame reserved Video Mode Specific Info Length = reserved Compression Mode Specific Info Length = reserved Color Space Specific Info Length = reserved Vendor Specific Info Length = 5 OUI (MSB) OUI OUI (LSB) OUI specific byte OUI specific byte reserved Copy Control Info Length = 9 OUI=xA CC_ID_2 = x49 r OUI (LSB)=x2D R N M RS E P N CG MS CC_ID_ = x43 reserved I C T APS R C OUI (MSB) = x CC_ID_1 = x43 reserved (Source Packet Size (Total length + 4) bytes of reserved data AVB transport SG 75

76 Protocol Adaptation Layer (PAL) Working slides Alan K. Bartky Bartky Networks AVB transport SG Draft for Orlando FL USA March meeting 76

77 PAL stream packet format PAL SNAP header PAL Stream header CIP #1 CIP #2 1 DSAP = xaa SSAP = xaa UI = x3 1394TA OUI-1=x 1394TA OUI-2=xA 1394TA OUI-3=x2D 1394TA PAL type = x21 Data Length 1 Channel (-63) Tcode = xa sy I Reserved? cycle# Cycle Offset (-371) SPH Source ID (-63) DBS (size in quadlets) FN QPC Rsv DBC FMT FDF SYT cyc # SYT Cycle Offset (-371) () CIP Packet Data Format summary SNAP compliant header, OUI x-a-2d, type x21 PAL stream header1 st quadlet same as 1394 header for CIP packets PAL stream header 2 nd quadlet used in 1394 for Header CRC reused for I bit: Indicates Isochronous or Asynchronous Stream Cycle time: Equivalent data of Cycle Start 1394 packet CIP Header and remaining CIP data are identical. AVB transport SG 77

78 Backup Misc. Info Alan K. Bartky Bartky Networks AVB transport SG Draft for Orlando FL USA March meeting 78

79 Time formats 1394/61883 time Seconds (-127) 8 khz Cycle # (-7999) SYT Cycle Offset (-371) 125 µs ticks 1/24.576Mhz ticks Ethernet AV time Epoch (2 32 second ticks) Seconds since : January 1,???? UTC Sub-seconds (-999,999,999 nanoseconds) AVB transport SG 79

80 Data bytes per packet, Unpacked Hz Bits/Sample: samples/ channel/ 8kHz Channels: , , , 4 Data , 6 per Packet: , , , , Average Data , per , Packet: , Max 1 megabit 1394 payload is 256 quadlets (124 bytes) Max AVB Ethernet Frame payload is 15 Invalid sizes not supportable for 1 megahertz 1394 in yellow Invalid sizes not supportable for a single normal max size Ethernet Frame in Red. AVB transport SG 8

81 Data bytes per packet, Packed Hz Bits/Sample: samples/ channel/ 8kHz Channels: , , , 4 Data , 6 per Packet: , , , , Average Data , per , Packet: , Max 1 megabit 1394 payload is 256 quadlets (124 bytes) Max AVB Ethernet Frame payload is 15 Invalid sizes not supportable for 1 megahertz 1394 in yellow Invalid sizes not supportable for a single normal max size Ethernet Frame in Red. AVB transport SG 81

82 A C E A 1C 1E 2 Cut and paste (82.1P/Q packet) MAC DA (stream group address) Priority CFI () IEEE 22???.? MAC Source Address 82.1P/Q Etype = x81 () VLAN ID XXXX Etype = x???? AVB transport SG 82