CHANGE REQUEST. Status: Draft Internal Review X Community Review Agreed. Qualcomm Incorporated, Comcast/NBCUniversal, Brightcove, Harmonic, Ericsson

Transcription

1 CHANGE REQUEST DASH-IF IOP CR 0002 rev - Current versin: 3.3 Status: Draft Internal Review X Cmmunity Review Agreed Title: Surce: Additin f HEVC-based UHD Vide t DASH-IF IOP DASH-IF UHD Task Frce Supprting Cmpanies: Qualcmm Incrprated, Cmcast/NBCUniversal, Brightcve, Harmnic, Ericssn Categry: A Date: Use ne f the fllwing categries: C (crrectin) A (additin f feature) B (editrial mdificatin) Reasn fr change: Summary f change: Cnsequences if nt apprved: Sectins affected: Other cmments: UHD is a relevant technlgy fr imprved user experience. UHD includes the ability t distribute vide signals at higher spatial reslutin, higher frame rates, wider clr gamut and higher dynamic range. This first set f extensins fr UHD fcus n HEVCbased technlgies t address higher spatial reslutin in ne case, and in the secnd case the additin f wide clr gamut and high dynamic range. All technlgies are based n HEVC decding and regular display prcessing technlgies. DASH is primarily used as a carriage frmat. Tw Extensins are added: 1) 4K Extensin 2) 4K Extensin with HDR and WCG In all cases the elementary stream cnstraints as well as DASH-specific aspects are addressed. Nt applicable. Acrnyms, Abbreviatins and Definitins; References; 1; 10 (new) Disclaimer: This dcument is nt yet final. It is prvided fr public review until the deadline mentined belw. If yu have cmments n the dcument, please submit cmments by ne f the fllwing means: - at the github repsitry (public at - dashif+ip@grupspaces.cm with a subject tag [UHD], r Please add a detailed descriptin f the prblem and the cmment. Cmmenting Deadline: August 15 th, 2016 Expected Publicatin: August 31 st, 2016 Based n the received cmments a final dcument will be published latest by the expected publicatin date belw, integrated in a new versin f DASH-IF IOP if the fllwing additinal criteria are fulfilled: - All cmments frm cmmunity review are addressed - The relevant aspects fr the Cnfrmance Sftware are prvided - Verified IOP test vectrs are prvided

2 Acrnyms, abbreviatins and definitins Add at the end HDR HFR UHD WCG High Dynamic Range High Frame Rate Ultra High Definitin Wider Clur Gamut References [XX] SMPTE ST 2084:2014, Mastering Display Clr Vlume Metadata Supprting High Luminance and Wide Clr Gamut Images [XY] ISO/IEC :2013, Infrmatin technlgy -- MPEG systems technlgies -- Part 8: Cding-independent cde pints, available here: [ZX] Recmmendatin ITU-R BT (06/2015): "Parameter values fr the HDTV standards fr prductin and internatinal prgramme exchange". [ZY] Recmmendatin ITU-R BT (06/2014): "Parameter values fr ultra-high definitin televisin systems fr prductin and internatinal prgramme exchange". [ZZ] ETSI TS v2.2.1 (06/2015): "Specificatin fr the use f Vide and Audi Cding in Bradcasting Applicatins based n the MPEG-2 Transprt Stream." [BB] ETSI TS v1.1.1 (05/2015): "Digital Vide Bradcasting (DVB); MPEG-DASH Prfile fr Transprt f ISO BMFF Based DVB Services ver IP Based Netwrks. [CC] 3GPP TS (03/2016): "Televisin (TV) ver 3GPP services; Vide Prfiles. [DD] DECE (05/2015): Cmmn File Frmat & Media Frmats Specificatin,

3 1 Intrductin This dcument extends the DASH-IF's InterOperability Pints (IOPs) t add supprt fr UHD Extensins, see Table 2. Extensins Identifier Versin Sectin DASH-IF UHD HEVC 4k 3.X 10.2 DASH-IF UHD HDR X DASH-IF UHD Extensins 10.1 Intrductin This versin f the dcument defines UHD Extensins in this sectin DASH-IF UHD HEVC 4k Intrductin Fr the supprt f brad set f use cases the DASH-IF IOP HEVC 4k Extensin is defined. UHD 4k vide encded with H.265/HEVC is an advanced distributin frmat fr TV services that enables higher reslutin experiences in an efficient manner. In additin, the features f DASH-IF IOP Main as defined in sectin xxx and DASH-265/HEVC as defined in sectin xxx, this extensin adds the Main interperability pint t include 4k reslutins at 60fps, and restricts the cdec supprt t HEVC Level 5.1. The cnfrmance t DASH-IF IOP 4k may be signaled by attribute with the value Elementary Stream Requirements Cnstraints n Picture Frmats NAL Structured Vide streams cnfrming t this Media Prfile SHALL NOT exceed the fllwing cded picture frmat cnstraints: Maximum encded hrizntal sample cunt f 3840 samples Maximum encded vertical sample cunt f 2160 samples Maximum Frame Rate f / 1000 (Frame Rate is calculated as per Sectin xxx) Additinal cded picture frmat cnstraints: The surce vide frmat shall be prgressive. Representatins in ne Adaptatin Set shall nly differ n the fllwing parameters: Bitrate, spatial reslutin, frame rate The cnditin f the fllwing SHALL NOT change thrughut ne HEVC vide track: aspect_rati_idc cpb_cnt_minus1

4 bit_rate_scale bit_rate_value_minus1 cpb_size_scale cpb_size_value_minus1 The fllwing fields SHALL NOT change thrughut an HEVC elementary stream: pic_width_in_luma_samples pic_height_in_luma_samples YCbCr shall be used as the Chrma Frmat and 4:2.0 fr clr sub-sampling.the bit depth f the cntent shall be either 8 bit r 10 bit. The cntent shall be restricted t the HEVC vide cdec. See Sectin xxx fr details abut HEVC encding. The clr primaries shall be ITU-R BT Bitstream Requirements and Recmmendatins A bitstream cnfrming t the H.265/HEVC 4k media prfile shall cmply with the Main Tier Main Prfile Level 5.1 restrictins, as specified in Recmmendatin ITU-T H.265 / ISO/IEC [35]. UHD HEVC 4k Bitstreams shall set vui_parameters_present_flag t 1 in the active Sequence Parameter Set, i.e. HEVC bitstreams shall cntain a Vide Usability Infrmatin syntax structure. The sample aspect rati infrmatin shall be signaled in the bitstream using the aspect_rati_idc value in the Vide Usability Infrmatin (see values f aspect_rati_idc in Recmmendatin ITU-T H.265 / ISO/IEC :2013 [35], table E-1). UHD HEVC 4k bitstreams shall represent square pixels indicated by aspect_rati_idc SHALL be set t 1. In additin t the prvisins set frth in Recmmendatin ITU-T H.265 / ISO/IEC :2013 [35], the fllwing restrictins shall apply fr the fields in the sequence parameter set: - vui_parameters_present_flag = 1 - sps_extensin_flag = 0 - fixed_pic_rate_general_flag = 1 - general_interlaced_surce_flag = 0 In additin t the prvisins set frth in Recmmendatin ITU-T H.265 / ISO/IEC :2013 [35], the fllwing restrictins shall apply fr the fields in the prfile_tier_level syntax structure in the sequence parameter set: - general_tier_flag = 0 - general_prfile_idc = 0 r 2 UHD HEVC 4k bitstreams shall bey the limits in Recmmendatin ITU-T H.265 / ISO/IEC :2013 [35], table A.1 and table A.2 assciated t Level 5.1. general_level_idc shall be less than r equal t 153 (level 5.1). It is recmmended that bitstreams which are cmpliant with the Main r Main10 prfile set general_prfile_cmpatibility_flag[1] t 1. The chrmaticity c-rdinates f the ideal display, pt-electrnic transfer characteristic f the surce picture and matrix cefficients used in deriving luminance and chrminance signals frm the red, green and blue primaries shall be explicitly signaled in the encded HEVC Bitstream by setting the apprpriate values fr each f the fllwing 3 parameters in the VUI: clur_primaries, transfer_characteristics, and matrix_ceffs.

5 BT.709 [ZX] clrimetry usage is signalled by setting clur_primaries t the value 1, transfer_characteristics t the value 1 and matrix_ceffs t the value 1. The bitstream may cntain SEI messages as permitted by the Recmmendatin ITU-T H.265 / ISO/IEC :2013 [35]. Details n these SEI messages are specified in Recmmendatin ITU-T H.265 / ISO/IEC / Annex D Receiver Requirements Receivers cnfrming t the HEVC 4k media prfile SHALL supprt decding and displaying H.265/HEVC 4kbitstreams as defined in clause N additinal prcessing requirements are defined, fr example prcessing f SEI messages is ut f scpe Mapping t DASH Media Prfile Identifier If all Representatins in an Adaptatin Set cnfrms t the elementary stream cnstraints fr the Media Prfile as defined in clause and the Adaptatin Set cnfrms t the MPD signaling accrding t clause and , and the Representatins cnfrm t the file frmat cnstraints in clause , then parameter in the Adaptatin Set may signal cnfrmance t this peratin pint by using MPD Signaling The MPD shall cnfrm t DASH-IF HEVC Main IOP as defined with the additinal cnstraints defined in clause File Frmat Requirements Representatins used in the cntext f the specificatin shall cnfrm t the ISO BMFF Segment frmat with the fllwing further requirements: - The value f the duratin field in the Mvie Header Bx ( mvhd ) shall be set t a value f 0 - The Track Header Bx ( tkhd ) shall bey the fllwing cnstraints: The value f the duratin field shall be set t '0'. The width and height fields fr a visual track shall specify the track s visual presentatin size as fixed-pint values expressed in n a unifrmly sampled grid (cmmnly called square pixels) - The Media Header Bx ( mdhd ) shall bey the fllwing cnstraints: The value f the duratin field shall be set t 0. - The Vide Media Header ( vmhd ) shall bey the fllwing cnstraints: The value f the versin field shall be set t 0. The value f the graphicsmde field shall be set t 0. The value f the pclr field shall be set t { 0, 0, 0 }.

6 - The Sample Descriptin Bx ( stsd ) shall bey the fllwing cnstraints: A visual sample entry shall be used. The bx shall include a NAL Structured Vide Parameter Set the maximum width and height values shall crrespnd t the maximum crpped hrizntal and vertical sample cunts indicated in any Sequence Parameter Set in the track It shall cntain a Decder Cnfiguratin Recrd which signals the Prfile, Level, and ther parameters in the vide track. - The entry_cunt field f the Sample-t-Chunk Bx ( stsc ) shall be set t 0. - Bth the sample_size and sample_cunt fields f the Sample Size Bx ( stsz ) bx shall be set t zer ( 0 ). The sample_cunt field f the Sample Size Bx ( stz2 ) bx shall be set t zer ( 0 ). The actual sample size infrmatin can be fund in the Track Fragment Run Bx ( trun ) fr the track. Nte: this is because the Mvie Bx ( mv ) cntains n media samples. - The entry_cunt field f the Chunk Offset Bx ( stc ) shall be set t 0. - Mvie Fragment Header Bxes ( mfhd ) shall cntain sequence_number values that are sequentially numbered starting with the number 1 and incrementing by +1, sequenced by mvie fragment strage and presentatin rder. - Any Segment Index Bx ( sidx ), if present, shall bey the additinal cnstraints: The timescale field shall have the same value as the timescale field in the Media Header Bx ( mdhd ) within the same track; and the reference_id field shall be set t the track_id f the ISO Media track as defined in the Track Header Bx ( tkhd ). - Fr HEVCSampleEntry ( hev1 ) NAL Structured Vide tracks, the 'first_sample_flags' shall signal the picture type f the first sample in each mvie fragment as specified belw. sample_is_nn_sync_sample=0: If the first sample is a sync sample. sample_is_nn_sync_sample=1: If the first sample is nt a sync sample. sample_depends_n=2: If the first sample is an I-frame. - The Clur Infrmatin Bx shuld be present. If present, it shall signal the transfer characteristics f the elementary stream. - The sample timing shall bey the frame rate requirements Adaptatin Set Cnstraints Fr a vide Adaptatin Set, the fllwing cnstraints apply, which are identical t the cnstraints as specified in clause 3.3: - parameter shall be present n Adaptatin Set level and shall signal the maximum required capability t decde any Representatin in the Adaptatin Set. - parameter may be present t signal the cnstraints fr the Adaptatin Set

7 - The shall be present. They are expected be used t signal the surce cntent frmat. This means that they may exceed the actual largest size f any cded Representatin in ne Adaptatin Set. - shall be signalled fr each Representatin (pssibly defaulted n Adaptatin Set level) and shall match the values f the maximum width and height in the Sample Descriptin bx f the cntained Representatin. - The maximum frame rate may be signalled n Adaptatin Set using attribute. - shuld be signalled fr each Representatin (pssibly defaulted n Adaptatin Set level). In additin t the abve referenced cnstraints, this prfile specifies the fllwing additinal cntraints: - The Clr Space in use may be signalled. If signalled, an Essential r Supplemental Descriptr shall be used t signal the value by setting attribute t urn:mpeg:mpegb:cicp:matrixcefficients as defined ISO/IEC [10] and attribute accrding t Table 4 f ISO/IEC [XY]. The values shall match the values set in the VUI. The signalling shall be n Adaptatin Set level, i.e all Representatins in ne Adaptatin Set are required t have the same Chrma Frmat. - The Clr Primaries and Transfer Functin may be signalled. If signalled, an Essential r Supplemental Descriptr shall be used t signal the value by setting attribute t urn:mpeg:mpegb:cicp: ClurPrimaries and urn:mpeg:mpegb:cicp:transfercharacteristics as defined ISO/IEC [XY] and attribute accrding t Table 4 f ISO/IEC [XY]. The values shall match the values set in the VUI. The signalling shall be n Adaptatin Set level nly, i.e all Representatins in ne Adaptatin Set are required t have the same Clr Primaries and Transfer Functin Cmpatibility Aspects This specificatin is designed such that cntent that is authred in cnfrmance t this IOP is expected t cnfrm t the media prfile defined by DVB DASH in ETSI TS [BB] and fllwing the 3GPP H.265/HEVC UHD Operatin Pint in sectin 5.6 f 3GPP TS [CC]. Hwever, in cntrast t DVB and 3GPP, nly BT.709 may be used and nt BT In additin, clients cnfrming t this extensin shuld be capable t play cntent authred as cnfrm t the media prfile defined by DVB DASH in ETSI TS [BB] and fllwing the 3GPP H.265/HEVC UHD Operatin Pint in sectin 5.6 f 3GPP TS [CC], if BT.709 clur space is used DASH-IF IOP UHD HDR Intrductin Fr the supprt f brad set f use cases addressing higher dynamic range and wider clur gamut, the DASH-IF IOP HDR10 Extensin is defined. This interperability pint allws fr additinal UHD features including Wide Clr Gamut, High Dynamic Range and a new electr-ptical transfer curve. These features are in additin t the existing features described in the DASH-IF UHD 4k interperability pint, except that that this prfile is designed fr HDR, and requires the use f SMPTE and Rec clrspace.

8 Nte that this IOP des nt require the use f the maximum values, such as 60fps r 4K reslutin. The cntent authr may ffer lwer spatial and tempral reslutins and may use the regular DASH signalling t indicate the actual frmat f the surce and rendering frmat. Typical cases may be t use HDR tgether with an HD 1080p signal. Nte als that Adaptatin Set Switching as defined in sectin 3.2.X may be used t separate different spatial reslutins in different Adaptatin Sets t address different capabilities, but still permit the use f lwer reslutins fr service cntinuity f higher reslutins. The cmpliance t DASH-IF IOP HDR10 may be signaled by attribute with the value Elementary Stream Requirements Intrductin The same requirements as fr UHD HEVC 4k as dcumented in [10.2] hld, expect fr the changes as detailed belw. The changes in the HEVC HDR10 prfile that extend it beynd the HEVC 4K prfile include: - the Main10 Prfile is used instead f the Main Prfile, as specified in Recmmendatin ITU-T H.265 / ISO/IEC [35]. - NAL Structured Vide Streams cnfrming t this interperability pint SHALL be encded using the REC-2020 clr parameters as defined in [xxx]. Clients shall be able t crrectly decde cntent that is encded using that clrspace. - NAL Structured Vide Streams cnfrming t this interperability pint SHALL be encded using the SMPTE-2084 electr-ptic transfer functin as defined in [xxx]. Clients shall be able t crrectly decde cntent that is encded using that electr-ptic transfer functin Nte that ne cannt authr a single piece f cntent that is cmpliant with bth this prfile and HEVC 4k prfile. Hwever, the cntent may be ffered in ne MPD in tw different Adaptatin Sets Bitstream Requirements and Recmmendatins A bitstream cnfrming t the HEVC HDR-10 media prfile shall cmply with the Main Tier Main10 Prfile Level 5.1 restrictins, as specified in Recmmendatin ITU-T H.265 / ISO/IEC In additin the requirements in sectin apply, except that this prfile requires the use f Recmmendatin ITU-R BT.2020 [ZY] nn-cnstant luminance clrimetry and SMPTE-2084 [ZZ]. SMPTE-2084 [ZZ] usage SHALL be signaled by setting clur_primaries t the value 9, transfer_characteristics t the value 16 and matrix_ceffs t the value 9. The bitstream may cntain SEI messages as permitted by the Recmmendatin ITU-T H.265 / ISO/IEC :2013 [35]. Details n these SEI messages are specified in Recmmendatin ITU-T H.265 / ISO/IEC / Annex D. SEI message may fr example supprt adaptatin f the decded vide signals t different display capabilities r mre detailed cntent descriptin, in particular the Mastering display clur vlume SEI and the Cntent light level inf SEI as specified in Recmmendatin ITU-T H.265 / ISO/IEC / Annex D.

9 Receiver Requirements Receivers cnfrming t the HEVC HDR-10 media prfile shall supprt decding and displaying HEVC HDR-10 bitstreams as defined in N additinal prcessing requirements are defined, fr example prcessing f SEI messages is ut f scpe Mapping t DASH Media Prfile Identifier If all Representatins in an Adaptatin Set cnfrms t the elementary stream cnstraints fr the Media Prfile as defined in clause and the Adaptatin Set cnfrms t the MPD signalling accrding t clause and , and the Representatins cnfrm t the file frmat cnstraints in clause , then Optin 1: parameter in the Adaptatin Set may signal cnfrmance t this peratin pint by using MPD Signaling The MPD shall cnfrm t DASH-IF HEVC Main IOP as defined with the additinal cnstraints defined in clause File Frmat Requirements The file frmat requirements as defined in clause shall apply Adaptatin Set Cnstraints The same requirements as defined in clause shall apply Cmpatibility Aspects Cntent authred accrding t this media prfile is interperable with the HDR 10 prfile defined in the DECE CFF Cntent Specificatin v2.2 [DD], althugh it shuld be nted that the DECE CFF prfile may have additinal cnstraints, such as bitrate restrictins and required metadata.