The Intel Media SDK 2017 R1 introduces API version This version is backward compatible with the previous API versions.

Transcription

1 Intel Media Sftware Develpment Kit 2017 R1 Release Ntes (Versin ) Overview New Features System Requirements Package Cntents Installatin Knwn Limitatins Legal Infrmatin Overview The Intel Media Sftware Develpment Kit* (further referred t as the Media SDK) is a sftware develpment package that expses the media acceleratin capabilities f Intel platfrms fr vide and audi decding, encding, RAW vide and pht prcessing as well as capabilities fr capturing screen cntent. The API cvers a wide range f Intel platfrms. The Media SDK targets general applicatin develpers wh want t integrate accelerated media int their applicatins. New Features The Intel Media SDK 2017 R1 intrduces API versin This versin is backward cmpatible with the previus API versins. Fllwing fixes, imprvements and features were added fr 6 th Generatin Intel Cre TM, 7 th Generatin Intel Cre TM, Intel Celern and Pentium. API updates cmparing t 1.19: mfxcamera.h: mfxextcamttalclrcntrl structure added t cntrl YUV->YUV cnversin filter. mfxcamera.h: mfxextcamcscyuvrgb structure added t cntrl cnversin frm RGB t YUV clr frmat. mfxplugin++.h: QueryPlatfrm functin added t get current platfrm cdename in applicatin via plugin. mfxstructures.h: MFX_PICSTRUCT_FIELD_SINGLE, MFX_PICSTRUCT_FIELD_TOP, MFX_PICSTRUCT_FIELD_BOTTOM, MFX_PICSTRUCT_FIELD_PAIRED_PREV, MFX_PICSTRUCT_FIELD_PAIRED_NEXT added fr specify picture type. *Other names and brands may be claimed as the prperty f thers. Page 1 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

2 mfxstructures.h: MFX_REFRESH_NO, MFX_REFRESH_VERTICAL, MFX_REFRESH_HORIZONTAL, MFX_REFRESH_SLICE added fr intra refresh supprt. mfxstructures.h: mfxextcdingoptin3::repartitincheckenable added t cntrl AVC encder attempts t predict frm small partitins. mfxstructures.h: mfxextcdingoptin3::adaptivemaxframesize added t cntrl max size f P and B frames. mfxstructures.h: mfxextcdingoptin3::enablembfrceintra and mfxextmbfrceintra structure added fr frce specified macrblcks t be encded as intra. mfxstructures.h: mfxextcdingoptin3::lwdelaybrc added t specifies frame size tlerance fr rate cntrls: VBR, QVBR, VCM. mfxstructures.h: mfxextcdingoptin3::brcpanicmde added t cntrl panic mde in MPEG2 encders. mfxstructures.h: mfxextencderroi::roimde, mfxextencderroi::roi::deltaqp and MFX_ROI_MODE_PRIORITY, MFX_ROI_MODE_QP_DELTA added t cntrl QP adjustment fr ROIs. mfxstructures.h: mfxextdecvideprcessing structure added t cntrl decder t resize utput frames via fixed functin resize engine. Fr detailed API descriptin please refer t mediasdk-man.pdf and mediasdkusr-man.pdf fr plugin API. Cmmn: Added Cntrl Flw Guard HW AVC Encde: Imprved dynamic intra refresh. Slice based intra refresh supprt added. Lw delay BRC and sliding windw BRC supprt added. Max frame size I/P supprt added. Explicit weighted P predictin and weighted B predictin supprt added. Fade detectin supprt added as preview fr latest versin driver Cntrl RGB input clr space via mfxextvidesignalinf. *Other names and brands may be claimed as the prperty f thers. Page 2 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

3 Frced intra based n ROIs supprt added fr 6 th Generatin Intel Cre TM, Intel Celern and Pentium with latest versin driver Scene change quality imprvement. HW HEVC Encde: Added supprt max frame size BRC cnstraints. HW RAW Acceleratr Plug-in Added supprt ttal clr cnversin. Added supprt cntrl clr space cnversin frm RGB t YUV. Tracer updated t 1.23 API. All the new features listed abve are nt supprted by sftware implementatin f the Media SDK Library. In a particular platfrm specific hardware implementatin f the Media SDK Library sme f the features may als be unsupprted. Make sure t call Query functins t check the actual supprt. Please see the Media SDK Reference Manual fr details <installflder>\dc\mediasdk-man.pdf Please see the RAW Media Acceleratr plug-in Reference Manual fr details <install-flder>\dc\mediasdk-raw-acceleratr-man.pdf Please see the Screen Capture plug-in Reference Manual fr details <installflder>\dc\mediasdkscreencap-man.pdf Fr infrmatin n the USER class please see <installflder>\dc\mediasdkusr-man.pdf Fr infrmatin n Multi-view Vide Cding supprt please see <installflder>\dc\mediasdkmvc-man.pdf Fr infrmatin n JPEG*/Mtin JPEG Vide Cding supprt please see <installflder>\dc\mediasdkjpeg-man.pdf System Requirements Hardware IA-32 r Intel 64 architecture prcessrs with supprt fr Intel Streaming SIMD Extensins 2 instructins fr running sftware implementatin f the Media SDK Library. *Other names and brands may be claimed as the prperty f thers. Page 3 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

4 Hardware acceleratin is available thrugh hardware implementatins f the Media SDK Library cming with Intel Iris TM and HD Graphics Driver fr Micrsft* Windws* 7/8.1/10 n platfrms with: 3 rd Generatin Intel Cre TM prcessrs, 4 th Generatin Intel Cre TM prcessrs, 5 th Generatin Intel Cre TM prcessrs, 6 th Generatin Intel Cre TM prcessrs, 7 th Generatin Intel Cre TM prcessrs, Intel Cre TM M prcessrs, Selected SKUs f Intel Celern TM and Intel Pentium TM prcessrs with Intel HD Graphics which supprt Intel Quick Sync Vide. Selected SKUs f Intel Atm TM prcessrs with Intel HD Graphics which supprt Intel Quick Sync Vide. Fr S3D display functinality using igfx_s3dcntrl library: 1. 2nd Generatin Intel Cre Prcessrs with Intel HD Graphics 3000/2000 r later 2. HDMI* 1.4, edp* 1.1 r similar based mnitr/tv as primary display 3. Active shutter glasses Sftware Micrsft* Windws* 7, Micrsft Windws 8.1, Micrsft Windws 10 and updates. Fr Micrsft DirectX* 11 functinality - Micrsft Windws 8.1, Micrsft Windws 10 and updates Micrsft Visual C++* 2005 with Service Pack 1, r later versin f Micrsft Visual C++. Package Cntents Nte: The suffix <arch> indicates 32- r 64-bit Micrsft* Windws* (either win32 r x64 ). Bth are always installed t allw fr crss-platfrm develpment. <install-flder> <install-flder>\bin\<arch> The Media SDK Release Ntes (this file), End User License Agreement (EULA) Media_SDK_EULA.rtf, a license file license.txt The Media SDK Dynamic Library, sftware implementatin: libmfxsw32.dll fr IA-32 architecture libmfxsw64.dll fr Intel 64 *Other names and brands may be claimed as the prperty f thers. Page 4 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

5 architecture versin The Media SDK Dynamic Library fr audi prcessing, sftware implementatin: libmfxaudisw32.dll fr IA-32 architecture libmfxaudisw64.dll fr Intel 64 architecture versin <install-flder>\ bin\<arch>\22d62c07e672408fbb4cc20ed7a0 53e4 Intel Media SDK fr Windws Screen Capture plug-in: Screen Capture plug-in mfxplugin64_screen_capture. dll fr Intel 64 architecture mfxplugin32_screen_capture. dll fr IA-32 architecture Cnfiguratin file plugin.cfg Plugin prduct versin: <install-flder>\ bin\<arch>\ e693ae899942ce 7355 Intel Media SDK fr Windws RAW Acceleratr plug-in: Camera plug-in mfxplugin_camera_pipe64.dll fr Intel 64 architecture mfxplugin_camera_pipe32.dll fr IA-32 architecture Cnfiguratin file plugin.cfg Plugin prduct versin: <install-flder>\dc Media SDK dcumentatin: Media SDK Reference Manual mediasdk-man.pdf Media SDK Extensins fr User- Defined Functins mediasdkusr-man.pdf *Other names and brands may be claimed as the prperty f thers. Page 5 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

6 Media SDK Extensins fr Multiview Vide Cding mediasdkmvc-man.pdf Media SDK Extensins fr JPEG*/Mtin JPEG mediasdkjpeg-man.pdf Media SDK Library Distributin and Dispatching Prcess Descriptin mediasdk-distrib.pdf Screen Capture Decder Reference Manual mediasdkscreencap-man.pdf RAW Acceleratr Reference Manual media-raw-acceleratrman.pdf Reference Manual fr Audi Prcessing mediasdkaudi-man.pdf <install-flder>\include External Media SDK headers: Type definitins in mfxdefs.h Structure definitins in mfxstructures.h, mfxastructures.h, mfxvstructures.h and mfxcmmn.h SDK sessin related definitins in mfxsessin.h Vide functin definitins in C in mfxvide.h C++ wrapper f the SDK vide functins in mfxvide++.h Audi functin definitins in C in mfxaudi.h C++ wrapper f the SDK audi functins in mfxaudi++.h Extensins fr Multi-view Vide Cding ptins mfxmvc.h Extensins fr User-Defined Functins mfxplugin.h *Other names and brands may be claimed as the prperty f thers. Page 6 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

7 C++ wrapper fr User-Defined Functins mfxplugin++.h Extensins fr JPEG*/Mtin JPEG Vide cding ptins mfxjpeg.h Structure definitins fr RAW Media Acceleratr mfxcamera.h Structure definitins fr Screen Capture plug-in mfxsc.h Definitins fr vp8 and vp9 cdecs mfxvp8.h, mfxvp9.h Definitins fr enc, pak functins and additinal features mfxenc.h, mfxpak.h, mfxla.h <install-flder>\ lib\ <arch> <install-flder>\ igfx_s3dcntrl\ include <install-flder>\ igfx_s3dcntrl\ lib\<arch> <install-flder>\ igfx_s3dcntrl\ <install-flder>\ pensurce\ <install-flder>\ tls\ Static Dispatcher Library libmfx.lib and libmfx_vs2015.lib fr Micrsft* Visual Studi 2015 S3D API definitins igfx_s3dcntrl.h Static S3D Cntrl Library igfx_s3dcntrl.lib Displaying S3D with Intel HD Graphics Develpers Guide Displaying S3D with Intel HD Graphics.pdf Surce cde f the Media SDK dispatcher Cntains the fllwing tls in binary frm: Media SDK Tracer in flder mediasdk_tracer. This utility perfrms runtime recrding f the Media SDK API calls and *Other names and brands may be claimed as the prperty f thers. Page 7 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

8 parameters t a lg file. Media SDK System Analyzer in flder mediasdk_sys_analyzer. This utility analyzes the system and reprts back the Media SDK related capabilities, graphics driver and cmpnents status. Installatin Installatin requires full administrative rights. Run the installer Intel_Media_SDK_2017_R1.msi. Knwn Limitatins Media SDK libraries and driver have the fllwing knwn limitatins. Unless explicitly specified each limitatin is relevant fr bth sftware and hardware implementatins f SDK dynamic library. API The fllwing APIs are nt supprted by the sftware implementatin f the SDK library: mfxextencdercapability, mfxextencderresetoptin, mfxextavcencdedframeinf; MFX_RATECONTROL_LA, MFX_RATECONTROL_ICQ, MFX_RATECONTROL_LA_ICQ, MFX_RATECONTROL_VCM, MFX_RATECONTROL_QVBR, MFX_RATECONTROL_LA_HRD and any ptins related t these BRC mdes; mfxextvppcmpsite, mfxextvppdeinterlacing; mfxextavcreflistctrl::applylngtermidx, LngTermIdx; mfxextencderroi; mfxextcdingoptin2::trellis, MBBRC, ExtBRC, RepeatPPS, BRefType, AdaptiveI, AdaptiveB, LkAheadDS; mfxinfmfx::icqquality; mfxencdectrl::skipframe; MFX_PLUGINID_HEVCE_HW, MFX_EXTBUFF_HEVC_PARAM, mfxexthevcparam; CreateAcceleratinDevice; MFXInitEx, MFXDWrk, mfxinitparam, mfxextthreadsparam; mfxinfmfx::lwpwer; *Other names and brands may be claimed as the prperty f thers. Page 8 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

9 MFX_EXTBUFF_DECODED_FRAME, mfxextdecdedframeinf, MFX_EXTBUFF_TIME_CODE, mfxexttimecde; mfxextcdingoptin3; mfxextpredweighttable; mfxextdirtyrect; mfxextmvingrect; mfxinitparam::gpucpy; mfxinfmfx::maxdecframebuffering; mfxvideparam:: AllcId; MFX_MEMTYPE_EXPORT_FRAME; mfxextcdingoptinvps; mfxextvpprtatin; mfxextvppsignalinf; mfxextvppmirrring; MFXVideCORE_QueryPlatfrm; mfxpaylad::ctrlflags; mfxframedata::memtype; mfxextvppscaling; mfxextvppclrfill; mfxextencdedslicesinf; MFX_MEMTYPE_SHARED_RESOURCE; mfxcreinterface::queryplatfrm; mfxextscenechange; mfxextvppclrfill; mfxexthevcregin; mfxextvppfieldprcessing; MFX_DEINTERLACING_ADVANCED_SCD; MFX_DEINTERLACING_FIELD_WEAVING; MFX_REFRESH_NO, MFX_REFRESH_VERTICAL, MFX_REFRESH_HORIZONTAL, MFX_REFRESH_SLICE; MFXCreInterface::QueryPlatfrm; mfxextdecvideprcessing; mfxextmbfrceintra; The belw APIs are nt supprted by the hardware implementatin f SDK Library in this release. Fr ther APIs nt mentined in this list make sure t call Query functins t check the actual supprt n a particular platfrm as it may vary. mfxextcdingoptin2::adaptivei, AdaptiveB, UseRawRef; *Other names and brands may be claimed as the prperty f thers. Page 9 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

10 Functinal mfxextavcencdedframeinf::mad, BRCPanicMde, QP; MFX_PLUGINID_VP8D_HW; mfxextchrmalcinf; mfxextmbqp; MFXInitEx, MFXDWrk, mfxinitparam, mfxextthreadsparam; mfxextdirtyrect; mfxextmverect; mfxextcdingoptin3::scenariinf, CntentInf, RepartitinCheckEnable EnableMBQP, DirectBiasAdjustment,GlbalMtinBiasAdjustment; mfxextcdingoptinvps; mfxextencdedslicesinf; mfxextscenechange; mfxexthevcregin; mfxextvppfieldprcessing; MFX_PICSTRUCT_FIELD_SINGLE, MFX_PICSTRUCT_FIELD_TOP, MFX_PICSTRUCT_FIELD_BOTTOM, MFX_PICSTRUCT_FIELD_PAIRED_PREV, MFX_PICSTRUCT_FIELD_PAIRED_NEXT; mfxextencderroi::roimde. Cmmn/general limitatins: The SDK dispatcher libmfx.lib is best used with a standard DLL entry pint (as recmmended by Micrsft*) when used in a DLL applicatin such as a Micrsft DirectShw* filter. The DLL entry pint setting can be fund under the Link > Advanced cmpiler ptins. Nn-standard entry pints can be used, but are nt recmmended. Lading f SDK dynamic libraries libmfxsw64.dll and libmfxhw64.dll nt thrugh the dispatcher is unsafe. Using the sftware implementatin f SDK in parallel with Intel Threading Building Blcks culd impact perfrmance. The number f internal tasks in hardware implementatin is limited t This impses a related limitatin n the number f SDK sessins which depends n the number f cmpnents in a sessin and the asynchrnus depth f each cmpnent: each cmpnent (DECODE, ENCODE r VPP) requires ne task fr synchrnus peratin and N tasks fr asynchrnus peratin with depth N. This release supprts nly 64-bit Micrsft* Windws* applicatins. Micrsft DirectX* 11.1 is the nly supprted acceleratin infrastructure (due t headless mde requirement). On Windws 10 bitstreams prduced by any encder can be nt bit exact frm time t time, but n visible difference. *Other names and brands may be claimed as the prperty f thers. Page 10 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

11 Recmmended t use system memry allcated with pinter alignment t 64, therwise result can cntain crruptins and smetimes pipeline can be brken. JPEG encde, decde: The feature set f JPEG decder/encder is limited t the fllwing: Baseline mde nly DCT based; 8-bit samples; Sequential; *Other names and brands may be claimed as the prperty f thers. Page 11 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin ladable 2 AC and 2 DC Huffman tables; 3 ladable quantizatin matrixes; interleaved and nn-interleaved scans; single and multiple scans. N extended, lssless and hierarchical mdes n 12-bit samples; n prgressive; n arithmetic cding; n 4 AC and 4 DC Huffman tables. JPEG decder des nt set Crrupted flag f mfxframedata structure, and des nt accept MFX_BITSTREAM_EOS as DataFlag f mfxbitstream structure. Sftware library implementatin can break pipeline in stress multisessin encding and cmplex threading graphs scenaris when tw r mre encders sharing the same mfxframesurface1 bject and memry handling implemented thrugh MemId. Encder with GPU cpy may prduce stream witch nt bit t bit with stream encded withut GPU cpy. HEVC decde: HEVC HW plugin MAIN10 prfile limited t Luma and Chrma BitDepth 10, all ther BitDepth are unsupprted in current implementatin. HW HEVC decde plugin is limited t 4096x2304 reslutin and desn t implement SW fallback fr higher reslutins 5 th generatin Intel Cre and Intel Xen E3 v4. Yu may use sftware implementatin f HEVC decde frm Intel Media Server Studi 2015 Prfessinal Editin t supprt higher reslutins. On 6 th Generatin Intel Cre and Xen E3 v5 it is limited t 8192x8192 reslutin. Interlaced decding is supprted nly thrugh separate field utput(half frame size), and n specific reprting f such behavir implemented in current versin, if App need interlace decde supprt, it can detect interlaced sequence thrugh: get SEI thrugh GetPaylad, parse SEI message t get pic_struct value fr SEI semantics(see D.2.3 seectin f High efficiency vide cding).

12 H.264 decde: H.264 decder may cnsume mre than 1 frame frm the input bitstream and then prpagate same timestamp t all f the cnsumed frames. If accurate time stamp handling is required the applicatin has t make sure that it desn t stre mre than ne-frame wise data in the input bitstream. MPEG-2 encde limitatins: If the MPEG-2 Vide encder mfxvideparam::mfxinfmfx::cdecprfile is initialized t 0, then the stream will be encded as MFX_PROFILE_MPEG2_MAIN. Additinally if the MPEG-2 Vide encder mfxvideparam::mfxinfmfx::cdeclevel is initialized t 0, then the stream will be encded as MFX_LEVEL_MPEG2_MAIN. MPEG-2 encde may prduce nt bit t bit result frm run t run n 5 th generatin Intel Cre and Intel Xen E3 v4. Run t run variatin desn t affect visual quality. mfxextcdingoptin3::brcpanicmde nt supprted fr windws. HEVC encde limitatins: Supprts maximum reslutin 4096x2172. Supprts nly CQP, CBR, VBR, ICQ and AVBR rate cntrl methds, as well as MFX_RATECONTROL_LA_EXT with lkahead plugin. Query max macrblck per secnd reprt nt supprted. Next limitatin fr encded bitstream: N tiles supprt; N SAO; N P slice; Prgressive nly. QP Offset fr HEVC is 1 by default. HW Accelerated HEVC encde supprts next extended buffer ids, with listed limitatins: MFX_EXTBUFF_CODING_OPTION; MFX_EXTBUFF_OPAQUE_SURFACE_ALLOCATION; MFX_EXTBUFF_HEVC_REFLISTS; MFX_EXTBUFF_HEVC_REFLIST_CTRL; MFX_EXTBUFF_CODING_OPTION_VPS; MFX_EXTBUFF_ENCODED_FRAME_INFO; MFX_EXTBUFF_VIDEO_SIGNAL_INFO; MFX_EXTBUFF_CODING_OPTION2; Supprted: MBBRC; BRefType; NumMbPerSlice; DisableDeblckingIdc; RepeatPPS; NumMbPerSlice; MaxFrameSize. MFX_EXTBUFF_CODING_OPTION3; Supprted: PRefType; EnableQPOffset; QPOffset. *Other names and brands may be claimed as the prperty f thers. Page 12 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

13 MFX_EXTBUFF_CODING_OPTION_SPSPPS; MFX_EXTBUFF_HEVC_TEMPORAL_LAYERS; MFX_EXTBUFF_ENCODER_RESET_OPTION; MFX_EXTBUFF_HEVC_PARAMS; GeneralCnstraintFlags: nt supprted. Encder with CBR rate cntrl ant height bitrate may prduce stream with HRD verflws. MaxFrameSize vilatin may happen in case f lw bit rate and specific cntent. T avid MaxFrameSize vilatin recmmend t set MaxFrameSize > 5* Bitrate/FPS/8. Encder with CBR rate cntrl, big reslutin and small max bitrate may fail. Supprts maximum paylads 160 byte per frame. H.264 AVC/MVC encde limitatins: Specific QSV-FF encde limitatins: Only I and P frame types supprted, s n API related t B frames encding supprted. CQP, CBR, VBR and QVBR rate cntrl methds nly. Supprted QP values range: Only prgressive encding supprted. Maximum number f reference frames equal t 3. Encding quality can be wrse than legacy encde with similar parameters. Encding bitrates higher than 43 Mbps nt supprted in current implementatin. MaxSliceSize feature can prduce slices nn-cmpliant t specified value, it is cntent dependent hw ften slice size verflw can ccur, s need t be tested accrding t usage and requirement if such vilatins acceptable r nt. QSV-FF encde nt utilizing render engine, except next 2 cases: Target Usage equal t 1 and NumRefFrame equal t 3. ARGB used as input. Nt supprted mfxextcdingoptin3::adaptivemaxframesize. MaxQP with MaxFrameSize nt wrking, MaxQP will have mre pririty and MaxFrameSize will be vilated. Frames fr different views in single AU in MVC encder must be prvided t encder in rder specified by mfxmvcviewdependency. MFX_EXTBUFF_AVC_REFLIST_CTRL and MFX_EXTBUFF_CODING_OPTION_SPSPPS external buffers are nt supprted by MVC encder. MVC encder supprts MFX_PROFILE_AVC_STEREO_HIGH nly. H.264 encder in sftware implementatin desn t supprt prcessing f mfxextpicturetimingsei template. During initializatin 0xFFFF values will be reset t default values. In runtime 0xFFFF values will be put t bitstream as is. RefPicMarkRepSEI syntax is nt supprted by MVC encder. Knwn limitatins fr H.264 Multiple-Segment Encding: *Other names and brands may be claimed as the prperty f thers. Page 13 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

14 Hardcded HRD parameters: bit_rate_scale = 0, cpb_size_scale = 3. Encded bit_rate_value_minus1, bit_rate_scale represent BitRate frm riginal SPS within precisin f Kbps (maximum supprted BitRate is 2^16 1 Kbps). Encded cpb_size_value_minus1, cpb_size_scale represent CpbSize frm riginal SPS within precisin f Kb (maximum supprted CpbSize is 2^16 1 Kb). Encded time_scale, num_units_in_tick culd be bth multiplied by 2 if the time_scale frm riginal SPS is dd. Cnflicts between SPS/PPS and mfxvideparam fr parameters that are nt cvered by SPS/PPS culd lead t change f parameters in SPS/PPS. Target usage 7 f H.264/MVC encders in sftware implementatin is knwn t have a nn-mntnic quality versus bitrate dependency. MVC encder ignres any user SEI messages fr the dependent view. The lk ahead bitrate cntrl mde may prduce nn HRD cmpliant encded streams. mfxextcdingoptin2::lkaheadds currently supprts nly MFX_LOOKAHEAD_DS_OFF and MFX_LOOKAHEAD_DS_2x, MFX_LOOKAHEAD_DS_4x will give the same result as MFX_LOOKAHEAD_DS_2x. MFX_LOOKAHEAD_DS_OFF is the default value fr target usage 1 and 2. MFX_LOOKAHEAD_DS_2x is the default value fr target usages 3 7. H.264 and MVC encders may nt bey the minimum cmpressin rati required by the Blu-Ray*/AVCHD* specificatins when the requirement is strnger than in H.264 standard. The value reprted via mfxextencdercapability::mbpersec may be bigger than the actual maximum prcessing rate f the encder. T change encding parameters n the fly with Reset() functin w/ IDR insertin applicatin shuld drain all the buffered surfaces frm encder. Otherwise encder may demnstrate undefined behavir after Reset. Call f Reset which starts new sequence (inserts IDR) will drp HRD cnfrmance ver the inserted IDR (CPB remval cunter will be set t 0 in the IDR Picture Timing SEI). HRD vilatins are pssible in specific scenaris (e.g. massive frame skipping). Encder prhibits increase f DPB size (NumRefFrame) via Reset functin even if new size is lwer than initializatin value. Reset functin will return MFX_ERR_INCOMPATIBLE_VIDEO_PARAM n any attempt t increase NumRefFrame. Target usage MFX_TARGETUSAGE_BEST_SPEED may prduce better bjective quality than MFX_TARGETUSAGE_BALANCED. Encder may nt insert PCM macrblcks when required. Encding f specific (cmplex) cntent with huge bitrate (which makes encder insert many PCM MBs) may cause a GPU hang n Haswell. *Other names and brands may be claimed as the prperty f thers. Page 14 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

15 Reset functin isn t supprted fr LkAhead BRC mdes. Reset functin desn t return an errr when called tgether with LA BRC. Result f such Reset call is undefined. B-pyramid isn t supprted tgether with HRD cmpliant Lk Ahead BRC (MFX_RATECONTROL_LA_HRD) and Lk Ahead BRC with sliding windw cntrl (MFX_RATECONTROL_LA and WinBRCMaxAvgKbps and WinBRCSize). Careful memry/resurce planning is needed when using Lk Ahead BRC due t strage f pre-analyzed frames. 1:N and N:N transcding use cases are especially demanding fr memry. When external Lk Ahead BRC is used in transcding pipeline which includes Frame Rate cnversin (FRC), FRC in the pipeline shuld take place befre external Lk Ahead. Otherwise encder may return errr MFX_ERR_UNDEFINED_BEHAVIOR frm EncdeFrameAsync calls. Trellis ptin can be enabled nly n lwer target usages, n sme f thse it is enabled by default but can be switched ff. Exact implementatin details are hidden and may change with time and between platfrms. Use f Query functin t retrieve actual supprt is strngly recmmended. SkipFrame feature has the fllwing limitatins: If GOP has nly P frames, arbitrary P can be skipped. When skipped, it is made nn-reference. If GOP has B frames, nly nn-reference B can be skipped. Sme fails can happen during encding in case f reinitializatin f encder in ne sessin with DirectX11. On specific cntent and height bitrate encder desn't always re-cde MB as PCM when its size exceed allwed by standard. Encding using VBR and dynamically adjusted the MaxFrameSize n a perframe basis algrithm may leads t HRD buffer underflw and quality artifacts. Max bit rate vilatins are pssible in case f using VBR and specific paylad. Fr RGB input in case f unspecified mfxextvidesignalinf::matrixcefficients r nt equals 1 will be used BT.601, if mfxextvidesignalinf::matrixcefficients = 1 - BT.709. Actual list f supprted cnversins may depend frm versin f driver. On 7th Generatin Intel CreTM and driver mfxextvidesignalinf::matrixcefficients will be ignred. Fr HW BRC: supprted nly WinBRCSize <=1 sec. MPEG-2 decde limitatins: MPEG-2 Vide decder returns MFX_ERR_UNDEFINED_BEHAVIOR instead f MFX_ERR_MORE_DATA when part f sequence header is absent and MFX_BITSTREAM_COMPLETE_FRAME flag is set. Decder des nt supprt bitstreams with reslutin bigger than 2096x2096. MFXVideDECODE_Init returns MFX_ERR_UNSUPPORTED n such bitstreams. Decder des nt supprt MPEG-1 bitstreams. It is interpreted as crrupted MPEG-2 bitstream. MFXVideDECODE_Init returns MFX_ERR_NONE and *Other names and brands may be claimed as the prperty f thers. Page 15 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

16 MFXVideDECODE_DecdeFrameAsync returns MFX_ERR_MORE_DATA until valid MPEG-2 bitstream is fund. Sequence headers are skipped if reslutin exceeds maximum supprted values (2096x2096) r level/chrma are invalid. It affects MFXVideDECODE_DecdeFrameAsync. mfxdecdestat.numframe that is returned frm GetDecdeStat functin is less by 1 than actual cunt f decded frames if GetDecdeStat is called after buffered frames are returned. VC1 decde limitatins: VC1 decder can t set crruptin flag in P,B-Frames if previus I-Frame was missed. VPP cmpnent has next limitatins: Cmpsitin has issues after reset with input system memry usage, input system memry nt recmmended fr use with cmpsitin if resetting cmpsitin pipeline required. MFX_FRCALGM_DISTRIBUTED_TIMESTAMP is unsupprted by InverseTelecine and Deinterlace (60i->60p) VPP filters. mfxextvppauxdata is deprecated. VPP::Query in sftware implementatin mistakenly indicates supprt fr MFX_FRCALGM_FRAME_INTERPOLATION while it is actually nt available. VPP scaling in sftware implementatin may prduce slightly blurred frames fr RGB32 interlaced cntent. VPP Image Stabilizatin and FRC Interplated filters will be deprecated and nt recmmended fr use due t result image quality and prduct quality assciated with these filters. When De-interlace and FRC filters used in pipeline MFX_DEINTERLACING_BOB will be used by default, if nt specified explicitly t use MFX_DEINTERLACING_ADVANCED. MFX_FOURCC_YV12 supprted nly via sftware fallback with DirectX* 11.1 interface. VPP in sftware implementatin always uses simple FRC algrithm based n repeat/drp frames and ignres MFX_FRCALGM_FRAME_INTERPOLATION flag. ADI may prduce clr artefacts n frame preceding a scene change. ADI may prduce clr artefacts in case f harmnic mtin (repeated pattern and mtin magnitude is the same as the peridic f repeated pattern). Multiple VPP filters being cmbined in ne sessin may prduce utput that is nt bit-exact with the utput frm the same VPP filters that are split by separate sessins, but the difference des nt affect visual quality. Frames with interlaced cntent must have CrpH multiple f 4. Otherwise, VPP may prduce clr artefacts n the bttm lines. De-interlacing is supprted fr NV12, YUY2 frmats nly. *Other names and brands may be claimed as the prperty f thers. Page 16 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

17 Once enabled at the Init stage VPP de-interlacing fr BOB mde is nt disabled autmatically if applicatin prvides input frames with picstruct set t MFX_PICSTRUCT_PROGRESSIVE. 1 st frame is dubled during 30i->60p de-interlacing fr MFX_DEINTERLACING_BOB and MFX_DEINTERLACING_ADVANCED_NOREF mdes. MFXVideVPP_GetVideParam des nt update values in attached extended buffers, except VPP_DO_USE. MFXVideVPP_Reset culd return errr if additinal memry allcatin is required based n prvided vide parameters (changed type f clr r frame rate cnversin fr example). The applicatin shuld clse VPP cmpnent and then re-initialize it in this case. See MFXVideVPP_Reset in SDK API Reference Manual fr mre details abut pssible return statuses. Multiple RGB4 surfaces with PixelAlphaEnable enabled culd give pr visual quality after cmpsitin n the same area with verlapping. Deprecated MFX_EXTBUFF_VPP_PICTSTRUCT_DETECTION enumeratr. VPP Mirrring in pipeline with vide t vide memry in/utput patterns can be supprted nly withut any ther filters, in/ut memry patterns cntaining system memry is supprted with any ther legal filters cmbinatin. ADI with dubled framerate there is an issue when first 3 frames cpied instead f 2. On 6 th generatin Intel Cre and Xen E3 v5 Tempral Denise enabled this can affect sme result f denise n scene change and after reset with changed denise factr. mfxextvppsignalinf has t be attached t surface with NV12 frmat nly when clr cnversin dne. Rtate + Detail/PrcAmp in cmbinatin affect each ther, thus result can different cmparing running filters separately and in ne call. The Screen Capture have the fllwing knwn limitatins: Screen Capture plugin will use fallback t standard Micrsft* DirectX* Vide Acceleratin (DXVA) path in case when mnitr is cnnected and applicatin uses exclusive render mde r OPM mde. Screen capture with scaling (i.e. when initializatin reslutin is nt equal current display reslutin) is supprted nly with NV12 furcc frmat. Screen Capture plugin lading recmmended nly with SDK HW library implementatin API 1.15 r later. In case f DirectX 11 implementatin, vide memry type, and RGB4 surface frmat usage, the applicatin frame allcatr needs t allcate the surfaces using DXGI_FORMAT_AYUV frmat because OS runtime will blck RGB surface allcatin with BIND_DECODER flag and decder utput view. In any ther cnfiguratin cases, e.g. DirectX 9 implementatin, system r paque memry type, r NV12 utput frmat, special frame allcatin is nt needed. DXVA fallback functinality desn t wrk fr reslutin change. *Other names and brands may be claimed as the prperty f thers. Page 17 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

18 DirtyRect detectin feature will detect dirty areas in captured frame and calesce areas t bigger nes until get 256 areas t feet int DirtyRect API buffer. Display Selectin API supprted nly fr Virtual Displays. Windws 10 acceleratin currently unsupprted, plugin will fall back t standard Micrsft functins, and perfrmance drp can be bserved. The Media RAW Acceleratr Plug-in has the fllwing knwn limitatins: Current versin supprts sessins nly initialized as MFX_IMPL_HARDWARE, MFX_IMPL_HARDWARE_ANY, MFX_IMPL_VIA_D3D11, MFX_IMPL_VIA_D3D9. Sftware fallback implementatin is nt ptimized thus perfrmance is very pr. Sftware fallback can be nt bit exact with GPU ptimized versin. Current versin supprts nly system memry as input memry type. Current versin supprts nly system memry as utput memry type fr MFX_FOURCC_ARGB16 and MFX_FOURCC_ABGR16 clr types. Current versin f plugin desn t supprt paque memry type. Additinal Intel Media SDK sessin must be created t use traditinal VPP features f Intel Media SDK HW Library. MFX_GAMMA_MODE_VALUE currently nt supprted. Current versin supprts nly system memry utput type fr MFX_FOURCC_ARGB4 clr type nt supprted with utput Vide memry type in case when ttal surface size is bigger than 6000x4000 n prcessrs lder than 6 th generatin Intel Cre. Fr reslutins mre than 6000x4000 result will be slightly different fr padded cntent and nn-padded cntent due t internal implementatin. Applicatin need t d MFXInit with API 1.10 versin t have RAW Acceleratr wrking n all available driver versins. MFX_EXTBUF_CAM_FORWARD_GAMMA_CORRECTION API is slwer than MFX_EXTBUF_CAM_GAMMA_CORRECTION n platfrms lder than 6 th generatin Intel Cre prcessrs. Vignette crrectin filter supprt is limited t pht with 8192x8192 reslutin f picture n 6th Generatin Intel Cre platfrms. Fr reslutins width bigger than 8192 and MFX_FOURCC_ARGB16 r MFX_FOURCC_ABGR16 clr types plug-in will fall back t GPU acceleratin instead f fixed functin n 6 th generatin Cre platfrms. 3D lk up table filter supprted nly n 6 th generatin Cre platfrms and will utilize render engine fr acceleratin. Nn zer values f CrpY may cause RunFrameVPPAsync t fail with MFX_ERR_DEVICE_FAILED (-17 errr cde) nly n 6 th Generatin Intel Cre Prcessrs based platfrms. The Audi library has the fllwing knwn limitatins and features: Lading f Audi library libmfxaudisw32.dll/libmfxaudisw64.dll nt thrugh the SDK Dispatcher is unsafe. Bitrate calculatin rutine in MFXAudiENCODE_Init may wrk incrrectly fr sme AAC High Efficiency (HE) prfile streams. As a result MFXAudiENCODE_Init functin returns an errr. Bitrate values fr AAC HE prfile vary frm 96 Kbit/s t 265 Kbit/s. The fllwing prfile and mde values are nt supprted: *Other names and brands may be claimed as the prperty f thers. Page 18 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

19 MFX_PROFILE_AAC_SSR MFX_PROFILE_AAC_ALS MFX_PROFILE_AAC_BSAC MFX_AUDIO_MP3_LFE_FILTER_ON always disabled AAC decder may handle streams with multiple (mre than 2) channels incrrectly. Audi has API versin Decding AAC, supprted prfiles: Lw Cmplexity (LC); Lng Term Predictin (LTP) Parametric Stere (PS) Spectral Band Replicatin (SBR)/HE AAC v1 HE AAC v2 (SBR + PS) Mpeg audi, supprted standards, prfiles MPEG-1 Audi Layer I, Layer II and Layer III (ISO*/IEC* ) MPEG-2 Audi Layer I, Layer II and Layer III (ISO/IEC ) Encding AAC supprted prfiles: Lw Cmplexity (LC) Spectral Band Replicatin (SBR) /HE AAC v1 Output frmats fr AAC ADTS, RAW, ADIF Stere mde LR, JOINT, MS Legal Infrmatin INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR INTENDED FOR ANY APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CREATE A SITUATION WHERE PERSONAL INJURY OR DEATH MAY OCCUR. Intel may make changes t specificatins and prduct descriptins at any time, *Other names and brands may be claimed as the prperty f thers. Page 19 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin

20 withut ntice. Designers must nt rely n the absence r characteristics f any features r instructins marked "reserved" r "undefined." Intel reserves these fr future definitin and shall have n respnsibility whatsever fr cnflicts r incmpatibilities arising frm future changes t them. The infrmatin here is subject t change withut ntice. D nt finalize a design with this infrmatin. The prducts described in this dcument may cntain design defects r errrs knwn as errata which may cause the prduct t deviate frm published specificatins. Current characterized errata are available n request. Cntact yur lcal Intel sales ffice r yur distributr t btain the latest specificatins and befre placing yur prduct rder. Cpies f dcuments which have an rder number and are referenced in this dcument, r ther Intel literature, may be btained by calling , r by visiting Intel's Web Site. MPEG is an internatinal standard fr vide cmpressin/decmpressin prmted by ISO. Implementatins f MPEG CODECs, r MPEG enabled platfrms may require licenses frm varius entities, including Intel Crpratin. Intel, the Intel lg, Intel Cre are trademarks r registered trademarks f Intel Crpratin r its subsidiaries in the United States and ther cuntries. Optimizatin Ntice Intel's cmpilers may r may nt ptimize t the same degree fr nn-intel micrprcessrs fr ptimizatins that are nt unique t Intel micrprcessrs. These ptimizatins include SSE2, SSE3, and SSE3 instructin sets and ther ptimizatins. Intel des nt guarantee the availability, functinality, r effectiveness f any ptimizatin n micrprcessrs nt manufactured by Intel. Micrprcessr-dependent ptimizatins in this prduct are intended fr use with Intel micrprcessrs. Certain ptimizatins nt specific t Intel micrarchitecture are reserved fr Intel micrprcessrs. Please refer t the applicable prduct User and Reference Guides fr mre infrmatin regarding the specific instructin sets cvered by this ntice. Ntice revisin # *Other names and brands may be claimed as the prperty f thers. Page 20 f 20 OpenCL and the OpenCL lg are trademarks f Apple Inc. used by permissin by Khrns. Cpyright , Intel Crpratin