!"# () # : ./ & 01$2 $3,$4! & / 5& 6/ 7 8 9/ :* / ;< 8=> 8! 7 8? ' (3X & & & Y.& */!,& ' Z'F& &! & L$)F&.? &/$&

Size: px

Start display at page:

Download "!"# () # : ./ & 01$2 $3,$*4! & */ 5& 6/ 7 8 9/ :* / ;< 8=> 8! 7 8? ' (3X & & & Y.& */!,& ' Z'F& &! & L$)F&.? &/$&"

Dwight Waters
5 years ago
Views:

1 (40342)!"# 138 %&' $ () # : -1.,'-.' ' ()*+! "#$ %&./ & 01$2 $3,$*4! & */ 5& 6/ 7 8 9/ :* / ;< 8=> 8! 7 8? ' ',D) CCIR 601! 7,B &.& */ 128 Mbit/s '& K'3/ 4:2:0 J/ & 8/I 6/ (EF/.G1,O& 8=> 112 Gbyte 8$N 2 L1* 7 ) MD.& 16Mbyte/s ' L1*' ' VHS ' ',D) :P? *Q*? CIF L1* 7.;? ' 89R 8? & VW&.;?,O& & &R %& STU 7 (VCD ' (3X & & & Y.& */!,& ' Z'F& &! & L$)F&.? &/$& '_ 7'.& S\& %Q1 ]Q1 ^/&Q;? & CCTTT [ The International Telecommunication Unit- ITU-T S';.;?& 8?) CCTTT & ` ' 7*;a & &/$& ( */ Telecommunication Sector,' &/$& %&.&? bc ^/&Q;?! &! '? 8' e' P9' 8? 8$3; H.320.&;D & 8*d 1990 e'c3 & ^/&Q;?! & &/$& %&.& H.261.!.? ' p=1,2,,30 8'? & p*64 kpbs / ;< && 8? ;? Q$& ISDN 30fpc) QCIF ' (352* fps) CIF '!' g';.' '/& 64 kbps & h' 5&'/& 8' ' &'i &j! & (176*144. CE 342 Multimedia HW# 6 1

2 01$2? &,$*4! i :1,- :* 384 kbps 8 CIF! 7, *Q*? l& & mpn &/$'& '4&,/'.& '*/ :* 64kbps 8 QCIF! 7 &.& 8'&& nr$/& 8/ & &? od ITU-T H.320 & ^ *Q*? 8? 8a & 8? & H.323 &/$& p %:PT 8'? H.324 &/$'& G'*/ & 8*d /:;& ;/ ;;? I ZPh 2808kbps S' rq & %Q1 ec3 B L? *9 / ;< ec3 & '!'.?? &/$&.& bc L*,/? 8' 9'/ 9's '*+ 8? & H.263 H.324 H.323 &/$& %& ' QCIF!' 7 H.263.& Z+ * 6/ & tu H kbps > 64kbps 6/ H.261 & :v,d *Q*? Motion Picture Expert Group MPEG S'/ 8 ` _ 7 ITU-T w.gj,'& g' ' ('3X &' & Q1$2 &/$& G*/ ISO & 8'? '& MPEG-1 _ %& &/$& ZF&./& 8D! $/& & (352*240 pels/sec 30 fps) SIF ' ' Mi! *1 'A+ '(3X.a& &/$& %&.& y3 *Q*? 1/5Mbps 1/5 Mbps 8' 'p 6'/.'. 8? & & CD-ROM L1*. s &' 1'N (Video CD ' VCD) CD MPEG-1 ' L1*' &,R$& b'c ZF& & MPEG-1 &/$& z.,$*4! od. */. J/.??&? & *{*+ &G& A 'c MPEG-1 ' L1*.??& Intel Pentium I 9+a*. 8WN.? 9* & WEB rq & MPEG-1 L1* l_ J/ ' ' 5*'.? &/$& MPEG MPEG-1.? & D ' G?P$ *Q*?! $/&? & &i! 10Mbp ' 3 Z' (.G1 *Q*?) CCIR601! 8? } %& &/$'& '4&.' MPEG 2.' b'c 8 ~; w %&. &' rq &! $/&.a& :&,/ PT g MPEG-2 MPEG-2 &/$'&.,$*4.G1 DVD L1* (Direct-TV ;/) Z;{j.& HDTV! & /a& && Z;{j.& _ MPEG-1 ;?? G*/ (SIF) MPEG-1 /& CE 342 Multimedia HW# 6 2

3 & & 8/ ;U,;)* & &/$& 2,-.&? ; g! " #! $" " #% # :2. }' 8'? ' >&q MPEG-4 S/ 8 ) &/$& MPEG-2,/.'!' ' &G' 01$2 *& 8 : & z*1 4& ' '? 8/_&- c ƒwb.? ]$!. }' 8'?.& MPEG-7 &/$& & 8&& MPEG _ w. 8'? &8'/) '& ' ' *1 0*i & &/$& 4& 8 *$ 8$& & i MNwq& &$s 0*i.a&.;? 9* &,$*4! Z'P` t'u! & &$& 7*;a %& ','/ MPEG-2 MPEG-1 H.261 &/$'&?>.& -.*I 8D-& [1] 8 8;* %& :* M*!G- &. &'# ( -2 )"* $#+ )"*, !' ' ' L$)F& B?& & 8+?>.& - ZP` M&(*O - 8? ;;??>.& - &.;$9 Z'P` & Q$'&.'a& ' %'&.'& 1 8 9/ G- ' Q$'& g-.&;d ˆ 7 8? );.;? 4& & */ 8'? '/& )'a G- }w$3&. of/ ˆ 8NP ' &.'/ 1 a' 8'? & Z?> *&?> o~*$/ I?? c ˆ 7. ˆ o9r 8a;& &.&./? R$9 c T?1 L*9R T?1 8 8a1 r'c; "1 %:v (- ˆ)? 8? "1 & &'. ~$9- ya$/& T?1 & &D.* g- ˆ "'1..'a Z' }w$'3& 8? *F?> & 7 "1 ' y'a$/& %&../ & g- ˆ. rc "1 %:v b' '$2 'c 8'? S\& g-? ~$9-7 /&. &3 & CE 342 Multimedia HW# 6 3

2!! 34 )"* $#5 :1/01 ' *F g- ˆ e&?> & */ 'T?1 %:v D g- ˆ & ) 1 g- ˆ & a / ' ' "'1 /' ' ~$9- ˆ & r*c./ 8$_ Z)/* (BMA) )"*,-. #! 6"! 7! 8 9&'# -1-1-2 ' f k-1 ˆ' "'1 7' Š;$ f k ˆ B n "1 8? *;?

4 2!! 34 )"* $#5 :1/01 ' *F g- ˆ e&?> & */ 'T?1 %:v D g- ˆ & ) 1 g- ˆ & a / ' ' "'1 /' ' ~$9- ˆ & r*c./ 8$_ Z)/* (BMA) )"*,-. #! 6"! 7! 8 9&'# ' f k-1 ˆ' "'1 7' Š;$ f k ˆ B n "1 8? *;?. D n *D r'q & '/& ' D n ZP`. */ B n?> & S; D n 8?. c3 r1c c3 g ;/ ZP` c3.? &> &'> && 8'??'1.'? &'*+ & &? ~$9-7 BMA ' & '- "'1 %'& r* MD.;? Q$& c3 1D.a }&q& 0D & 5s 7 %aœ "1 o*1? D ;? 8s & ZP` c3 Z*D "1 & ;? 89R %':v.&';d & & c3 &> 8??1 %aœ T?1 S &. ya$/& rc "1 Z*'D ' T?1 & mpn! ˆ Z D&?> '?> Z'P` &' T?1 rc L$)F& & Q$& %&;.9*/ 7 R*R>?> 8? );.;? 4& R* ZP` /& I?>.& - &>?1.? &*+ & L$)F& /,R$/& 7 "1 rc & Q$&?>.& - & & nb 2 Ž.;? w c3../ "1 CE 342 Multimedia HW# 6 4

5 2! 7! 8 = # :#! )"* $#+ # ; < :2/01 '- ˆ' & & 1 ˆ U '&) '& ZP` T$?>.&* & Z+ & U Z+ (./& L "1 G? s & Z*D?>../ &?>.&* & Q$& ZP` Z*'D & 8';* ^+?> SN R* c L$)F& 8? 8=>w Z'P` a' %& LU. 8$9 8a*F> &?. I CE 342 Multimedia HW# 6 5

6 >??" #! $" "# " ;-B /*# :3 /01 /4 " )"* $#+ # :#! $" " ' 8$3; block-based hybrid.?? S/ 8!.?? %:F&$ S&?. L*9R (MBs) "1? 8 ˆ %&..& - & *? & Q$& "1?.& 8*8 "1 %;U &&.? & &./ 3 a 8? c/j DCT?> 7 Intra.? & a /& "1?,'PN& "'1 L*R$9 c JPEG 8 8* DCT.?? ]$ c D a ˆ ZF& "w? & %&. 7' Inter '.' Q$& G*/ 8F/ ˆ y;$.&g'* c3.?? & DCT Z*D &$&?> & & '- ˆ & - "w? %& mi3. Q$&?> 8'QFY ['R) '/ ZP` 1 ˆ. rc "w? %:v.' ' & ' Z*'D '> & :P?. ZP` c3 _& (Luminance & Q$'& ' Z'P` c3 M;& (. I Z*D & }w$3& ' ' G*$/&'? 8'$ ' ' 8'QFY DCT * 8$ p./? JPEG 8 runlength & Q$&,'& video multiplex 8' ' '??> & MNwq& &j? G*$/&'? step 5&'/& ' & b' JPEG 0*i 8? c/j./ (*'O.'?? &? & *Q*? & /& ;;?.;? H.261 $" " 9&'# -2-2! ' '11 & Z ' &/$ '& & & 8 'NP CCTTT 1990, ' i ^ & H.261! ;;?? ^/&Q;?.'? (/ 8$3; G*/ p*64 &/$& 8?) p*64 kbps ISDN L$9* %Q1 &/$& %& & 8$_ =/? CE 342 Multimedia HW# 6 6

7 [' &/$'& %& 8? L$9* %&;.& ^/&Q;?! 8$'& & &/$'& %'& J/.??&? *1 ;$9 p 8'+ 6'/ ISDN e& 7 &.& 30 1 & p 5s.;.& 2 7 %'Q1 &'!' '.&;D & QCIF CIF CCTTT Y &' 9'a*+ 352*288 && CIF!._ =/ ˆ' 30 ' 7' Z /& ˆ 6/.& Cr&C b & 9Ž*+ 176*144 'a1pn ;;? PN QCIF Vc ;;?? o*1?. 8*/ B?&'> 29/97) 8'*/ ˆ' 30 mr N.& *$3& CIF Vc QCIF 36/45 Mb/s 6/ / CIF (. /*$+ 8? & &R '& S T-'? 1/5 Mb/s,/? 7 &.& 9/115Mb/s 6/ CIF m'pn.'& '*$>& 24 :1 '? (128 kb/s) p=2,/? 7 & n. 8*i (p=6) 384 kb/s & :* 6/,& & '?> Z'P` ' DPCM DCT ')F& & *?' 7 & H.261 5;;?? "w'?'.& &./ 3 a 8? c/j ;? Q$& ' & Intra.? Inter Intra & a Mi 8 /& o'f/ ' m ';$ D Q$& ˆ ZF& "w? *'+,& c3 & 8? c3 $/& & Q$& ˆ.;? (_1- ; Q$& &.?? & & 8191 & & $3 7 & H.261 "'1 "w?' (GOB) T?1 _ $3 %&.;? ' 8/I /& 8? 9a*+ & 8*8 onp "1 7. (y) 8*8 'D& Luminance "1 4 & "w? 7. C r C b y "w?' ' GOB 7. *a (C r & C b ) Chrominance "1.'' GOB %';U ' ' 7'. n&$ c %;U "1.;? 0D &? * 8$ syntax H.261 &/$&..,/ EOB wn 7 "1 7 & (DCTCOEFF)DCT 8QFY GOB 7'.'& "w? ; 7 "1 6 & "w?. 8$3.,/ GOB. "w? GOB ;? & ' GOB & n&'$ & 8& 8? & ; 7 p.;.,/ MPEG-1 #% # -3-2 pels ) SIF ' "#$! 7.? (3X =; 8 MPEG-1 &/$& ' >&q 1/5Mbps 6/ ( 352*240 pels for y 176*120 for C r & C b at 30 fps.&. & b MPEG-1 [ & %& S\& 5 8&& 6 )"* $#+ C $" " Q$& wn 8? & %& H.261 MPEG 1 Z & MQ & a ƒw' 8'?) ;? Q$& G*/ D ˆ & 1 ˆ &?>.& - & '1 ˆ' ' & /& - ˆ 1? c.(&? ' '*/ MPEG 8$9' ZP`.&;D PN %&. ZP` D I ' ';?? 01$2 8 &! 7 ˆ MPEG-1. GOP ' 8'ac / L*9R GOP 8 ˆ.B p a' ; L*9R %&. B P %;U I 7 ' ' ' S'\& 01$2 & 8? *1PN.& &./ 4./ & V*W 8&& :* M*!G- 7' & Q$'& ') ' '3 & I 7 : (I) Intra picture 8*8 "'1 ' JPEG L$)F& ;/j. (JPEG 8 CE 342 Multimedia HW# 6 7

8 DCT ' 8'QFY ('_ ' &' DCT 16*16 "1? 7 ' ' zig-zag M'i 8 G*$/&? 8QFY %&./ *F ( R runlength. Qi 8QFY & runlength %:v / &' I './? J;*j.?? & Q$& Qi. Q$& š *$.a& 4& & GOP ˆ ZF& MPEG-1 GOP D :4/01 8' 8*)?>.& - 7*;a & %& : (P) Unidirectional Predicted Pictures & "w?' '.';? Q$& & (H.261 &/$& 'c3.';? Q$&?> & 7. ZP` & 1 I P G*$/&'? DCT ' 8QFY DCT & Q$&. ZP`./ runlength & '?>.& '- / 8 & a %& : (B) Bidirectionally predicted picture. a "w? &?>.& - Interpolative.& - / ^+?>.& - / *+?>.& -.';? ' Q$& (P B) 1 P I & / *+?' 8'? ';? Q$& D MNwq& & / ^+?>.& - ' ZP` D P I rc; "1 %:v - "1 ' r'c; 'T?1 %':v Z' (_ [$ & Interpolative.& -. 5 a' 8$T-?>.& -.;? Q$& D 1.& &./ CE 342 Multimedia HW# 6 8

9 6 )"* $#+,-. :5 /01 '1 GOP & w'q&. ;/& GOP 7 ˆ o*1? 8? \ & fast forward 7.š *$ & & & 8+ >& GOP 7 /?& 7'. S\& P I I T;.??& /&. S\& I T;??& /& G*/ fest rewind Half-Pel )E! )"*, ' MPEG-1?> & 8? & %& H.261 MPEG-1 Z ) }w$3& pel L*'/ &G'& ' '? ~$9-7 ]D. ZP` half-pel M'i %& 8?> ZP`.V*#i N 5&/& 8 &G& 8/ S\& */ 8 L n. & ZP` c3?.a& & r* 8 3 %& 8? & *$>& half-pel.a 8/I *F & 1 ˆ.& */ integer-pel?> ZP` F> 8 9/ :* Ms MPEG-2 $" " #% # -4-2!'.'?? & MPEG-2 &/$& & 8R 8? c/j MPEG-1 8 MPEG-2.?? o*f&.& bc CCTR601 L*R$9 & Q$& "w? 8? 8 GOP $3 & '? (B ) 8q ZP` (P ) 8q 7 ZP` (I ) DCT CCTR601!' Z' '& }w$'3& :* spatial & 8$ _. 8'? ' %&.& CCTR601! interlacing & Q$& CIF/SIF ' %&';.' *{*+ T- c &+.& '- 'a1pn 8? & bc interlaced.?,:;? & i3. [1] :* M*!G-. (*O & DCT?> ZP`.';?,'; & 01$2 %F bc! /& MPEG-2 & :'* ' *1 8? & Q1$2 profile && &/$& %& (mp@ml) 1'i& Vc' 1'i& profile 8' T'; žÿ.& _ *$3& '? Vc 1i& profile & Q$& HDTV,;)* 7.& & scalability profile MPEG-1 ' 89R MPEG-2 ) LT od 7. o' 7' 1'i& o' 7' M 8? &! 7 8? & '1*Pa o ;? 4& & 8+ *Q*? 1i& o.? 1*Pa 7. v & *Q*? /& G& 1i& o 8 8a*); 8a /& scalability & Q$& MPEG-2?! ' *1 /(_ & 01$2 / ;< [ 8? Q1$2 Vc 01$2 profile 6 a. R$; 01$2 spatial.;? 8iw3 & / /*$+ MPEG2 CE 342 Multimedia HW# 6 9

10 MPEG-2 ) G profile F8 :6 /01 H #% # -5-2 Intel s Indeo I'? Intel Architecture Labs [' 8'? '& &G'& S'/ F;a 7 Indeo! 10 ' 5 & & '/,$*4! 5&/& *F Microsoft s video for ';/ 's 'F;a %'&.? &.& /~;_ Apple s Quicktime windows Loos less Lossy ' ' 7'*;a '/ %';U & Indeo 'F;a &. ' '.Gj c &! Indeo F;a.;? Q$& 8 */ / 5& %&; ;? video capture board rq! Z 7 & z EF/!.&/ & 79. (3X r'q & NTSC ';/ &/$& / G*F 7 VCR,'$*4 ' 8' Intel smart video Recorder board 7' ';/ video capture board. :(;$9*/ &GF& p ) & >& Indeo.[$ J/ &R 7 8 9a*+ >9? & yuv & 8/I -1 ('3X r'q & &.? L? & / 9a*+ }w$3& -2 ' %&).&? (*O ˆ 9a*+ Z 8? Nwq& T;.? (. S\& &.*&G*$/&? & ˆ }w$3&.? G*$/&?.? & run-length.?? -3 8' M'Nwq& & M'Q$ o'np 7? & variable content.?? -4.* z &D 'B &/$'& ' 7 rq &i MNwq&,$*4! ' ('3X A 79 *? Apple s Quicktime Microsoft s AVI. g. V*#. A+ & /& *?.!' ' 8G &i! P9 8.? A+ & 'I ' ' '?& (' M*1PN ^an) &D 7 rq &. 9*,$*4! 8 e D&,$*4 9a*+ :& ;N &? Y N 8 CE 342 Multimedia HW# 6 10

11 (3 9a*+ 9> playback 5~;+ 5&/& (2 9+a* N (1 ˆ 6/ ' 'D*q!' ' 8'? žn playback 5~;+. :au? & :'* ˆ' 6/ :_G playback ~;+ 9+a*.; '.:' &' ˆ' :D 6/ ]D & scalable Indeo.;? F;a.;? L& & :* &+ M Apple s Quicktime S'!' end-user desktop ' L$9* & L? o;g Quicktime,s 'q 8' &. ^'an PN Apple..O& 8 & "#$ ' ' & 'a &.? G*$/&?.? *+ &G& S/ l'&.'a& %'&.& - Quicktime 8? & &G& S/ L&' & &G'& A' 7'P?.' 30 frame/sec 320*240! 200 ' 25 Z ; %& 8? 9/.;?.& Microsoft AVI L'? o';g L?! 4& Microsoft AVI & } Quicktime ;/j AVI '& 'N L$9'* & zp9' 8'? Quicktime }w3.& desktop T'; '> & 7.&;D AVI.& 0D &G Vc. 7.&;D!' Super VGA VGA $*/ & >&q &G& S/ :'* ' [ s VCR 8a*); AVI. I & *i3 7.& N.G1,;)* 7 & :P? mpn 89R.&. Scalability, AVI LT. %' o' Q$'& ' &G'& A 8 )$9 AVI &?.'&. ^'an &G& S/ L$)F& %;U AVI.& ) 3 8a*F> /& 8;*v?> & L$)F& %& & 3./& 8;*v! & '*Q*? ˆ' 6'/ ~;+ 5&/& ya$/& & dialog box %;U AVI ' 8' AVI 8? z*q*?. & *$3& L$)F& '& ' 8'? '-.& 89R Quick Time *Q*?.;$9 )a 8* 1*3 Š ;;? PN Q$ F;a Intel s DVI '? '\ &.'& &G'& A' &/$'& 7' Intel s Digital Video Interface DVI ) '/& ' ' '*+ &G'& S/ c - &/$& M'*!G- ('& & & > &/$&.&;N 8 & 3 *j&.& / bc ~;& %& & 8A9'/ 7' ';/& ' ;$9' ';PwN &/$& %& 8 8? &&.;I 8DFc &. M*!G- 8*d & &/$& J K 8'? *9'; & 8'/!' o'f/ 7 & ˆ l& -1 (015) (00) "'1,B &) 16*16 "1 ZF& & &?> & g'& & '*/&u & ˆ'.';? &*+ ˆ Z (1515) (150) S-start BK-location BK-size B,A ':&+ *;? Q$& fread() fopen () '=/.'& ' A '*+ 8? EBLK() g.&;d & S-end 'A "'1 &' &?> & /& 8? & D EBLK.().() =/ c & ~$9-5s */&.;? &*+ '& 8'aq *;? *Pa & 8$/ 1 P9 8? & & 8/ -2 ('3X &' D 2 &) ˆ "1 S & &?> -3 CE 342 Multimedia HW# 6 11

12 ((mv-y) & () mv-x & a & */?> & o*1?.*;? L quiver ()g & Q$& &?>.&*. Z'P` 8aq *;? *Pa & &8$/ 2 P9 8? & 8/ -3 ' Z*D),& ˆ & e "1.?? & S ˆ & ZP` S ˆ 1i& ˆ. S ˆ (?> & [ c3 1i& ˆ Z (9a*+ c3 r1c ) c3 & '?>.&*.* I & 1i& S ˆ ZP` S ˆ Z ' & PSNR &'R Z;'{j.* I 1c quiver $ 7P?.*;? 8s & - 1i& c3 : 0D M PSNR.& (m,n) 9a*+ c3 &R e(m,n). 8? }w$'3& '?>.&* ZP` & 3 M& o*1? Z'P` artifact / 8U.*9; PSNR R c3 Z 9*U. 1N *;? P9 g& 8/ %&.*/&u & B *+ encode.m o/ -4 8'/ %'&.'& ' */ getprediction () S; 8? /&3 & & 3 ' & 8*8 DCT '.' S\& c3 & DCT DCT,& o'qfy ';U.*;?,PN& P` c3 "1 S 8 8? & ZP` c3 D & 8)/ & "1 Z' PNR. & *;? 8W& ZP` '? *Q*? 8s 1i& oq*š./ 8? * V*W $ [3 mqcf. 9*U $ [3. W o~*$/ / &T)/ & S 8? 8QFY &D &> -5 Q$'& G'*/ PSNR os &.& ) =/ & u.?? %& Z;{j *;? &*+ & (.& S db & :* PSNR 8?? ' & 8*8 DCT a S 1i& ˆ & L*R$9 c & DCT 8')/ & DCT,& o'qfy ;U *;?,PN& S 1i& ˆ T?1 & 7 ' 'u 'W o'~*$/ 8? & */ 8QFY &> &D.& 89'R & 'F> %'& S ' 8QFY &> *;? &*+ ; ' DCT ' 8'QFY & /9'a &'D.?? 8? *;?.*;? :'v '*Q*? S&?? &3 } & /9a * &D "1 & &3.9a * 6/ & =#5L-4.'* ' & 3 p /* $/ o*1? matlab? -1.& W. V*W M& 8!&& S\&?>.& - ZP` &$& npd!.?? L$9* 7-2 ' %'&.' '? DCT & Q$&. ZP` c3 D,'PN& 8 9/ c3 DCT? & Q$& 8? & %& &.& :P? * 6/ 8 *$>& L*R$9 c 1i& DCT matlab o'/ 7 & Q$& */& & V*#i &.$A+ #i 8? * S\& s (.*;? 89R & P9 5 4 P9 $/) M# -5 CE 342 Multimedia HW# 6 12

13 :9 -N -6 :'# --N encode.m M! O#L P! CE 342 Multimedia HW# 6 13

14 :Q --N CE 342 Multimedia HW# 6 14

15 CE 342 Multimedia HW# 6 15

The Scope of Picture and Video Coding Standardization

H.120 H.261 Video Coding Standards MPEG-1 and MPEG-2/H.262 H.263 MPEG-4 H.264 / MPEG-4 AVC Thomas Wiegand: Digital Image Communication Video Coding Standards 1 The Scope of Picture and Video Coding Standardization