Temporal Quality Assessment for Mobile Videos

Transcription

1 Temporal Quality Assessment for Mobile Videos An (Jack) Chan, Amit Pande, Eilwoo Baik, Prasant Mohapatra Department of Computer Science, University of California, Davis

2 Videos are Everywhere Cisco s Virtual Network Index In 2011, video traffic accounted for more than 50% in mobile networks Evaluating mobile video quality becomes a hot topic Important for content providers and network services providers onbile.com

3 Assessing video quality Snap shot A Snap shot B

4 Assessing Video Quality Subjective video quality metrics Mean Opinion Score (MOS): Ranging from 1 to 5 Evaluated by human viewers High cost Objective video quality metrics Evaluated by computer programs To approximate subjective measurement, MOS

5 Evaluation for Mobile Videos Low computational power requirement Video codec independent Network impairment estimation No original (reference) videos Correlated to subjective scores greenwala.com storage-news.com sciencedirect.com

6 Outline Objective Video Quality Temporal Variation Metric (TVM) Measure temporal information at low cost Temporal Variation Index (TVI) Reduced-reference video quality metric Estimates subjective video quality Estimates network impairments

7 Spatial and Temporal Quality Spatial quality assessment Blocking and blurring Image quality measurement Pixel-by-pixel comparison (e.g. PSNR, SSIM) Temporal quality assessment Jerkiness and freezing Optical flows More pervasive in wireless mobile networks sciencedirect.com

8 Related Work Partially evaluated [Vidal2006][Yang2007] Focus on the effect from network packet loss No high correlation to subjective scores Modeling human visual system e.g. MOVIE [Sesha2010] Evaluate both spatial and temporal quality High complexity Require original copies Motion Vector Reuse [Moorthy2010] Codec-dependent

9 Measuring Temporal Information Temporal Variation Metric (TVM) Difference between two neighboring frames Difference Frame p-1 Frame p Other consecutive frame comparison techniques Temporal versions of SSIM, ESS VSNR TSSIM, TESS and TVSNR

10 Searching for the Best Candidate Test with video clips Length from 10 to 60 seconds Resolution from 352X288 to 1920X1080 Motion degree from slow to very fast

11 TVM Outperforms the Others

12 Temporal Variation Index (TVI) An Reduced-Reference Temporal Quality Metric TVM of the original video TVM of the received video From out-ofband control channel, e.g. RTCP sender report TVI Calculated locally

13 Subjective Experiments Derivation Developed an Android app Engaged 17 volunteers Collected 50 video clips (3 motion groups) Measured Mean Opinion Score (MOS) Calculate TVM and TVI adroid.com

14 Estimating Quality of Experience Strong linear correlation Moderate motion Slow motion Pearson correlation coefficient ranges from 0.87 to 0.96 Fast motion

15 Network Experiments Set up an n single-hop testbed Streaming videos (3 motion groups) Introduce packet loss and delay Calculate TVM and TVI Collect 183 video samples

16 Detecting Packet Loss Causes blocking, blurring and freezing TVM in received video is inconsistent with that in the original video Freezing leads to infinite TVM

17 Detecting Packet Loss Causes blocking, blurring and freezing TVM in received video is inconsistent with that in the original video Freezing leads to infinite TVM

18 Estimating Packet Loss Rate Strong linear correlation Slow motion Moderate motion Evaluated with 45 videos Pearson correlation coefficient ranges from 0.90 to 0.96 Fast motion

19 Detecting End-to-End Delay Results in freezing Infinite TVM values TVM of the received video is like a delayed version of that of the original video

20 Estimating End-to-End Delay delay happens Evaluated by randomly chosen videos The average accuracy rate ~ 95%

21 Conclusions TVM to measure the temporal information at low cost Derive TVI as a quality and network condition predictor TVI is highly correlated with MOS (0.925) TVI is highly correlated with packet loss rate (0.94) Predict end-to-end delay with 95% accuracy

22 References [Vidal2006] R. Pastrana-Vidal and J. Gicquel. Automatic quality assessment of video fluidity impairments using a no-reference metric. In Proc. of Int. Workshop on Video Processing and Quality Metrics for Consumer Electronics, [Yang2007] K.-C. Yang, C. Guest, K. El-Maleh, and P. Das. Perceptual temporal quality metric for compressed video. Multimedia, IEEE Transactions on, 9(7): , nov [Sesha2010] K. Seshadrinathan and A. C. Bovik. Motion tuned spatiotemporal quality assessment of natural videos. IEEE Trans. on Image Processing., [Moorthy2010] A. K. Moorthy and A. C. Bovik. Efficient video quality assessment along temporal trajectories. IEEE Trans. Circuits Syst. Video Techn., 20(11): , 2010.

23 Thank you Questions and Answers