Luma Adjustment for High Dynamic Range Video. Jacob Ström, Jonatan Samuelsson, Kristofer Dovstam Ericsson Research

Size: px
Start display at page:

Download "Luma Adjustment for High Dynamic Range Video. Jacob Ström, Jonatan Samuelsson, Kristofer Dovstam Ericsson Research"

Transcription

1 Luma Adjustment for High Dynamic Range Video Jacob Ström, Jonatan Samuelsson, Kristofer Dovstam Ericsson Research

2 outline Luminance (Y) and luma (Y ) Strange things that happen during subsampling How to do subsampling without artifacts Implementation details Applications Bonus? Ericsson Internal Page 2

3 luminance Assume linear (R, G, B) tuple (think linear output of red source, etc ) Luminance is weighted average = + + Linear How bright Y in CEI1931 XYZ color space = 3 3 Ericsson Internal Page 3

4 Luma Non-linear values (R, G, B ): = or = = or = = or = Luma is weighted average = + + Non-linear Not how bright Y in Rec.709 and BT.2020 Y CbCr = 3 3 Ericsson Internal Page 4

5 Preprocessing Ericsson Internal Page 5

6 Preprocessing Ericsson Internal Page 6 inverse gamma a.k.a. inverse Electro Optical Transfer Function (EOTF -1 ). We use SMPTE ST 2084 (PQ)

7 Preprocessing Ericsson Internal Page 7

8 Preprocessing Ericsson Internal Page 8

9 Preprocessing Ericsson Internal Page 9

10 POST PROCESSING Ericsson Internal Page 10

11 POST PROCESSING Ericsson Internal Page 11

12 POST PROCESSING Ericsson Internal Page 12

13 POST PROCESSING Ericsson Internal Page 13

14 POST PROCESSING Ericsson Internal Page 14

15 artifacts original 4:4:4 subsampled to 4:2:0 (no compression!) Ericsson Internal Page 15 Sequence courtesy of Technicolor and the NevEx project

16 Artifacts Spotted by E. Francois in an MPEG contribution Also noted that the effect is biggest for saturated colors Ericsson Internal Page 16

17 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 Ericsson Internal Page 17

18 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 Ericsson Internal Page 18

19 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 Quite similar Quite different Ericsson Internal Page 19

20 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Ericsson Internal Page 20

21 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 After converting back to RGB: = 1001, 0.48, Ericsson Internal Page 21

22 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 After converting back to RGB: = 1001, 0.48, Quite similar Ericsson Internal Page 22

23 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 After converting back to RGB: = 1001, 0.48, Quite similar Ericsson Internal Page 23

24 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 After converting back to RGB: = 1001, 0.48, Conclusion: Just averaging is not a problem. Quite similar Ericsson Internal Page 24

25 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Average Cb/Cr, copy Y : 1= 2= Ericsson Internal Page 25

26 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Average Cb/Cr, copy Y : 1= 332, 608.5, 783 2= 332,608.5,783 Ericsson Internal Page 26

27 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Average Cb/Cr, copy Y : 1= 2= 332, 608.5, , 608.5, 783 After conversion back to RGB: 1= 484, 0.03, 45 2= 2061, 2.2, 216 Ericsson Internal Page 27

28 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Average Cb/Cr, copy Y : 1= 2= 332, 608.5, , 608.5, 783 After conversion back to RGB: 1= 484, 0.03, 45 2= 2061, 2.2, 216 Way too dark! Ericsson Internal Page 28

29 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Average Cb/Cr, copy Y : 1= 2= 332, 608.5, , 608.5, 783 After conversion back to RGB: 1= 484, 0.03, 45 2= 2061, 2.2, 216 Way too bright! Ericsson Internal Page 29

30 What is happening? Two neighboring pixels: 1= 1000, 0, 100 2= 1000, 4, 100 After conversion to Y CbCr: 1= 263, 646, 831 2= 401, 571, 735 After averaging = 332, 608.5, 783 Average Cb/Cr, copy Y : 1= 2= After conversion back to RGB: 1= 484, 0.03, 45 2= 2061, 2.2, 216 Conclusion: 332, 608.5, , 608.5, 783 Subsampling of two components and copying of third component creates trouble. Ericsson Internal Page 30

31 Main idea Y will make pixels too dark or too bright But! We can set Y individually for each pixel. Why not set it so that the pixel is just as bright as the original? This means matching luminance Y Task: Find Y (luma) that gives the right Y (luminance) We call it Luma Adjustment Ericsson Internal Page 31

32 Overview linear preprocessing 4:2:0 post processing linear RGB to XYZ linear luminance RGB to XYZ linear luminance 4:2:0 subsampling not really preserving Ericsson Internal Page 32

33 first approach Y is an integer in [0, 1023] (or [64, 940] in standard range). Try all Y values and see which generates the best luminance Y Very slow... Lucky thing: Luminance Y is monotonously increasing with Y If Y gives something that is too bright, the optimum Y must be smaller than that value Ericsson Internal Page 33

34 luma adjustment linear preprocessing 4:2:0 post processing linear RGB to XYZ linear luminance compare and if too big, lower RGB to XYZ linear luminance if too small, increase Ericsson Internal Page 34

35 binary search 940 We know the value must be between 64 and Ericsson Internal Page 35

36 binary search We know the value must be between 64 and 940 We try the middle value (64+940)/2 = Ericsson Internal Page 36

37 binary search We know the value must be between 64 and 940 We try the middle value (64+940)/2 = 502 If = 502 generates a linear luminance that is too bright, we know the best must be in [64, 502] Ericsson Internal Page 37

38 binary search We know the value must be between 64 and 940 We try the middle value (64+940)/2 = 502 If = 502 generates a linear luminance that is too bright, we know the best must be in [64, 502] If = (64+502)/2 = 283 makes too dark, should be in [283, 502] etc. Ericsson Internal Page 38

39 binary search We know the value must be between 64 and 940 We try the middle value (64+940)/2 = 502 If = 502 generates a linear luminance that is too bright, we know the best must be in [64, 502] If = (64+502)/2 = 283 makes too dark, should be in [283, 502] etc. 10 iterations instead of 1024 Ericsson Internal Page 39

40 Further refinement: Bounds The fact that the EOTF is monotonously increasing can be used to create a lower and upper bound on Y given Y: Upper Lower +max, +,,, +min, +,,, An even tighter upper bound can be used due to the EOTF being convex. Ericsson Internal Page 40

41 Further Refinement: Bounds Ericsson Internal Page 41

42 Further Refinement: Bounds 940 Upper bound Calculate bounds Lower bound Ericsson Internal Page 42

43 Further Refinement: Bounds 940 Upper bound Calculate bounds Continue interval halving from there Lower bound Ericsson Internal Page 43

44 Further Refinement: Bounds 940 Upper bound Calculate bounds Continue interval halving from there Average number of iterations in a test sequence: < 5 iterations 64 Lower bound Ericsson Internal Page 44

45 Further Refinement: Bounds 940 Upper bound Calculate bounds Continue interval halving from there Average number of iterations in a test sequence: < 5 iterations 64 Lower bound Tighter bounds < 2 iterations Ericsson Internal Page 45

46 Further Refinement: Bounds 940 Upper bound Calculate bounds Continue interval halving from there Average number of iterations in a test sequence: < 5 iterations 64 Ericsson Internal Page 46 Lower bound Tighter bounds < 2 iterations Other approches: LUTs, linearizations

47 results We do not have any material that fills out the BT.2020 color container. In the future, we will have such material. Example images are created using Rec.709 container and material that fills out the Rec.709 gamut. Ericsson Internal Page 47

48 examples Reduced artifacts Original 4:4:4 Traditional subsampling (no compression) Luma Adjustment (proposed method) Ericsson Internal Page 48 Sequence courtesy of Technicolor and the NevEx project

49 examples Original 4:4:4 Traditional subsampling (no compression) Luma Adjustment (proposed method) Ericsson Internal Page 49 Sequence courtesy of Technicolor and the NevEx project

50 Compressed examples Original 4:4:4 Traditional Processing (18752 kbps ) Luma Adjustment (17700 kbps) Ericsson Internal Page 50 Sequence courtesy of Technicolor and the NevEx project

51 Compressed examples Original 4:4:4 Ericsson Internal Page 51 Traditional Processing (26568 kbps) Sequence courtesy of Technicolor and the NevEx project Luma Adjustment (26142 kbps)

52 Applications Encoding for HDR10 (HEVC Main 10, ST 2084, Y CbCr) Transmission chain Receiver chain unchanged Luma Adjustment Ericsson Internal Page 52

53 applications Conversion for display using HDMI 2.0a Any HDR decoder Conversion to Y CbCr 4:2:0 HDMI 2.0a 4k 60 Hz Y CbCr 4:2:0 Traditional RGB to Y CbCr conversion here......gives bad artifacts here. Ericsson Internal Page 53

54 applications Conversion for display using HDMI 2.0a Any HDR decoder Conversion to Y CbCr 4:2:0 HDMI 2.0a 4k 60 Hz Y CbCr 4:2:0 Luma Adjustment here......gives good picture here. Ericsson Internal Page 54

55 Other EOTFs We tried this for SMPTE ST What about other transfer functions? Hybrid Log Gamma (ARIB B67) Ericsson Internal Page 55

56 Hybrid log gamma Original 4:4:4 Traditional subsampling (no compression) Luma Adjustment (proposed method) Ericsson Internal Page 56 Sequence courtesy of Technicolor and the NevEx project

57 Other EOTFs We tried this for SMPTE ST What about other transfer functions? Hybrid Log Gamma What about Standard Dynamic Range (SDR) (Rec 1886)? Ericsson Internal Page 57

58 SDR (1886) original 4:4:4 traditional processing Luma Adjustment Ericsson Internal Page 58

59 SDR (1886) original 4:4:4 traditional processing Luma Adjustment Ericsson Internal Page 59 Sequence courtesy of Technicolor and the NevEx project

60 conclusion Due to non-linearity of transfer function, artifacts appear during subsampling from 4:4:4 to 4:2:0 Worse for HDR since transfer function is more non-linear It is possible to adjust Y to match luminance in each pixel Since Y is monotonous in Y, binary search can be used Mathematical bounds further lower number of iterations Applications are preprocessing for compression and conversion to HDMI 2.0a. Some noise and blurring in 4:2:0 SDR data can be due to the processing from 4:4:4 to 4:2:0. MPEG anchors Ericsson Internal Page 60

61

62 HDMI 2.0 and hdmi 2.0a For 4K resolutions at Hz, 4:2:0 is necessary. HMDI 2.0a specifies HDR through pointing to the CEA specification. Ericsson Internal Page 62

63 Y easier to code Y traditional processing Y after Luma Adjustment Ericsson Internal Page 63

Chroma Adjustment for HDR Video. Jacob Ström, Per Wennersten Ericsson Research

Chroma Adjustment for HDR Video. Jacob Ström, Per Wennersten Ericsson Research Chroma Adjustment for HD Video Jacob Ström, Per Wennersten Ericsson esearch Video representation scene Ericsson Confidential Ericsson A 2016 2015-05-13 Page 2 Video representation scene camera sensor Ericsson

More information

HDR10+ Technology & Content Tools SAMSUNG July 2018

HDR10+ Technology & Content Tools SAMSUNG July 2018 1 HDR10+ Technology & Content Tools SAMSUNG July 2018 HDR systems deployed since 2015. HDR Supported by HDR10+ Studio masters delivered in PQ encoding. Perceptual Quantizer. PQ Enables content creators

More information

Texture Compression. Jacob Ström, Ericsson Research

Texture Compression. Jacob Ström, Ericsson Research Texture Compression Jacob Ström, Ericsson Research Overview Benefits of texture compression Differences from ordinary image compression Texture compression algorithms BTC The mother of all texture compression

More information

Цепочка доставки UHD. Boris Yurin Account manager TV and Media

Цепочка доставки UHD. Boris Yurin Account manager TV and Media Цепочка доставки UHD Boris Yurin Account manager TV and Media Ericsson Consumer Lab annual research 100,000 RESPONDENTS REPRESENTING 1.1 billion PEOPLE 40 MORE THAN COUNTRIES 15 STUDIED MEGACITIES Importance

More information

RATE DISTORTION OPTIMIZED TONE CURVE FOR HIGH DYNAMIC RANGE COMPRESSION

RATE DISTORTION OPTIMIZED TONE CURVE FOR HIGH DYNAMIC RANGE COMPRESSION RATE DISTORTION OPTIMIZED TONE CURVE FOR HIGH DYNAMIC RANGE COMPRESSION Mikaël Le Pendu 1,2, Christine Guillemot 1 and Dominique Thoreau 2 1 INRIA 2 Technicolor Campus de Beaulieu, 5042 Rennes Cedex France

More information

UHD Herausforderungen an die Bildaufnahmetechnik und Lösungsmöglichkeiten FKTG Regionalgruppe Thüringen / November 2016

UHD Herausforderungen an die Bildaufnahmetechnik und Lösungsmöglichkeiten FKTG Regionalgruppe Thüringen / November 2016 UHD Herausforderungen an die Bildaufnahmetechnik und Lösungsmöglichkeiten FKTG Regionalgruppe Thüringen / November 2016 Klaus Weber Senior Product Marketing Manager, Cameras Agenda UHD and the challenges

More information

Apple ProRes RAW. White Paper April 2018

Apple ProRes RAW. White Paper April 2018 Apple ProRes RAW White Paper April 2018 Contents Introduction 3 About Raw Video 4 Data Rate 6 Performance 8 Using ProRes RAW in Final Cut Pro 12 Using Log Conversion with Built-in Camera LUTs 13 Using

More information

Motivation. Intensity Levels

Motivation. Intensity Levels Motivation Image Intensity and Point Operations Dr. Edmund Lam Department of Electrical and Electronic Engineering The University of Hong ong A digital image is a matrix of numbers, each corresponding

More information

Dolby Vision. Profiles and levels V1.2.9

Dolby Vision. Profiles and levels V1.2.9 Dolby Vision Profiles and levels V1.2.9 1 June 2017 Contents Contents 1.1 Copyright 3 1.2 Intentionally blank 4 1.3 Trademarks 5 1 Introduction to Dolby Vision bitstreams profiles and levels 6 1.1 Standards

More information

How Many Humans Does it Take to Judge Video Quality?

How Many Humans Does it Take to Judge Video Quality? How Many Humans Does it Take to Judge Video Quality? Bill Reckwerdt, CTO Video Clarity, Inc. Version 1.0 A Video Clarity Case Study page 1 of 5 Abstract for Subjective Video Quality Assessment In order

More information

Setup Guide. Samsung 2017 QLED TVs. Rev. 1.6

Setup Guide. Samsung 2017 QLED TVs. Rev. 1.6 Setup Guide Samsung 2017 QLED TVs Rev. 1.6 Introduction CalMAN can automatically calibrate a 2017 Samsung QLED TV s two-point white balance controls, 10-point grayscale controls, and CMS color gamut controls,

More information

Dolby Vision. Profiles and levels

Dolby Vision. Profiles and levels Dolby Vision Profiles and levels V1.2.92 21 October 2017 Contents Contents 1.1 Copyright... 3 1.2 Trademarks...4 1 Introduction to Dolby Vision bitstream profiles and levels...5 1.1 New in this version...5

More information

Analysis and extensions of the Frankle-McCann

Analysis and extensions of the Frankle-McCann Analysis and extensions of the Frankle-McCann Retinex algorithm Jounal of Electronic Image, vol.13(1), pp. 85-92, January. 2004 School of Electrical Engineering and Computer Science Kyungpook National

More information

VPSG summary report to FES-TF - draft 2013/9/11

VPSG summary report to FES-TF - draft 2013/9/11 VPSG summary report to FES-TF - draft 2013/9/11 Video Performance Study Group (VPSG) Charter To study input from members and invited experts and provide a r ecommendation to FEST on The video parameters,

More information

How to: Objectively Scoring Your Video

How to: Objectively Scoring Your Video How to: Objectively Scoring Your Video Video Clarity, Inc. Version 2.0 A Video Clarity Application Note page 1 of 9 ClearView has the ability objective score the video quality, graph the result, and show

More information

Read this first. Product documentation. New features in firmware version 3.4.X. Covered products. version *P *

Read this first. Product documentation. New features in firmware version 3.4.X. Covered products. version *P * Product documentation Covered products The following Tektronix products are covered by this document: WFM7200 Waveform Monitor WVR7200 Waveform Rasterizer Product documentation version Your instrument

More information

Perceptual Color Volume

Perceptual Color Volume Perceptual Color Volume Measuring the Distinguishable Colors of HDR and WCG Displays INTRODUCTION Metrics exist to describe display capabilities such as contrast, bit depth, and resolution, but none yet

More information

Dolby Vision. Profiles and levels

Dolby Vision. Profiles and levels Dolby Vision Profiles and levels V1.2.93 20 April 2018 Contents Contents 1.1 Copyright... 3 1.2 Trademarks...4 1 Introduction to Dolby Vision bitstream profiles and levels...5 1.1 New in this version...5

More information

Video Codecs. National Chiao Tung University Chun-Jen Tsai 1/5/2015

Video Codecs. National Chiao Tung University Chun-Jen Tsai 1/5/2015 Video Codecs National Chiao Tung University Chun-Jen Tsai 1/5/2015 Video Systems A complete end-to-end video system: A/D color conversion encoder decoder color conversion D/A bitstream YC B C R format

More information

Multimedia Systems Image III (Image Compression, JPEG) Mahdi Amiri April 2011 Sharif University of Technology

Multimedia Systems Image III (Image Compression, JPEG) Mahdi Amiri April 2011 Sharif University of Technology Course Presentation Multimedia Systems Image III (Image Compression, JPEG) Mahdi Amiri April 2011 Sharif University of Technology Image Compression Basics Large amount of data in digital images File size

More information

INF5063: Programming heterogeneous multi-core processors. September 17, 2010

INF5063: Programming heterogeneous multi-core processors. September 17, 2010 INF5063: Programming heterogeneous multi-core processors September 17, 2010 High data volumes: Need for compression PAL video sequence 25 images per second 3 bytes per pixel RGB (red-green-blue values)

More information

F O R C O N T E N T C R E AT O R S

F O R C O N T E N T C R E AT O R S FOR CONTENT CREATORS DOLBY VISION CER TIFIED FACILITIES 2 A new era of storytelling The transition from standard dynamic range (SDR) to high dynamic range (HDR) represents as significant a change as the

More information

DigiPoints Volume 1. Student Workbook. Module 8 Digital Compression

DigiPoints Volume 1. Student Workbook. Module 8 Digital Compression Digital Compression Page 8.1 DigiPoints Volume 1 Module 8 Digital Compression Summary This module describes the techniques by which digital signals are compressed in order to make it possible to carry

More information

IT Digital Image ProcessingVII Semester - Question Bank

IT Digital Image ProcessingVII Semester - Question Bank UNIT I DIGITAL IMAGE FUNDAMENTALS PART A Elements of Digital Image processing (DIP) systems 1. What is a pixel? 2. Define Digital Image 3. What are the steps involved in DIP? 4. List the categories of

More information

HDR and Dolby Atmos Support for DTA-2195

HDR and Dolby Atmos Support for DTA-2195 Application Note DT-AN-2195-1 HDR and Dolby Atmos Support for DTA-2195 1. Introduction The DTA-2195 12G-SDI input and output with HDMI 2.0 output is a PCI-Express adapter for interfacing 4K-UHD signals

More information

CIE Colour Chart-based Video Monitoring

CIE Colour Chart-based Video Monitoring www.omnitek.tv IMAE POCEIN TECHNIQUE CIE Colour Chart-based Video Monitoring Transferring video from one video standard to another or from one display system to another typically introduces slight changes

More information

HDR (High Dynamic Range)

HDR (High Dynamic Range) HDR (High Dynamic Range) Introduction A big wave of change is coming to live image production this is the new trend of 4K and even higher 8K resolution content creation. Aligned with this trend, live image

More information

HDMI/HD-SDI/VGA H.264/H.256 HEVC

HDMI/HD-SDI/VGA H.264/H.256 HEVC 1/16 chs HDMI/HD-SDI/VGA H.264/H.256 HEVC r Model: MagicBox HD4N Series HDMI input HD-SDI input VGA input 16 channels HD-SDI input 1 16 channels HDMI input Product Profile MagicBox HD4 N series The HD

More information

Motivation. Gray Levels

Motivation. Gray Levels Motivation Image Intensity and Point Operations Dr. Edmund Lam Department of Electrical and Electronic Engineering The University of Hong ong A digital image is a matrix of numbers, each corresponding

More information

Advanced Video Coding: The new H.264 video compression standard

Advanced Video Coding: The new H.264 video compression standard Advanced Video Coding: The new H.264 video compression standard August 2003 1. Introduction Video compression ( video coding ), the process of compressing moving images to save storage space and transmission

More information

Overview: motion-compensated coding

Overview: motion-compensated coding Overview: motion-compensated coding Motion-compensated prediction Motion-compensated hybrid coding Motion estimation by block-matching Motion estimation with sub-pixel accuracy Power spectral density of

More information

WV-SF335/WV-SF336 WV-SP305/WV-SP306. HD Fixed Dome Network Camera. HD Network Camera. Fixed Dome Network Camera WV-SF332. Network Camera WV-SP302

WV-SF335/WV-SF336 WV-SP305/WV-SP306. HD Fixed Dome Network Camera. HD Network Camera. Fixed Dome Network Camera WV-SF332. Network Camera WV-SP302 HD Network Camera WV-/WV- Network Camera WV- HD Fixed Dome Network Camera WV-/WV- Fixed Dome Network Camera WV- Security & AV Systems Business Unit Panasonic System Networks Company WV-/305/306 Overview

More information

A full-resolution 8K single-chip portable camera system

A full-resolution 8K single-chip portable camera system 8640 pixels 4320 pixels https://doi.org/10.2352/issn.2470-1173.2017.11.imse-179 2017, Society for Imaging Science and Technology A full-resolution 8K single-chip portable camera system Tomohiro Nakamura,

More information

CHAPTER-5 WATERMARKING OF COLOR IMAGES

CHAPTER-5 WATERMARKING OF COLOR IMAGES CHAPTER-5 WATERMARKING OF COLOR IMAGES 5.1 INTRODUCTION After satisfactorily developing the watermarking schemes for gray level images, we focused on developing the watermarking schemes for the color images.

More information

texture compression using smooth profile functions

texture compression using smooth profile functions texture compression using smooth profile functions j. rasmusson 1,2, j. ström 1, p. wennersten 1, m. doggett 2 AND t. Akenine-Möller 2 1 ericsson research 2 lund university Texturing and the bus Memory

More information

Lecture 6: Texturing Part II: Texture Compression and GPU Latency Hiding Mechanisms. Visual Computing Systems CMU , Fall 2014

Lecture 6: Texturing Part II: Texture Compression and GPU Latency Hiding Mechanisms. Visual Computing Systems CMU , Fall 2014 Lecture 6: Texturing Part II: Texture Compression and GPU Latency Hiding Mechanisms Visual Computing Systems Review: mechanisms to reduce aliasing in the graphics pipeline When sampling visibility?! -

More information

Encoding Color Difference Signals for High Dynamic Range and Wide Gamut Imagery

Encoding Color Difference Signals for High Dynamic Range and Wide Gamut Imagery Encoding Color Difference Signals for High Dynamic Range and Wide Gamut Imagery Jan Froehlich, Timo Kunkel, Robin Atkins, Jaclyn Pytlarz, Scott Daly, Andreas Schilling, Bernd Eberhardt March 17, 2016 Outline

More information

ECE 417 Guest Lecture Video Compression in MPEG-1/2/4. Min-Hsuan Tsai Apr 02, 2013

ECE 417 Guest Lecture Video Compression in MPEG-1/2/4. Min-Hsuan Tsai Apr 02, 2013 ECE 417 Guest Lecture Video Compression in MPEG-1/2/4 Min-Hsuan Tsai Apr 2, 213 What is MPEG and its standards MPEG stands for Moving Picture Expert Group Develop standards for video/audio compression

More information

VIDEO AND IMAGE PROCESSING USING DSP AND PFGA. Chapter 3: Video Processing

VIDEO AND IMAGE PROCESSING USING DSP AND PFGA. Chapter 3: Video Processing ĐẠI HỌC QUỐC GIA TP.HỒ CHÍ MINH TRƯỜNG ĐẠI HỌC BÁCH KHOA KHOA ĐIỆN-ĐIỆN TỬ BỘ MÔN KỸ THUẬT ĐIỆN TỬ VIDEO AND IMAGE PROCESSING USING DSP AND PFGA Chapter 3: Video Processing 3.1 Video Formats 3.2 Video

More information

Source Coding Techniques

Source Coding Techniques Source Coding Techniques Source coding is based on changing the content of the original signal. Also called semantic-based coding. Compression rates may be higher but at a price of loss of information.

More information

VC 12/13 T16 Video Compression

VC 12/13 T16 Video Compression VC 12/13 T16 Video Compression Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline The need for compression Types of redundancy

More information

High Efficiency Video Coding. Li Li 2016/10/18

High Efficiency Video Coding. Li Li 2016/10/18 High Efficiency Video Coding Li Li 2016/10/18 Email: lili90th@gmail.com Outline Video coding basics High Efficiency Video Coding Conclusion Digital Video A video is nothing but a number of frames Attributes

More information

CHAPTER 7. Copyright Cengage Learning. All rights reserved.

CHAPTER 7. Copyright Cengage Learning. All rights reserved. CHAPTER 7 FUNCTIONS Copyright Cengage Learning. All rights reserved. SECTION 7.1 Functions Defined on General Sets Copyright Cengage Learning. All rights reserved. Functions Defined on General Sets We

More information

Image and Video Coding I: Fundamentals

Image and Video Coding I: Fundamentals Image and Video Coding I: Fundamentals Thomas Wiegand Technische Universität Berlin T. Wiegand (TU Berlin) Image and Video Coding Organization Vorlesung: Donnerstag 10:15-11:45 Raum EN-368 Material: http://www.ic.tu-berlin.de/menue/studium_und_lehre/

More information

DHTC: An Effective DXTC-based HDR Texture Compression Scheme

DHTC: An Effective DXTC-based HDR Texture Compression Scheme DHTC: An Effective DXTC-based HDR Texture Compression Scheme Wen Sun 1,2 Yan Lu 1 Feng Wu 1 Shipeng Li 1 yanlu@microsoft.com 1 Microsoft Research Asia 2 University of Science and Technology of China Outline

More information

Image Segmentation Techniques for Object-Based Coding

Image Segmentation Techniques for Object-Based Coding Image Techniques for Object-Based Coding Junaid Ahmed, Joseph Bosworth, and Scott T. Acton The Oklahoma Imaging Laboratory School of Electrical and Computer Engineering Oklahoma State University {ajunaid,bosworj,sacton}@okstate.edu

More information

Model: LT-125 USER MANUAL. A Lattice ECP3 based HD video compression and decompression evaluation platform. AUGUST Page 1

Model: LT-125 USER MANUAL. A Lattice ECP3 based HD video compression and decompression evaluation platform. AUGUST Page 1 Model: LT-125 USER MANUAL A Lattice ECP3 based HD video compression and decompression evaluation platform. AUGUST 2012 Page 1 TABLE OF CONTENTS Table of Contents... 2 Special handling instructions... 3

More information

ATSC Candidate Standard: A/341 Amendment

ATSC Candidate Standard: A/341 Amendment ATSC Candidate Standard: A/341 Amendment 2094-40 Doc. S34-301r2 20 February 2018 Advanced Television Systems Committee 1776 K Street, N.W. Washington, D.C. 20006 202-872-9160 i The Advanced Television

More information

CSE 417 Network Flows (pt 4) Min Cost Flows

CSE 417 Network Flows (pt 4) Min Cost Flows CSE 417 Network Flows (pt 4) Min Cost Flows Reminders > HW6 is due Monday Review of last three lectures > Defined the maximum flow problem find the feasible flow of maximum value flow is feasible if it

More information

JPEG Descrizione ed applicazioni. Arcangelo Bruna. Advanced System Technology

JPEG Descrizione ed applicazioni. Arcangelo Bruna. Advanced System Technology JPEG 2000 Descrizione ed applicazioni Arcangelo Bruna Market s requirements for still compression standard Application s dependent Digital Still Cameras (High / mid / low bit rate) Mobile multimedia (Low

More information

Laboratoire d'informatique, de Robotique et de Microélectronique de Montpellier Montpellier Cedex 5 France

Laboratoire d'informatique, de Robotique et de Microélectronique de Montpellier Montpellier Cedex 5 France Video Compression Zafar Javed SHAHID, Marc CHAUMONT and William PUECH Laboratoire LIRMM VOODDO project Laboratoire d'informatique, de Robotique et de Microélectronique de Montpellier LIRMM UMR 5506 Université

More information

Quantel Rio Rio Assist. V3.0 rev 1 New Feature List

Quantel Rio Rio Assist. V3.0 rev 1 New Feature List Quantel Rio Rio Assist V3.0 rev 1 New Feature List Note: This is a major release and requires a database schema change. After installation the first run up will migrate the base, desk and dict folders

More information

Bits and Bit Patterns

Bits and Bit Patterns Bits and Bit Patterns Bit: Binary Digit (0 or 1) Bit Patterns are used to represent information. Numbers Text characters Images Sound And others 0-1 Boolean Operations Boolean Operation: An operation that

More information

Human detection using histogram of oriented gradients. Srikumar Ramalingam School of Computing University of Utah

Human detection using histogram of oriented gradients. Srikumar Ramalingam School of Computing University of Utah Human detection using histogram of oriented gradients Srikumar Ramalingam School of Computing University of Utah Reference Navneet Dalal and Bill Triggs, Histograms of Oriented Gradients for Human Detection,

More information

Chapter 3: Intensity Transformations and Spatial Filtering

Chapter 3: Intensity Transformations and Spatial Filtering Chapter 3: Intensity Transformations and Spatial Filtering 3.1 Background 3.2 Some basic intensity transformation functions 3.3 Histogram processing 3.4 Fundamentals of spatial filtering 3.5 Smoothing

More information

EEM 463 Introduction to Image Processing. Week 3: Intensity Transformations

EEM 463 Introduction to Image Processing. Week 3: Intensity Transformations EEM 463 Introduction to Image Processing Week 3: Intensity Transformations Fall 2013 Instructor: Hatice Çınar Akakın, Ph.D. haticecinarakakin@anadolu.edu.tr Anadolu University Enhancement Domains Spatial

More information

IMAGE PROCESSING >FILTERS AND EDGE DETECTION FOR COLOR IMAGES UTRECHT UNIVERSITY RONALD POPPE

IMAGE PROCESSING >FILTERS AND EDGE DETECTION FOR COLOR IMAGES UTRECHT UNIVERSITY RONALD POPPE IMAGE PROCESSING >FILTERS AND EDGE DETECTION FOR COLOR IMAGES UTRECHT UNIVERSITY RONALD POPPE OUTLINE Filters for color images Edge detection for color images Canny edge detection FILTERS FOR COLOR IMAGES

More information

Chapter 1. Data Storage Pearson Addison-Wesley. All rights reserved

Chapter 1. Data Storage Pearson Addison-Wesley. All rights reserved Chapter 1 Data Storage 2007 Pearson Addison-Wesley. All rights reserved Chapter 1: Data Storage 1.1 Bits and Their Storage 1.2 Main Memory 1.3 Mass Storage 1.4 Representing Information as Bit Patterns

More information

720P,indoor vandal WV-SF346 SVGA, indoor vandal WV-SF342

720P,indoor vandal WV-SF346 SVGA, indoor vandal WV-SF342 720P,indoor vandal WV- SVGA, indoor vandal WV- Security & AV Systems Business Unit Panasonic System Networks Company WV-/346 Overview WV- WV- WV-SF332 WV-SF33 WV-SF336 800x600, 30fps Simple D/N Focus Assist

More information

Video coding. Concepts and notations.

Video coding. Concepts and notations. TSBK06 video coding p.1/47 Video coding Concepts and notations. A video signal consists of a time sequence of images. Typical frame rates are 24, 25, 30, 50 and 60 images per seconds. Each image is either

More information

Ian Snyder. December 14, 2009

Ian Snyder. December 14, 2009 PEG mage an Snyder December 14, 2009 Complete... Abstract This paper will outline the process of PEG image compression and the use of linear algebra as part of this process. t will introduce the reasons

More information

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 3. HIGH DYNAMIC RANGE Computer Vision 2 Dr. Benjamin Guthier Pixel Value Content of this

More information

Quantization, conversion of values into bits

Quantization, conversion of values into bits Quantization, conversion of values into bits We have seen that for pure brightness values we need about 100 steps, for which 7 bits are sufcient. What is the situation with DCT coefcients? We saw with

More information

Color Space Converter

Color Space Converter March 2009 Reference Design RD1047 Introduction s (CSC) are used in video and image display systems including televisions, computer monitors, color printers, video telephony and surveillance systems. CSCs

More information

Physical Color. Color Theory - Center for Graphics and Geometric Computing, Technion 2

Physical Color. Color Theory - Center for Graphics and Geometric Computing, Technion 2 Color Theory Physical Color Visible energy - small portion of the electro-magnetic spectrum Pure monochromatic colors are found at wavelengths between 380nm (violet) and 780nm (red) 380 780 Color Theory

More information

CSEP 521 Applied Algorithms Spring Lossy Image Compression

CSEP 521 Applied Algorithms Spring Lossy Image Compression CSEP 521 Applied Algorithms Spring 2005 Lossy Image Compression Lossy Image Compression Methods Scalar quantization (SQ). Vector quantization (VQ). DCT Compression JPEG Wavelet Compression SPIHT UWIC (University

More information

Compression Part 2 Lossy Image Compression (JPEG) Norm Zeck

Compression Part 2 Lossy Image Compression (JPEG) Norm Zeck Compression Part 2 Lossy Image Compression (JPEG) General Compression Design Elements 2 Application Application Model Encoder Model Decoder Compression Decompression Models observe that the sensors (image

More information

4K LASER FRONT PROJECTOR REMOTE CODES

4K LASER FRONT PROJECTOR REMOTE CODES 4K LASER FRONT PROJECTOR REMOTE CODES Changes Dreamvision provides this manual as is without warranty of any kind, either expressed or implied, including but not limited to the implied warranties or merchantability

More information

Intro to Algorithms. Professor Kevin Gold

Intro to Algorithms. Professor Kevin Gold Intro to Algorithms Professor Kevin Gold What is an Algorithm? An algorithm is a procedure for producing outputs from inputs. A chocolate chip cookie recipe technically qualifies. An algorithm taught in

More information

Lecture #5. Point transformations (cont.) Histogram transformations. Intro to neighborhoods and spatial filtering

Lecture #5. Point transformations (cont.) Histogram transformations. Intro to neighborhoods and spatial filtering Lecture #5 Point transformations (cont.) Histogram transformations Equalization Specification Local vs. global operations Intro to neighborhoods and spatial filtering Brightness & Contrast 2002 R. C. Gonzalez

More information

High Dynamic Range Imaging.

High Dynamic Range Imaging. High Dynamic Range Imaging High Dynamic Range [3] In photography, dynamic range (DR) is measured in exposure value (EV) differences or stops, between the brightest and darkest parts of the image that show

More information

The Basics of Video Compression

The Basics of Video Compression The Basics of Video Compression Marko Slyz February 18, 2003 (Sourcecoders talk) 1/18 Outline 1. Non-technical Survey of Video Compressors 2. Basic Description of MPEG 1 3. Discussion of Other Compressors

More information

Edge Blending White paper

Edge Blending White paper Edge Blending White paper Edge blending is a technique used to describe the process of visually combining several projected images to make a single seamless image. Typically, this is done to increase the

More information

Mark Kogan CTO Video Delivery Technologies Bluebird TV

Mark Kogan CTO Video Delivery Technologies Bluebird TV Mark Kogan CTO Video Delivery Technologies Bluebird TV Bluebird TV Is at the front line of the video industry s transition to the cloud. Our multiscreen video solutions and services, which are available

More information

Visible Color. 700 (red) 580 (yellow) 520 (green)

Visible Color. 700 (red) 580 (yellow) 520 (green) Color Theory Physical Color Visible energy - small portion of the electro-magnetic spectrum Pure monochromatic colors are found at wavelengths between 380nm (violet) and 780nm (red) 380 780 Color Theory

More information

Introduction to Digital Image Processing

Introduction to Digital Image Processing Fall 2005 Image Enhancement in the Spatial Domain: Histograms, Arithmetic/Logic Operators, Basics of Spatial Filtering, Smoothing Spatial Filters Tuesday, February 7 2006, Overview (1): Before We Begin

More information

DTC-350. VISUALmpeg PRO MPEG Analyser Software.

DTC-350. VISUALmpeg PRO MPEG Analyser Software. VISUALmpeg PRO MPEG Analyser Software 1. Introduction VISUALmpeg PRO is a powerful tool set intended for detailed off-line analysis of Video Elementary Streams in MPEG-1 or MPEG-2 video format. The analysis

More information

4 Megapixels Full HD Network 10x AF Zoom Camera

4 Megapixels Full HD Network 10x AF Zoom Camera 4 Megapixels Full HD Network 10x AF Zoom Camera VCC-HD4000P VGA (640 x 480) 4M (2288 x 1712) Full HD () 4 Megapixels resolution Compared to conventional VGA cameras having a 640 x 480 pixel resolution,

More information

CSC 2515 Introduction to Machine Learning Assignment 2

CSC 2515 Introduction to Machine Learning Assignment 2 CSC 2515 Introduction to Machine Learning Assignment 2 Zhongtian Qiu(1002274530) Problem 1 See attached scan files for question 1. 2. Neural Network 2.1 Examine the statistics and plots of training error

More information

Optical Storage Technology. MPEG Data Compression

Optical Storage Technology. MPEG Data Compression Optical Storage Technology MPEG Data Compression MPEG-1 1 Audio Standard Moving Pictures Expert Group (MPEG) was formed in 1988 to devise compression techniques for audio and video. It first devised the

More information

I ll be speaking today about BC6H compression, how it works, how to compress it in realtime and what s the motivation behind doing that.

I ll be speaking today about BC6H compression, how it works, how to compress it in realtime and what s the motivation behind doing that. Hi everyone, my name is Krzysztof Narkowicz. I m the Lead Engine Programmer at Flying Wild Hog. It s a small company based in Poland and we are mainly making some old-school first person shooter games

More information

Image compression. Stefano Ferrari. Università degli Studi di Milano Methods for Image Processing. academic year

Image compression. Stefano Ferrari. Università degli Studi di Milano Methods for Image Processing. academic year Image compression Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Methods for Image Processing academic year 2017 2018 Data and information The representation of images in a raw

More information

Transcoding Using the MFP Card

Transcoding Using the MFP Card This section covers the transcoding option of the Digital Content Manager (DCM) that is provided with an MFP card. Introduction, page 1 Routing a Service to the Output Through an MFP Card, page 6 Naming

More information

An introduction to 3D image reconstruction and understanding concepts and ideas

An introduction to 3D image reconstruction and understanding concepts and ideas Introduction to 3D image reconstruction An introduction to 3D image reconstruction and understanding concepts and ideas Samuele Carli Martin Hellmich 5 febbraio 2013 1 icsc2013 Carli S. Hellmich M. (CERN)

More information

Lecture 13 Video Coding H.264 / MPEG4 AVC

Lecture 13 Video Coding H.264 / MPEG4 AVC Lecture 13 Video Coding H.264 / MPEG4 AVC Last time we saw the macro block partition of H.264, the integer DCT transform, and the cascade using the DC coefficients with the WHT. H.264 has more interesting

More information

Using animation to motivate motion

Using animation to motivate motion Using animation to motivate motion In computer generated animation, we take an object and mathematically render where it will be in the different frames Courtesy: Wikipedia Given the rendered frames (or

More information

UNIT - 5 IMAGE ENHANCEMENT IN SPATIAL DOMAIN

UNIT - 5 IMAGE ENHANCEMENT IN SPATIAL DOMAIN UNIT - 5 IMAGE ENHANCEMENT IN SPATIAL DOMAIN Spatial domain methods Spatial domain refers to the image plane itself, and approaches in this category are based on direct manipulation of pixels in an image.

More information

MULTIMEDIA AND CODING

MULTIMEDIA AND CODING 07 MULTIMEDIA AND CODING WHAT MEDIA TYPES WE KNOW? TEXTS IMAGES SOUNDS MUSIC VIDEO INTERACTIVE CONTENT Games Virtual reality EXAMPLES OF MULTIMEDIA MOVIE audio + video COMPUTER GAME audio + video + interactive

More information

Video Compression Method for On-Board Systems of Construction Robots

Video Compression Method for On-Board Systems of Construction Robots Video Compression Method for On-Board Systems of Construction Robots Andrei Petukhov, Michael Rachkov Moscow State Industrial University Department of Automatics, Informatics and Control Systems ul. Avtozavodskaya,

More information

Lecture 4 Image Enhancement in Spatial Domain

Lecture 4 Image Enhancement in Spatial Domain Digital Image Processing Lecture 4 Image Enhancement in Spatial Domain Fall 2010 2 domains Spatial Domain : (image plane) Techniques are based on direct manipulation of pixels in an image Frequency Domain

More information

Digital Image Processing. Lecture # 3 Image Enhancement

Digital Image Processing. Lecture # 3 Image Enhancement Digital Image Processing Lecture # 3 Image Enhancement 1 Image Enhancement Image Enhancement 3 Image Enhancement 4 Image Enhancement Process an image so that the result is more suitable than the original

More information

CSE237A: Final Project Mid-Report Image Enhancement for portable platforms Rohit Sunkam Ramanujam Soha Dalal

CSE237A: Final Project Mid-Report Image Enhancement for portable platforms Rohit Sunkam Ramanujam Soha Dalal CSE237A: Final Project Mid-Report Image Enhancement for portable platforms Rohit Sunkam Ramanujam (rsunkamr@ucsd.edu) Soha Dalal (sdalal@ucsd.edu) Project Goal The goal of this project is to incorporate

More information

R2T12T&S12T45TP. CLIPSTER Release Note Software Version 6.0. Release Note 7DV

R2T12T&S12T45TP. CLIPSTER Release Note Software Version 6.0. Release Note 7DV R&S2T45TP 54T2PT is R2T12T&S12T45TP CLIPSTER Release Note Software Version 6.0 2016 Rohde & Schwarz GmbH DVS GmbH Krepenstr. 8, 30165 Hanover, Germany Phone: +49 511 67 80 70 Fax: +49 511 37 19 74 E-mail:

More information

Change H.264 export settings Posted by filmoy - 10 Mar :07

Change H.264 export settings Posted by filmoy - 10 Mar :07 Change H.264 export settings Posted by filmoy - 10 Mar 2015 15:07 This might be a silly question but, as I don't know what I'm doing, any advice would be gratefully received! I am using Lightworks (free)

More information

Transcoding SDK. Professional Transcoding Engine

Transcoding SDK. Professional Transcoding Engine Transcoding SDK Professional Transcoding Engine Formerly known as Reference SDK, Transcoding SDK offers improved quality and performance as well as exciting new features and stability enhancements to further

More information

Unable to import a video file into Lightworks Posted by Slashbuddy24-03 Mar :50

Unable to import a video file into Lightworks Posted by Slashbuddy24-03 Mar :50 Unable to import a video file into Lightworks Posted by Slashbuddy24-03 Mar 2016 23:50 Hello, This is my first time posting on the Lightworks forums and I did not think I would ever have to get to this

More information

HiTi. Color Management Utility Instructions

HiTi. Color Management Utility Instructions HiTi Color Management Utility Instructions Benefits of using color management. Improve the consistency of printed colors against the colors displayed on the display screen. Users can also remotely fine

More information

Procedural Compression: Efficient, Low Bandwidth Remote Android Graphics

Procedural Compression: Efficient, Low Bandwidth Remote Android Graphics : Efficient, Low Bandwidth Remote Android Graphics Joel Isaacson. Copyright 2014 Joel Isaacson joel@ascender.com of GUI Rendered Video Streams The compression system described allows high performance interactive

More information

The Sources of Randomness in Smartphones with Symbian OS

The Sources of Randomness in Smartphones with Symbian OS The Sources of Randomness in Smartphones with Symbian OS Jan Krhovják, Petr Švenda, Vašek Matyáš, Luděk Smolík Faculty of Informatics Masaryk University, Brno Outline Basics on random number generation

More information

PVM-X inch 4K TRIMASTER EL OLED high grade picture monitor. Overview

PVM-X inch 4K TRIMASTER EL OLED high grade picture monitor. Overview PVM-X550 55-inch 4K TRIMASTER EL OLED high grade picture monitor Overview Optimized large 55-inch (diag.) screen for 4K color grading, with close color matching to the reference BVM-X300 The PVM-X550 55-inch*

More information