Customizing Progressive JPEG for Efficient Image Storage
|
|
- Gary Lawson
- 6 years ago
- Views:
Transcription
1 Customizing Progressive JPEG for Efficient Image Storage Eddie Yan Kaiyuan Zhang Xi Wang Karin Strauss Luis Ceze HotStorage 17 July 11, 2017
2 2
3 2
4 2
5 2
6 2
7 2
8 2
9 2
10 2
11 Summary Today s image hosts need to store many images, but also at many different sizes (resolutions), increasing pressure on storage systems Leverage progressive image storage technology to reduce the effect of serving multiple resolutions of each image 3
12 Contents Intro & Related Work JPEG & Progressive JPEG Progressive JPEG for Dynamic Resizing Future Work & Conclusion 4
13 Facebook Stores Four Versions of Each Photo (2010) Facebook s photo store: handle many small files efficiently [Beaver OSDI 10] For each uploaded photo, Facebook generates and stores four images of different sizes, which translates to over 260 billion images and more than 20 petabytes of data. 5
14 Facebook Serves Different Image Sizes Depending on Context Facebook s photo cache: resizing on the fly + SSD caching [Huang SOSP 13] Facebook serves photos in many different forms to many different users. For instance, a desktop user with a big window will see larger photos than a desktop users with a smaller window who in turn sees larger photos than a mobile user. 6
15 FLICKR: No Capacity Upgrades for a Year with Resizing A Year Without A Byte [Flickr ] & Real-time Resizing of Flickr Images Using GPUs [Flickr ] 7
16 Goals for Image Storage image storage for large (social media services) should: 8
17 Goals for Image Storage image storage for large (social media services) should: offer low latency, high throughput [Beaver OSDI 10] [Huang SOSP 13] 8
18 Goals for Image Storage image storage for large (social media services) should: offer low latency, high throughput [Beaver OSDI 10] [Huang SOSP 13] serve multiple resolutions [Beaver OSDI 10] [Flickr 17 1 & 2 17] [Huang SOSP 13] 8
19 Goals for Image Storage image storage for large (social media services) should: offer low latency, high throughput [Beaver OSDI 10] [Huang SOSP 13] serve multiple resolutions [Beaver OSDI 10] [Flickr 17 1 & 2 17] [Huang SOSP 13] use minimal storage capacity [Google 17] [Horn NSDI 17] [Mozilla circa 14] 8
20 JPEG: Quantization 9
21 JPEG: Quantization 9
22 JPEG: Quantization 9
23 JPEG: Quantization 9
24 JPEG: Quantization 9
25 JPEG: Quantization 9
26 JPEG: Quantization 9
27 JPEG: Quantization 9
28 JPEG: Quantization 9
29 JPEG: Quantization 9
30 JPEG: Quantization
31 JPEG: Quantization
32 JPEG: Quantization
33 JPEG: Quantization
34 JPEG: Quantization
35 JPEG: Quantization
36 JPEG: Quantization
37 JPEG: Quantization
38 JPEG: Quantization 1 2 less quantization
39 JPEG: Quantization 1 2 less quantization 3... more quantization... 9
40 JPEG: Lossless Compression (0, 2)( 3); (1, 2)( 3); (0, 2)( 2); (0, 3)( 6); (0, 2) (2); (0, 3)( 4); (0, 1)(1); (0, 2)( 3); (0, 1)(1); (0, 1)(1); (0, 3)(5); (0, 1) (1); (0, 2)(2); (0, 1)( 1); (0, 1)(1); (0, 1)( 1); (0, 2) (2); (5, 1)( 1); (0, 1)( 1); (0, 0). 10
41 Baseline JPEG: Scanline Order 11
42 Baseline JPEG: Scanline Order 12
43 Progressive JPEG
44 Progressive JPEG
45 Progressive JPEG each scan is a refinement pass 13
46 Progressive JPEG represent image data in the frequency domain, roughly in frequency order load data in frequency order, grouped by scans header scan 1 scan 2 scan 3 scan 4 scan 5 14
47 Progressive JPEG Example header scan 1 PSNR: 27.9 db 15
48 Progressive JPEG Example header scan 1 scan 2 PSNR: 29.8 db 16
49 Progressive JPEG Example header scan 1 scan 2 scan 3 PSNR: 31.9 db 17
50 Progressive JPEG Example header scan 1 scan 2 scan 3 scan 4 PSNR: 37.9 db 18
51 Progressive JPEG Example header scan 1 scan 2 scan 3 scan 4 scan 5 PSNR: inf db 19
52 Progressive JPEG Example header scan 1 scan 2 scan 3 scan 4 scan 5 PSNR: 31.9 db PSNR: inf db 20
53 Progressive JPEG Example header scan 1 scan 2 scan 3 scan 4 scan 5 21
54 Targeting Dynamic Resizing 22
55 Targeting Dynamic Resizing request( image.jpg, 500px) 22
56 Targeting Dynamic Resizing request( image.jpg, 500px) 22
57 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) 22
58 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) 22
59 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) resize( image.jpg, 500px) 22
60 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) resize( image.jpg, 500px) 22
61 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) resize( image.jpg, 500px) send( image.jpg, 500px) 22
62 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) resize( image.jpg, 500px) send( image.jpg, 500px) 22
63 Targeting Dynamic Resizing request( image.jpg, 500px) read( image.jpg, src) resize( image.jpg, 500px) you can cache this send( image.jpg, 500px) 22
64 Three Methods for Dynamic Resizing read( image.jpg, src) 23
65 Three Methods for Dynamic Resizing read source JPEG read( image.jpg, src) decode 23
66 Three Methods for Dynamic Resizing read source JPEG read progressive JPEG partially read( image.jpg, src) decode decode 23
67 Three Methods for Dynamic Resizing read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) decode decode decode 23
68 Three Methods for Dynamic Resizing Baseline Progressive JPEG Custom Progressive JPEG read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) decode decode decode 23
69 Our Approach Store only one size of each image, resize dynamically, and customize JPEGs to match target sizes 24
70 Using Custom Progressive JPEG find custom scan configuration predefined resolutions (a) write resolution to read offset mapping (b) saved data (c) read read necessary scans resize and encode (transcode) 25
71 Using Custom Progressive JPEG find custom scan configuration predefined resolutions (a) write resolution to read offset mapping (b) saved data (c) read read necessary scans resize and encode (transcode) 25
72 Using Custom Progressive JPEG find custom scan configuration predefined resolutions (a) write resolution to read offset mapping (b) saved data (c) read read necessary scans resize and encode (transcode) 25
73 Customizing Progressive JPEG
74 Customizing Progressive JPEG
75 Tune Coefficients Included in Each Scan to Match Quality Targets Directly
76 Tune Coefficients Included in Each Scan to Match Quality Targets Directly
77 Tune Coefficients Included in Each Scan to Match Quality Targets Directly % 27
78 Tune Coefficients Included in Each Scan to Match Quality Targets Directly % 25% 27
79 Tune Coefficients Included in Each Scan to Match Quality Targets Directly % 25% 50% 27
80 Choosing Coefficients 28
81 Choosing Coefficients 28
82 Choosing Coefficients best 28
83 Choosing Coefficients best 28
84 Choosing Coefficients best 28
85 Choosing Coefficients best best 28
86 Choosing Coefficients best 28
87 Choosing Coefficients best 28
88 Choosing Coefficients best 28
89 Choosing Coefficients best 28
90 Choosing Coefficients best 28
91 Choosing Coefficients best 28
92 Choosing Coefficients best 28
93 Choosing Coefficients best 28
94 Choosing Coefficients best 28
95 Choosing Coefficients best 28
96 Choosing Coefficients best 28
97 Evaluation 29
98 Evaluation minimize required storage capacity 29
99 Evaluation minimize required storage capacity minimize amount of data read (bandwidth) 29
100 Evaluation minimize required storage capacity minimize amount of data read (bandwidth) limit decode-time overheads 29
101 Dynamic Resizing Saves Capacity over Static Schemes 30
102 Customizing Progressive Reduces Read Bandwidth Requirements 31
103 Where to Decode for Resizing? Baseline Progressive JPEG Custom Progressive JPEG read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) decode decode decode 32
104 Where to Decode for Resizing? Baseline Progressive JPEG Custom Progressive JPEG read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) decode decode decode 32
105 Where to Decode for Resizing? Progressive JPEG is more expensive to decode than baseline JPEG Baseline Progressive JPEG Custom Progressive JPEG read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) decode decode decode 32
106 Where to Decode for Resizing? Progressive JPEG is more expensive to decode than baseline JPEG Baseline Progressive JPEG Custom Progressive JPEG read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) decode decode decode 32
107 Where to Decode for Resizing? Progressive JPEG is more expensive to decode than baseline JPEG Baseline Progressive JPEG Custom Progressive JPEG read source JPEG read progressive JPEG partially read custom progressive JPEG partially read( image.jpg, src) Two Choices: decode decode decode 1. decode on client 2. decode on server 32
108 Where to Decode for Resizing? 33
109 Where to Decode for Resizing? Client Server 33
110 Where to Decode for Resizing? Client Server Input Truncated PJPEG Truncated PJPEG 33
111 Where to Decode for Resizing? Client Server Input Truncated PJPEG Truncated PJPEG Output Resized JPEG Resized JPEG 33
112 Where to Decode for Resizing? Client Server Input Truncated PJPEG Truncated PJPEG Output Resized JPEG Resized JPEG Baseline Input Resized JPEG Full Size JPEG 33
113 Where to Decode for Resizing? Client Server Input Truncated PJPEG Truncated PJPEG Output Resized JPEG Resized JPEG Baseline Input Resized JPEG Full Size JPEG Change in Input Resized JPEG to Truncated Progressive Full Size JPEG to Truncated Progressive 33
114 Decoding on the Server has Lower Overhead 34
115 Decoding on the Server has Lower Overhead 34
116 35
117 Minimize required storage capacity 35
118 Minimize required storage capacity Minimize amount of data read 35
119 Minimize required storage capacity Minimize amount of data read Limit decode-time overheads 35
120 dynamic resizing custom PJPEG +dynamic resizing Minimize required storage capacity Minimize amount of data read Limit decode-time overheads 35
121 dynamic resizing custom PJPEG +dynamic resizing Minimize required storage capacity Minimize amount of data read Limit decode-time overheads 35
122 dynamic resizing custom PJPEG +dynamic resizing Minimize required storage capacity Minimize amount of data read Limit decode-time overheads 35
123 dynamic resizing custom PJPEG +dynamic resizing Minimize required storage capacity Minimize amount of data read Limit decode-time overheads 35
124 Future Work we need accurate, perceptual, image quality metrics we should make this faster 36
125 Conclusion 37
126 Conclusion modern image storage services store a lot of images, at many resolutions 37
127 Conclusion modern image storage services store a lot of images, at many resolutions serving multiple resolutions is necessary, but wastes capacity 37
128 Conclusion modern image storage services store a lot of images, at many resolutions serving multiple resolutions is necessary, but wastes capacity we can do better by only reading the necessary data for each request and customizing image data layout 37
129 Thank You Questions? 38
JPEG decoding using end of block markers to concurrently partition channels on a GPU. Patrick Chieppe (u ) Supervisor: Dr.
JPEG decoding using end of block markers to concurrently partition channels on a GPU Patrick Chieppe (u5333226) Supervisor: Dr. Eric McCreath JPEG Lossy compression Widespread image format Introduction
More informationLecture 8 JPEG Compression (Part 3)
CS 414 Multimedia Systems Design Lecture 8 JPEG Compression (Part 3) Klara Nahrstedt Spring 2012 Administrative MP1 is posted Today Covered Topics Hybrid Coding: JPEG Coding Reading: Section 7.5 out of
More informationBit Rate Reduction Video Transcoding with Distributed Computing
Bit Rate Reduction Video Transcoding with Distributed Computing Fareed Jokhio, Tewodros Deneke, S ebastien Lafond, Johan Lilius Åbo Akademi University Department of Information Technologies Joukahainengatan
More informationReview and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding.
Project Title: Review and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding. Midterm Report CS 584 Multimedia Communications Submitted by: Syed Jawwad Bukhari 2004-03-0028 About
More informationFlexiWeb: Network-Aware Compaction for Accelerating Mobile Web
FlexiWeb: Network-Aware Compaction for Accelerating Mobile Web What s the impact of web latency? 100ms 1% Delay sales Source : https://speakerdeck.com/deanohume/faster-mobilewebsites! 100ms 1% Delay revenue
More informationFeedback: Twitter: #TechTalk #wpo #io2011. Make The Web Faster. Joshua Marantz Richard Rabbat Håkon Wium Lie.
Feedback: Twitter: http://goo.gl/vf47i #TechTalk #wpo #io2011 Make The Web Faster Joshua Marantz Richard Rabbat Håkon Wium Lie May 10, 2011 Agenda mod_pagespeed Joshua Marantz Feedback: Twitter: http://goo.gl/vf47i
More informationToday s Papers. Array Reliability. RAID Basics (Two optional papers) EECS 262a Advanced Topics in Computer Systems Lecture 3
EECS 262a Advanced Topics in Computer Systems Lecture 3 Filesystems (Con t) September 10 th, 2012 John Kubiatowicz and Anthony D. Joseph Electrical Engineering and Computer Sciences University of California,
More informationMULTIMEDIA COMMUNICATION
MULTIMEDIA COMMUNICATION Laboratory Session: JPEG Standard Fernando Pereira The objective of this lab session about the JPEG (Joint Photographic Experts Group) standard is to get the students familiar
More informationThe Next Generation of Compression JPEG 2000
The Next Generation of Compression JPEG 2000 Bernie Brower NSES Kodak bernard.brower@kodak.com +1 585 253 5293 1 What makes JPEG 2000 Special With advances in compression science combined with advances
More informationCS 260: Seminar in Computer Science: Multimedia Networking
CS 260: Seminar in Computer Science: Multimedia Networking Jiasi Chen Lectures: MWF 4:10-5pm in CHASS http://www.cs.ucr.edu/~jiasi/teaching/cs260_spring17/ Multimedia is User perception Content creation
More informationPixelsior: Photo Management as a Platform Service for Mobile Apps
Pixelsior: Photo Management as a Platform Service for Mobile Apps Kyungho Jeon, Sharath Chandrashekhara, Karthik Dantu and Steven Y. Ko University at Buffalo, The State University of New York Photo data
More informationORBX 2 Technical Introduction. October 2013
ORBX 2 Technical Introduction October 2013 Summary The ORBX 2 video codec is a next generation video codec designed specifically to fulfill the requirements for low latency real time video streaming. It
More informationCompression II: Images (JPEG)
Compression II: Images (JPEG) What is JPEG? JPEG: Joint Photographic Expert Group an international standard in 1992. Works with colour and greyscale images Up 24 bit colour images (Unlike GIF) Target Photographic
More informationJPEG Joint Photographic Experts Group ISO/IEC JTC1/SC29/WG1 Still image compression standard Features
JPEG-2000 Joint Photographic Experts Group ISO/IEC JTC1/SC29/WG1 Still image compression standard Features Improved compression efficiency (vs. JPEG) Highly scalable embedded data streams Progressive lossy
More informationStereo Image Compression
Stereo Image Compression Deepa P. Sundar, Debabrata Sengupta, Divya Elayakumar {deepaps, dsgupta, divyae}@stanford.edu Electrical Engineering, Stanford University, CA. Abstract In this report we describe
More informationJPEG Baseline JPEG Pros and Cons (as compared to JPEG2000) Advantages. Disadvantages
Baseline JPEG Pros and Cons (as compared to JPEG2000) Advantages Memory efficient Low complexity Compression efficiency Visual model utilization Disadvantages Single resolution Single quality No target
More informationJPEG 2000 A versatile image coding system for multimedia applications
International Telecommunication Union JPEG 2000 A versatile image coding system for multimedia applications Touradj Ebrahimi EPFL Why another still image compression standard? Low bit-rate compression
More informationDecoding. Encoding. Recoding to sequential. Progressive parsing. Pixels DCT Coefficients Scans. JPEG Coded image. Recoded JPEG image. Start.
Progressive Parsing Transcoding of JPEG Images Λ Johan Garcia, Anna Brunstrom Department of Computer Science Karlstad University, SE-6 88 Karlstad, Sweden E-mail: johan.garcia, anna.brunstrom@kau.se Abstract
More informationJPEG: An Image Compression System. Nimrod Peleg update: Nov. 2003
JPEG: An Image Compression System Nimrod Peleg update: Nov. 2003 Basic Structure Source Image Data Reconstructed Image Data Encoder Compressed Data Decoder Encoder Structure Source Image Data Compressed
More informationParallelized Progressive Network Coding with Hardware Acceleration
Parallelized Progressive Network Coding with Hardware Acceleration Hassan Shojania, Baochun Li Department of Electrical and Computer Engineering University of Toronto Network coding Information is coded
More informationThe Standardization process
JPEG2000 The Standardization process International Organization for Standardization (ISO) 75 Member Nations 150+ Technical Committees 600+ Subcommittees 1500+ Working Groups International Electrotechnical
More informationA LOW-COMPLEXITY AND LOSSLESS REFERENCE FRAME ENCODER ALGORITHM FOR VIDEO CODING
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) A LOW-COMPLEXITY AND LOSSLESS REFERENCE FRAME ENCODER ALGORITHM FOR VIDEO CODING Dieison Silveira, Guilherme Povala,
More informationUniversity of Mustansiriyah, Baghdad, Iraq
Volume 5, Issue 9, September 2015 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Audio Compression
More informationCloud Transcoder: Bridging the Format and Resolution Gap between Internet Videos and Mobile Devices
Cloud Transcoder: Bridging the Format and Resolution Gap between Internet Videos and Mobile Devices Zhenhua Li, Peking University Yan Huang, Gang Liu, Fuchen Wang, Tencent Research Zhi-Li Zhang, University
More informationUsing Virtual Texturing to Handle Massive Texture Data
Using Virtual Texturing to Handle Massive Texture Data San Jose Convention Center - Room A1 Tuesday, September, 21st, 14:00-14:50 J.M.P. Van Waveren id Software Evan Hart NVIDIA How we describe our environment?
More informationCascade Mapping: Optimizing Memory Efficiency for Flash-based Key-value Caching
Cascade Mapping: Optimizing Memory Efficiency for Flash-based Key-value Caching Kefei Wang and Feng Chen Louisiana State University SoCC '18 Carlsbad, CA Key-value Systems in Internet Services Key-value
More informationRADEON X1000 Memory Controller
RADEON X1000 Memory Controller Ring Bus Memory Controller Supports today s fastest graphics memory devices GDDR3, 48+ GB/sec 512-bit Ring Bus Simplifies layout and enables extreme memory clock scaling
More informationError resilience capabilities (cont d R=0.5 bit/pixel, ber=0.001
Error resilience capabilities (cont d R=0.5 bit/pixel, ber=0.001 FLC (NTNU) VLC cont d) Error resilience capabilities (cont d) Re-synch marker at packet boundaries Ability to locate errors in a packet
More informationFinding a needle in Haystack: Facebook's photo storage
Finding a needle in Haystack: Facebook's photo storage The paper is written at facebook and describes a object storage system called Haystack. Since facebook processes a lot of photos (20 petabytes total,
More informationAcceleration Systems Technical Overview. September 2014, v1.4
Acceleration Systems Technical Overview September 2014, v1.4 Acceleration Systems 2014 Table of Contents 3 Background 3 Cloud-Based Bandwidth Optimization 4 Optimizations 5 Protocol Optimization 5 CIFS
More informationEC-Bench: Benchmarking Onload and Offload Erasure Coders on Modern Hardware Architectures
EC-Bench: Benchmarking Onload and Offload Erasure Coders on Modern Hardware Architectures Haiyang Shi, Xiaoyi Lu, and Dhabaleswar K. (DK) Panda {shi.876, lu.932, panda.2}@osu.edu The Ohio State University
More informationReducing Solid-State Storage Device Write Stress Through Opportunistic In-Place Delta Compression
Reducing Solid-State Storage Device Write Stress Through Opportunistic In-Place Delta Compression Xuebin Zhang, Jiangpeng Li, Hao Wang, Kai Zhao and Tong Zhang xuebinzhang.rpi@gmail.com ECSE Department,
More informationBuilding an Area-optimized Multi-format Video Encoder IP. Tomi Jalonen VP Sales
Building an Area-optimized Multi-format Video Encoder IP Tomi Jalonen VP Sales www.allegrodvt.com Allegro DVT Founded in 2003 Privately owned, based in Grenoble (France) Two product lines: 1) Industry
More informationMulti-structured redundancy. Eno Thereska, Phil Gosset, Richard Harper Microsoft Research, Cambridge UK [HotStorage 12]
Multi-structured redundancy Eno Thereska, Phil Gosset, Richard Harper Microsoft Research, Cambridge UK [HotStorage 12] Motivation Language/APIs {put, get,...},, {create, read, write, },, {addnode, AddEdge,
More informationCSE 451: Operating Systems Spring Module 12 Secondary Storage. Steve Gribble
CSE 451: Operating Systems Spring 2009 Module 12 Secondary Storage Steve Gribble Secondary storage Secondary storage typically: is anything that is outside of primary memory does not permit direct execution
More informationLETTER Improvement of JPEG Compression Efficiency Using Information Hiding and Image Restoration
IEICE TRANS. INF. & SYST., VOL.E96 D, NO.5 MAY 2013 1233 LETTER Improvement of JPEG Compression Efficiency Using Information Hiding and Image Restoration Kazumi YAMAWAKI, Member, Fumiya NAKANO, Student
More informationLaboratoire d'informatique, de Robotique et de Microélectronique de Montpellier Montpellier Cedex 5 France
Video Compression Zafar Javed SHAHID, Marc CHAUMONT and William PUECH Laboratoire LIRMM VOODDO project Laboratoire d'informatique, de Robotique et de Microélectronique de Montpellier LIRMM UMR 5506 Université
More informationDigiPoints Volume 1. Student Workbook. Module 8 Digital Compression
Digital Compression Page 8.1 DigiPoints Volume 1 Module 8 Digital Compression Summary This module describes the techniques by which digital signals are compressed in order to make it possible to carry
More informationECE 634: Digital Video Systems Scalable coding: 3/23/17
ECE 634: Digital Video Systems Scalable coding: 3/23/17 Professor Amy Reibman MSEE 356 reibman@purdue.edu hip://engineering.purdue.edu/~reibman/ece634/index.html Scalability Outline IntroducNon: Heterogeneous
More informationIntroduction to Video Compression
Insight, Analysis, and Advice on Signal Processing Technology Introduction to Video Compression Jeff Bier Berkeley Design Technology, Inc. info@bdti.com http://www.bdti.com Outline Motivation and scope
More informationPerformance Tuning on the Blackfin Processor
1 Performance Tuning on the Blackfin Processor Outline Introduction Building a Framework Memory Considerations Benchmarks Managing Shared Resources Interrupt Management An Example Summary 2 Introduction
More informationJPEG 2000 Implementation Guide
JPEG 2000 Implementation Guide James Kasner NSES Kodak james.kasner@kodak.com +1 703 383 0383 x225 Why Have an Implementation Guide? With all of the details in the JPEG 2000 standard (ISO/IEC 15444-1),
More informationCS5950 / CS6030 Cloud Computing
CS5950 / CS6030 Cloud Computing http://www.cs.wmich.edu/gupta/teaching/cs6030/6030clouds17/cs6030cloud.php Ajay Gupta B239, CEAS Computer Science Department Western Michigan University ajay.gupta@wmich.edu
More informationROI Based Image Compression in Baseline JPEG
168-173 RESEARCH ARTICLE OPEN ACCESS ROI Based Image Compression in Baseline JPEG M M M Kumar Varma #1, Madhuri. Bagadi #2 Associate professor 1, M.Tech Student 2 Sri Sivani College of Engineering, Department
More informationLIST OF TABLES. Table 5.1 Specification of mapping of idx to cij for zig-zag scan 46. Table 5.2 Macroblock types 46
LIST OF TABLES TABLE Table 5.1 Specification of mapping of idx to cij for zig-zag scan 46 Table 5.2 Macroblock types 46 Table 5.3 Inverse Scaling Matrix values 48 Table 5.4 Specification of QPC as function
More informationApplication and Desktop Sharing. Omer Boyaci November 1, 2007
Application and Desktop Sharing Omer Boyaci November 1, 2007 Overview Introduction Demo Architecture Challenges Features Conclusion Application Sharing Models Application specific + Efficient - Participants
More informationJPEG: An Image Compression System
JPEG: An Image Compression System ISO/IEC DIS 10918-1 ITU-T Recommendation T.81 http://www.jpeg.org/ Nimrod Peleg update: April 2007 Basic Structure Source Image Data Reconstructed Image Data Encoder Compressed
More informationLow-complexity video compression based on 3-D DWT and fast entropy coding
Low-complexity video compression based on 3-D DWT and fast entropy coding Evgeny Belyaev Tampere University of Technology Department of Signal Processing, Computational Imaging Group April 8, Evgeny Belyaev
More informationLecture 6: Texturing Part II: Texture Compression and GPU Latency Hiding Mechanisms. Visual Computing Systems CMU , Fall 2014
Lecture 6: Texturing Part II: Texture Compression and GPU Latency Hiding Mechanisms Visual Computing Systems Review: mechanisms to reduce aliasing in the graphics pipeline When sampling visibility?! -
More informationThe Scope of Picture and Video Coding Standardization
H.120 H.261 Video Coding Standards MPEG-1 and MPEG-2/H.262 H.263 MPEG-4 H.264 / MPEG-4 AVC Thomas Wiegand: Digital Image Communication Video Coding Standards 1 The Scope of Picture and Video Coding Standardization
More informationFinding a Needle in a Haystack. Facebook s Photo Storage Jack Hartner
Finding a Needle in a Haystack Facebook s Photo Storage Jack Hartner Paper Outline Introduction Background & Previous Design Design & Implementation Evaluation Related Work Conclusion Facebook Photo Storage
More informationStorage. CS 3410 Computer System Organization & Programming
Storage CS 3410 Computer System Organization & Programming These slides are the product of many rounds of teaching CS 3410 by Deniz Altinbuke, Kevin Walsh, and Professors Weatherspoon, Bala, Bracy, and
More informationICS RESEARCH TECHNICAL TALK DRAKE TETREAULT, ICS H197 FALL 2013
ICS RESEARCH TECHNICAL TALK DRAKE TETREAULT, ICS H197 FALL 2013 TOPIC: RESEARCH PAPER Title: Data Management for SSDs for Large-Scale Interactive Graphics Applications Authors: M. Gopi, Behzad Sajadi,
More informationCHAPTER 5 RATIO-MODIFIED BLOCK TRUNCATION CODING FOR REDUCED BITRATES
77 CHAPTER 5 RATIO-MODIFIED BLOCK TRUNCATION CODING FOR REDUCED BITRATES 5.1 INTRODUCTION In this chapter, two algorithms for Modified Block Truncation Coding (MBTC) are proposed for reducing the bitrate
More informationSECURED SOCIAL TUBE FOR VIDEO SHARING IN OSN SYSTEM
ABSTRACT: SECURED SOCIAL TUBE FOR VIDEO SHARING IN OSN SYSTEM J.Priyanka 1, P.Rajeswari 2 II-M.E(CS) 1, H.O.D / ECE 2, Dhanalakshmi Srinivasan Engineering College, Perambalur. Recent years have witnessed
More informationReal-Time Buffer Compression. Michael Doggett Department of Computer Science Lund university
Real-Time Buffer Compression Michael Doggett Department of Computer Science Lund university Project 3D graphics project Demo, Game Implement 3D graphics algorithm(s) C++/OpenGL(Lab2)/iOS/android/3D engine
More informationLawrence Ying Sr Tech Lead, Google Platforms Aug 9, 2018
Lawrence Ying Sr Tech Lead, Google Platforms Aug 9, 2018 Agenda Common fallacy: HDDs will soon be replaced by SSDs Common fallacy: WORN data dominate storage in Cloud Storing the world
More informationFundamentals of Video Compression. Video Compression
Fundamentals of Video Compression Introduction to Digital Video Basic Compression Techniques Still Image Compression Techniques - JPEG Video Compression Introduction to Digital Video Video is a stream
More informationIMAGE COMPRESSION. October 7, ICSY Lab, University of Kaiserslautern, Germany
Lossless Compression Multimedia File Formats Lossy Compression IMAGE COMPRESSION 69 Basic Encoding Steps 70 JPEG (Overview) Image preparation and coding (baseline system) 71 JPEG (Enoding) 1) select color
More informationIn-Memory Data Management
In-Memory Data Management Martin Faust Research Assistant Research Group of Prof. Hasso Plattner Hasso Plattner Institute for Software Engineering University of Potsdam Agenda 2 1. Changed Hardware 2.
More informationComparison of EBCOT Technique Using HAAR Wavelet and Hadamard Transform
Comparison of EBCOT Technique Using HAAR Wavelet and Hadamard Transform S. Aruna Deepthi, Vibha D. Kulkarni, Dr.K. Jaya Sankar Department of Electronics and Communication Engineering, Vasavi College of
More informationLecture 3 Image and Video (MPEG) Coding
CS 598KN Advanced Multimedia Systems Design Lecture 3 Image and Video (MPEG) Coding Klara Nahrstedt Fall 2017 Overview JPEG Compression MPEG Basics MPEG-4 MPEG-7 JPEG COMPRESSION JPEG Compression 8x8 blocks
More informationRobust Image Identification without any Visible Information for Double-Compressed JPEG Images
Robust Image Identification without any Visible Information for Double-Compressed JPEG Images Kenta Iida and Hitoshi Kiya Tokyo Metropolitan University, Tokyo, Japan E-mail: iida-kenta1@ed.tmu.ac.jp, kiya@tmu.ac.jp
More informationA Novel Fast Self-restoration Semi-fragile Watermarking Algorithm for Image Content Authentication Resistant to JPEG Compression
A Novel Fast Self-restoration Semi-fragile Watermarking Algorithm for Image Content Authentication Resistant to JPEG Compression Hui Wang, Anthony TS Ho and Xi Zhao 24 th October 2011 Outline Background
More informationBe Fast, Cheap and in Control with SwitchKV Xiaozhou Li
Be Fast, Cheap and in Control with SwitchKV Xiaozhou Li Raghav Sethi Michael Kaminsky David G. Andersen Michael J. Freedman Goal: fast and cost-effective key-value store Target: cluster-level storage for
More informationInsight: that s for NSA Decision making: that s for Google, Facebook. so they find the best way to push out adds and products
What is big data? Big data is high-volume, high-velocity and high-variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making.
More informationirtc: Live Broadcasting
1 irtc: Live Broadcasting Delivering ultra-low-latency media at massive scale with LiveSwitch and WebRTC Introduction In the early days of the Internet and personal computing, it wasn t uncommon to wait
More informationSetting up Flickr. Open a web browser such as Internet Explorer and type this url in the address bar.
Workshop 15 th July 2008 Page 1 http://blog.larkin.net.au/ Setting up Flickr Flickr is a photo sharing tool that has rich functionality and allows the public to share their photographs with others., It
More informationGroup Testing for Image Compression
Group Testing for Image Compression Edwin Hong and Richard Ladner. IEEE Transations on Image Processing. Aug. 2003 By Chih-Yu (Joey) Tang November 22, 2006 The Concept of Group Testing Identify Army recruits
More informationLecture 8 JPEG Compression (Part 3)
CS 414 Multimedia Systems Design Lecture 8 JPEG Compression (Part 3) Klara Nahrstedt Spring 2011 Administrative MP1 is posted Extended Deadline of MP1 is February 18 Friday midnight submit via compass
More informationLive P2P Streaming with Scalable Video Coding and Network Coding
School of Computing Science Simon Fraser University, Canada Live P2P Streaming with Scalable Video Coding and Network Coding Mohamed dhefeeda (Joint work with Shabnam Mirshokraie) 22 February 2010 Mohamed
More informationContent-Based Adaptive Binary Arithmetic Coding (CABAC) Li Li 2017/2/9
Content-Based Adaptive Binary Arithmetic Coding (CABAC) Li Li 2017/2/9 Name: Li Li Self-introduction Email: lil1@umkc.edu Education 2007-2011 Bachelor USTC 2011-2016 PhD USTC Houqiang Li 2016- Postdoc
More informationBi-Level Image Compression
Bi-Level Image Compression EECE 545: Data Compression by Dave Tompkins The University of British Columbia http://spmg.ece.ubc.ca Overview Introduction to Bi-Level Image Compression Existing Facsimile Standards:
More informationADAPTIVE PICTURE SLICING FOR DISTORTION-BASED CLASSIFICATION OF VIDEO PACKETS
ADAPTIVE PICTURE SLICING FOR DISTORTION-BASED CLASSIFICATION OF VIDEO PACKETS E. Masala, D. Quaglia, J.C. De Martin Λ Dipartimento di Automatica e Informatica/ Λ IRITI-CNR Politecnico di Torino, Italy
More informationThe Best-Performance Digital Video Recorder JPEG2000 DVR V.S M-PEG & MPEG4(H.264)
The Best-Performance Digital Video Recorder JPEG2000 DVR V.S M-PEG & MPEG4(H.264) Many DVRs in the market But it takes brains to make the best product JPEG2000 The best picture quality in playback. Brief
More informationMPEG-2. And Scalability Support. Nimrod Peleg Update: July.2004
MPEG-2 And Scalability Support Nimrod Peleg Update: July.2004 MPEG-2 Target...Generic coding method of moving pictures and associated sound for...digital storage, TV broadcasting and communication... Dedicated
More informationThe Ultimate Social Media Setup Checklist. fans like your page before you can claim your custom URL, and it cannot be changed once you
Facebook Decide on your custom URL: The length can be between 5 50 characters. You must have 25 fans like your page before you can claim your custom URL, and it cannot be changed once you have originally
More informationA DEDUPLICATION-INSPIRED FAST DELTA COMPRESSION APPROACH W EN XIA, HONG JIANG, DA N FENG, LEI T I A N, M I N FU, YUKUN Z HOU
A DEDUPLICATION-INSPIRED FAST DELTA COMPRESSION APPROACH W EN XIA, HONG JIANG, DA N FENG, LEI T I A N, M I N FU, YUKUN Z HOU PRESENTED BY ROMAN SHOR Overview Technics of data reduction in storage systems:
More informationLow-Memory Packetized SPIHT Image Compression
Low-Memory Packetized SPIHT Image Compression Frederick W. Wheeler and William A. Pearlman Rensselaer Polytechnic Institute Electrical, Computer and Systems Engineering Dept. Troy, NY 12180, USA wheeler@cipr.rpi.edu,
More informationMS Word Training Pictures and Text Wrapping
MS Word Training Pictures and Text Wrapping Introduction Adding pictures to your document can be a great way to illustrate important information and add decorative accents to existing text. Used in moderation,
More informationRTP Payload format for Application and Desktop Sharing
RTP Payload format for Application and Desktop Sharing Omer Boyaci & Henning Schulzrinne November 18, 2008 1 Application Sharing Sharing an application with multiple users There is only one copy of the
More informationERDAS APOLLO PERFORMANCE BENCHMARK ECW DELIVERY PERFORMANCE OF ERDAS APOLLO VERSUS ESRI ARCGIS FOR SERVER
ERDAS APOLLO PERFORMANCE BENCHMARK ECW DELIVERY PERFORMANCE OF ERDAS APOLLO VERSUS ESRI ARCGIS FOR SERVER White Paper April 14, 2014 Contents Introduction... 3 Sample Dataset... 4 Test Hardware... 5 Summary...
More information06/12/2017. Image compression. Image compression. Image compression. Image compression. Coding redundancy: image 1 has four gray levels
Theoretical size of a file representing a 5k x 4k colour photograph: 5000 x 4000 x 3 = 60 MB 1 min of UHD tv movie: 3840 x 2160 x 3 x 24 x 60 = 36 GB 1. Exploit coding redundancy 2. Exploit spatial and
More informationMy Own Web Site. Ian Whiting
My Own Web Site Ian Whiting Last updated: 9 December 013 I am regularly asked to suggest how someone might create their own photographic web site. I am assuming that you are not an expert at building web
More informationGridGraph: Large-Scale Graph Processing on a Single Machine Using 2-Level Hierarchical Partitioning. Xiaowei ZHU Tsinghua University
GridGraph: Large-Scale Graph Processing on a Single Machine Using -Level Hierarchical Partitioning Xiaowei ZHU Tsinghua University Widely-Used Graph Processing Shared memory Single-node & in-memory Ligra,
More informationCassandra- A Distributed Database
Cassandra- A Distributed Database Tulika Gupta Department of Information Technology Poornima Institute of Engineering and Technology Jaipur, Rajasthan, India Abstract- A relational database is a traditional
More informationJPEG IMAGE CODING WITH ADAPTIVE QUANTIZATION
JPEG IMAGE CODING WITH ADAPTIVE QUANTIZATION Julio Pons 1, Miguel Mateo 1, Josep Prades 2, Román Garcia 1 Universidad Politécnica de Valencia Spain 1 {jpons,mimateo,roman}@disca.upv.es 2 jprades@dcom.upv.es
More informationPASTE: A Networking API for Non-Volatile Main Memory
PASTE: A Networking API for Non-Volatile Main Memory Michio Honda (NEC Laboratories Europe) Lars Eggert (NetApp) Douglas Santry (NetApp) TSVAREA@IETF 99, Prague May 22th 2017 More details at our HotNets
More informationCSE502: Computer Architecture CSE 502: Computer Architecture
CSE 502: Computer Architecture Memory Hierarchy & Caches Motivation 10000 Performance 1000 100 10 Processor Memory 1 1985 1990 1995 2000 2005 2010 Want memory to appear: As fast as CPU As large as required
More informationECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective
ECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective Part II: Data Center Software Architecture: Topic 3: Programming Models RCFile: A Fast and Space-efficient Data
More informationRPT: Re-architecting Loss Protection for Content-Aware Networks
RPT: Re-architecting Loss Protection for Content-Aware Networks Dongsu Han, Ashok Anand ǂ, Aditya Akella ǂ, and Srinivasan Seshan Carnegie Mellon University ǂ University of Wisconsin-Madison Motivation:
More informationPick a time window size w. In time span w, are there, Multiple References, to nearby addresses: Spatial Locality
Pick a time window size w. In time span w, are there, Multiple References, to nearby addresses: Spatial Locality Repeated References, to a set of locations: Temporal Locality Take advantage of behavior
More informationCombined Copyright Protection and Error Detection Scheme for H.264/AVC
Combined Copyright Protection and Error Detection Scheme for H.264/AVC XIAOMING CHEN, YUK YING CHUNG, FANGFEI XU, AHMED FAWZI OTOOM, *CHANGSEOK BAE School of Information Technologies, The University of
More informationSmart Video Transcoding Solution for Surveillance Applications. White Paper. AvidBeam Technologies 12/2/15
Smart Video Transcoding Solution for Surveillance Applications AvidBeam Technologies 12/2/15 Table of Contents Introduction... 2 AvidBeam Smart Video Transcoding Solution... 2 Portability Solution for
More informationCompression of 3-Dimensional Medical Image Data Using Part 2 of JPEG 2000
Page 1 Compression of 3-Dimensional Medical Image Data Using Part 2 of JPEG 2000 Alexis Tzannes, Ph.D. Aware, Inc. Nov. 24, 2003 1. Introduction JPEG 2000 is the new ISO standard for image compression
More informationCODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM. Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala
CODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala Tampere University of Technology Korkeakoulunkatu 1, 720 Tampere, Finland ABSTRACT In
More informationThe Existing DCT-Based JPEG Standard. Bernie Brower
The Existing DCT-Based JPEG Standard 1 What Is JPEG? The JPEG (Joint Photographic Experts Group) committee, formed in 1986, has been chartered with the Digital compression and coding of continuous-tone
More informationDelta Compressed and Deduplicated Storage Using Stream-Informed Locality
Delta Compressed and Deduplicated Storage Using Stream-Informed Locality Philip Shilane, Grant Wallace, Mark Huang, and Windsor Hsu Backup Recovery Systems Division EMC Corporation Abstract For backup
More informationNon-Blocking Writes to Files
Non-Blocking Writes to Files Daniel Campello, Hector Lopez, Luis Useche 1, Ricardo Koller 2, and Raju Rangaswami 1 Google, Inc. 2 IBM TJ Watson Memory Memory Synchrony vs Asynchrony Applications have different
More informationCSE 451: Operating Systems Spring Module 12 Secondary Storage
CSE 451: Operating Systems Spring 2017 Module 12 Secondary Storage John Zahorjan 1 Secondary storage Secondary storage typically: is anything that is outside of primary memory does not permit direct execution
More information