Survey of the Mathematics of Big Data
|
|
- Imogene Spencer
- 6 years ago
- Views:
Transcription
1 Survey of the Mathematics of Big Data Issues with Big Data, Mathematics to the Rescue Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) Math & Big Data Fall / 28
2 Introduction We survey some mathematical techniques used with Big Data. The goal here is to make you aware of these techniques rather than giving you detail about them. This will be done later on, at least for some of the techniques we survey. Philippe B. Laval (KSU) Math & Big Data Fall / 28
3 Outline 1 Issues with Big Data 2 How Can Mathematics Help Types of Data Mathematics to the Rescue! 3 Acquisition of Data Information Content Compressed Sensing 4 Data Analysis 5 Conclusion High Dimensional Data Imaging Data Philippe B. Laval (KSU) Math & Big Data Fall / 28
4 Issues with Big Data We live in a digital world, which generates a lot of data. New technologies produce enormous amount of data. We are gathering more data than ever, even from old technologies. Problem: Acquisition/storage, analysis and transmission of data. Total data generated > total storage. Increase in generation rate >> increase in communication rate. Analysis can be very complex. Problem: Data is noisy, unstructured and dynamic. Philippe B. Laval (KSU) Math & Big Data Fall / 28
5 How Can Mathematics Help? One answer is given in a video from a previous lecture, remembering that many of the skills mathematicians have are needed in programming. But also, mathematics......allows us to formalize both the data and the problem....provides a big "chest" of tools or methodologies....allows validation of the methodologies (proof of functionality). Philippe B. Laval (KSU) Math & Big Data Fall / 28
6 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Philippe B. Laval (KSU) Math & Big Data Fall / 28
7 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Philippe B. Laval (KSU) Math & Big Data Fall / 28
8 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Remove noise from the signal (PDE techniques, Fourier transform, wavelets, statistics) Philippe B. Laval (KSU) Math & Big Data Fall / 28
9 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Remove noise from the signal (PDE techniques, Fourier transform, wavelets, statistics) Extract features from the signal. Philippe B. Laval (KSU) Math & Big Data Fall / 28
10 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Remove noise from the signal (PDE techniques, Fourier transform, wavelets, statistics) Extract features from the signal. The next slide shows a clean signal (red), some noise (green) and a noisy signal. Philippe B. Laval (KSU) Math & Big Data Fall / 28
11 How Can Mathematics Help? - Types of Data Philippe B. Laval (KSU) Math & Big Data Fall / 28
12 How Can Mathematics Help? - Types of Data Images. Can be represented by a function f : R 2 R Philippe B. Laval (KSU) Math & Big Data Fall / 28
13 How Can Mathematics Help? - Types of Data Images. Can be represented by a function f : R 2 R Put a grid on the image (the finer the grid, the highest the resolution). Each cell of the grid contains a positive integer indicating a gray level (for gray images). That s the function f. For color images (RGB), each cell is a vector that contains 3 positive integers indicating the amount of Red, Green and Blue. As for signals, once we have f we can enhance the image, remove noise from it, extract features. Philippe B. Laval (KSU) Math & Big Data Fall / 28
14 Experiment: Clean Image and Image With 20% Noise Animated version Philippe B. Laval (KSU) Math & Big Data Fall / 28
15 Experiment: Clean Image and Image With 50% Noise Animated version Philippe B. Laval (KSU) Math & Big Data Fall / 28
16 How Can Mathematics Help? - Types of Data Data on manifolds. Can be represented by a function f : S 2 R Philippe B. Laval (KSU) Math & Big Data Fall / 28
17 Acquisition of Data As noted above, the main problem is the size of the data. However, this cannot be solved by increasing storage capacity. Possible solutions: Search for better ways to compress. Acquire less data. Philippe B. Laval (KSU) Math & Big Data Fall / 28
18 Acquisition of Data - Better Ways to Compress Data Compression saves storage but also decreases bandwidth. General ideas behind compression: Take advantage of redundant information. Only keep the most relevant information. Einstein: "Not everything that can be counted counts, and not everything that counts can be counted." Philippe B. Laval (KSU) Math & Big Data Fall / 28
19 Acquisition of Data - Better Ways to Compress The standard for data compression was JPEG. It is based on the discrete cosine transform (DCT) (see Fourier analysis, Fourier transform, fast Fourier transform (FFT) and the discrete fast Fourier transform (DFFT). It expresses the image in terms of building blocks, the functions cos [ π n ( i ) k ]. Definition The DCT is a linear, invertible function f : R n R n. It transforms the numbers (x 0, x 1,..., x n 1 ) into (X 0, X 1,..., X n 1 ) by the formula n 1 [ ( π X k = x i cos i + 1 ) ] k n 2 i=0 for k = 0, 1,..., n 1 Philippe B. Laval (KSU) Math & Big Data Fall / 28
20 Acquisition of Data - Better Ways to Compress The latest standard for data compression is JPEG2000. It is similar to JPEG, but it uses wavelets instead of the discrete cosine transform. The branch of mathematics which studies wavelets is called Harmonic Analysis. Like the DCT, wavelets decompose the image in terms of building blocks. But the building blocks are not limited to the cosine function. Both the DCT and wavelets use the divide and conquer method. Decompose an image in terms of its building blocks. Only keep the most relevant building blocks. Philippe B. Laval (KSU) Math & Big Data Fall / 28
21 Acquisition of Data - Better Ways to Compress Problem: The raw data still has to be stored first Solution: Compressed sensing (Donoho, Candès, Romberg, Tao (2006) Philippe B. Laval (KSU) Math & Big Data Fall / 28
22 Acquisition of Data - Compressed Sensing Main idea: Goal: Assumption: Only a small percentage of the data to be captured is really relevant (sparse data). Problem: We don t know which. Solution: Use random building blocks. This is pushing the sampling theorem beyond its limits! Goal: To capture a signal with as few points as possible. Thus the raw data will be already compressed. Requires a lot of linear algebra, solving sparse systems. Philippe B. Laval (KSU) Math & Big Data Fall / 28
23 Applications of Compressed Sensing Business Compression Astronomy Radar Biology Communications Imaging Science Geology Medicine Information theory Remote sensing Optics Philippe B. Laval (KSU) Math & Big Data Fall / 28
24 Data Analysis There are many techniques, statistical and mathematical which already exist. Problem: The analysis maybe be too complex for current computing power. Data can be noisy, unstructured and dynamic. However, these problems cannot be simply solved by more computing power. Possible solutions include: Graph Theory. TDA (Topological Data Analysis). Philippe B. Laval (KSU) Math & Big Data Fall / 28
25 Data Analysis - High-Dimensional Data Strategy: Detection of inner structure. Reduction of dimension Examples: A circle can be approximated by lines. A sphere can be approximated by flat surfaces. Philippe B. Laval (KSU) Math & Big Data Fall / 28
26 Data Analysis - High-Dimensional Data Philippe B. Laval (KSU) Math & Big Data Fall / 28
27 Data Analysis - High-Dimensional Data Question: How do we identify inner structure? By using topology. The link will open a website. Scroll down to play the video. Philippe B. Laval (KSU) Math & Big Data Fall / 28
28 Data Analysis - Imaging Data Tasks: Removing Noise. Pattern recognition. Reconstructing missing data.... Tools: Statistics. Fourier and harmonic analysis. Partial differential equations. Compressed sensing. Linear Algebra. Philippe B. Laval (KSU) Math & Big Data Fall / 28
29 Conclusion Big Data is here to stay. We need to tame it! The techniques presented are fairly diffi cult and require a lot knowledge in various branches of mathematics, statistics and science. Not everybody needs to be a mathematician. But chances are you will work with one. Knowing at least some mathematics will make the communication and the teamwork easier. Questions? Philippe B. Laval (KSU) Math & Big Data Fall / 28
30 Some Questions 1 Name some new technologies which generate data which were not mentioned during the talk. 2 Give examples of unstructured data not mentioned during the talk. 3 Why is removing noise from data (images as well as other data) important? 4 Give applications of pattern recognition in images. Philippe B. Laval (KSU) Math & Big Data Fall / 28
31 Online Articles to Read 1 The Mathematical Shape of Things to Come from Quanta Magazine. 2 The Real Secret to Unlocking Big Data? Math. 3 The New Shape of Big Data. 4 New Mathematical Method May Help Tame Big Data from Communications of the ACM. 5 Better Way to Make Sense of Big Data from Science Daily. Philippe B. Laval (KSU) Math & Big Data Fall / 28
The Mathematics of Big Data
The Mathematics of Big Data Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) Math & Big Data Fall 2017 1 / 10 Introduction We briefly present Big Data and the issues associated with Big Data. Philippe
More informationRectangular Coordinates in Space
Rectangular Coordinates in Space Philippe B. Laval KSU Today Philippe B. Laval (KSU) Rectangular Coordinates in Space Today 1 / 11 Introduction We quickly review one and two-dimensional spaces and then
More informationImage Processing. Filtering. Slide 1
Image Processing Filtering Slide 1 Preliminary Image generation Original Noise Image restoration Result Slide 2 Preliminary Classic application: denoising However: Denoising is much more than a simple
More informationECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis
ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis Yuejie Chi Departments of ECE and BMI The Ohio State University September 24, 2015 Time, location, and office hours Time: Tue/Thu
More informationPreparation Meeting. Recent Advances in the Analysis of 3D Shapes. Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers
Preparation Meeting Recent Advances in the Analysis of 3D Shapes Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers What You Will Learn in the Seminar Get an overview on state of the art
More informationDiscrete Wavelets and Image Processing
Discrete Wavelets and Image Processing Helmut Knaust Department of Mathematical Sciences The University of Texas at El Paso El Paso TX 79968-0514 hknaust@utep.edu October 16, 2009 Math 5311: Applied Mathematics
More informationCompressive Sensing for Multimedia. Communications in Wireless Sensor Networks
Compressive Sensing for Multimedia 1 Communications in Wireless Sensor Networks Wael Barakat & Rabih Saliba MDDSP Project Final Report Prof. Brian L. Evans May 9, 2008 Abstract Compressive Sensing is an
More informationTomographic reconstruction: the challenge of dark information. S. Roux
Tomographic reconstruction: the challenge of dark information S. Roux Meeting on Tomography and Applications, Politecnico di Milano, 20-22 April, 2015 Tomography A mature technique, providing an outstanding
More informationResearch in Computational Differential Geomet
Research in Computational Differential Geometry November 5, 2014 Approximations Often we have a series of approximations which we think are getting close to looking like some shape. Approximations Often
More informationModern Signal Processing and Sparse Coding
Modern Signal Processing and Sparse Coding School of Electrical and Computer Engineering Georgia Institute of Technology March 22 2011 Reason D etre Modern signal processing Signals without cosines? Sparse
More informationIntroduction to the Mathematics of Big Data. Philippe B. Laval
Introduction to the Mathematics of Big Data Philippe B. Laval Fall 2017 Introduction In recent years, Big Data has become more than just a buzz word. Every major field of science, engineering, business,
More informationMassive Data Analysis
Professor, Department of Electrical and Computer Engineering Tennessee Technological University February 25, 2015 Big Data This talk is based on the report [1]. The growth of big data is changing that
More informationCompressed Sensing and Applications by using Dictionaries in Image Processing
Advances in Computational Sciences and Technology ISSN 0973-6107 Volume 10, Number 2 (2017) pp. 165-170 Research India Publications http://www.ripublication.com Compressed Sensing and Applications by using
More informationWhat is a... Manifold?
What is a... Manifold? Steve Hurder Manifolds happens all the time! We just have to know them when we see them. Manifolds have dimension, just like Euclidean space: 1-dimension is the line, 2-dimension
More informationPlanar Graphs and Surfaces. Graphs 2 1/58
Planar Graphs and Surfaces Graphs 2 1/58 Last time we discussed the Four Color Theorem, which says that any map can be colored with at most 4 colors and not have two regions that share a border having
More informationTracking Computer Vision Spring 2018, Lecture 24
Tracking http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 24 Course announcements Homework 6 has been posted and is due on April 20 th. - Any questions about the homework? - How
More informationCHAPTER 9 INPAINTING USING SPARSE REPRESENTATION AND INVERSE DCT
CHAPTER 9 INPAINTING USING SPARSE REPRESENTATION AND INVERSE DCT 9.1 Introduction In the previous chapters the inpainting was considered as an iterative algorithm. PDE based method uses iterations to converge
More informationVideo Compression An Introduction
Video Compression An Introduction The increasing demand to incorporate video data into telecommunications services, the corporate environment, the entertainment industry, and even at home has made digital
More informationImage Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi
Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi 1. Introduction The choice of a particular transform in a given application depends on the amount of
More informationThe Normal Curve. June 20, Bryan T. Karazsia, M.A.
The Normal Curve June 20, 2006 Bryan T. Karazsia, M.A. Overview Hand-in Homework Why are distributions so important (particularly the normal distribution)? What is the normal distribution? Z-scores Using
More informationVolume 2, Issue 9, September 2014 ISSN
Fingerprint Verification of the Digital Images by Using the Discrete Cosine Transformation, Run length Encoding, Fourier transformation and Correlation. Palvee Sharma 1, Dr. Rajeev Mahajan 2 1M.Tech Student
More informationRedundant Data Elimination for Image Compression and Internet Transmission using MATLAB
Redundant Data Elimination for Image Compression and Internet Transmission using MATLAB R. Challoo, I.P. Thota, and L. Challoo Texas A&M University-Kingsville Kingsville, Texas 78363-8202, U.S.A. ABSTRACT
More informationG009 Scale and Direction-guided Interpolation of Aliased Seismic Data in the Curvelet Domain
G009 Scale and Direction-guided Interpolation of Aliased Seismic Data in the Curvelet Domain M. Naghizadeh* (University of Alberta) & M. Sacchi (University of Alberta) SUMMARY We propose a robust interpolation
More informationData-Driven Modeling. Scientific Computation J. NATHAN KUTZ OXPORD. Methods for Complex Systems & Big Data
Data-Driven Modeling & Scientific Computation Methods for Complex Systems & Big Data J. NATHAN KUTZ Department ofapplied Mathematics University of Washington OXPORD UNIVERSITY PRESS Contents Prolegomenon
More informationDigital Signal Processing. Soma Biswas
Digital Signal Processing Soma Biswas 2017 Partial credit for slides: Dr. Manojit Pramanik Outline What is FFT? Types of FFT covered in this lecture Decimation in Time (DIT) Decimation in Frequency (DIF)
More informationCS 521 Data Mining Techniques Instructor: Abdullah Mueen
CS 521 Data Mining Techniques Instructor: Abdullah Mueen LECTURE 2: DATA TRANSFORMATION AND DIMENSIONALITY REDUCTION Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major Tasks
More informationModule 9 : Numerical Relaying II : DSP Perspective
Module 9 : Numerical Relaying II : DSP Perspective Lecture 36 : Fast Fourier Transform Objectives In this lecture, We will introduce Fast Fourier Transform (FFT). We will show equivalence between FFT and
More informationApplication of Daubechies Wavelets for Image Compression
Application of Daubechies Wavelets for Image Compression Heydari. Aghile 1,*, Naseri.Roghaye 2 1 Department of Math., Payame Noor University, Mashad, IRAN, Email Address a_heidari@pnu.ac.ir, Funded by
More informationEE123 Digital Signal Processing
EE123 Digital Signal Processing Lecture 24 Compressed Sensing III M. Lustig, EECS UC Berkeley RADIOS https://inst.eecs.berkeley.edu/~ee123/ sp15/radio.html Interfaces and radios on Wednesday -- please
More informationCS 335 Graphics and Multimedia. Image Compression
CS 335 Graphics and Multimedia Image Compression CCITT Image Storage and Compression Group 3: Huffman-type encoding for binary (bilevel) data: FAX Group 4: Entropy encoding without error checks of group
More informationAn introduction to JPEG compression using MATLAB
An introduction to JPEG compression using MATLAB Arno Swart 30 October, 2003 1 Introduction This document describes the popular JPEG still image coding format. The aim is to compress images while maintaining
More informationMore Formulas: circles Elementary Education 12
More Formulas: circles Elementary Education 12 As the title indicates, this week we are interested in circles. Before we begin, please take some time to define a circle: Due to the geometric shape of circles,
More informationIntroduction to Functions of Several Variables
Introduction to Functions of Several Variables Philippe B. Laval KSU Today Philippe B. Laval (KSU) Functions of Several Variables Today 1 / 20 Introduction In this section, we extend the definition of
More informationOutcomes List for Math Multivariable Calculus (9 th edition of text) Spring
Outcomes List for Math 200-200935 Multivariable Calculus (9 th edition of text) Spring 2009-2010 The purpose of the Outcomes List is to give you a concrete summary of the material you should know, and
More informationA Image Comparative Study using DCT, Fast Fourier, Wavelet Transforms and Huffman Algorithm
International Journal of Engineering Research and General Science Volume 3, Issue 4, July-August, 15 ISSN 91-2730 A Image Comparative Study using DCT, Fast Fourier, Wavelet Transforms and Huffman Algorithm
More informationGame Mathematics. (12 Week Lesson Plan)
Game Mathematics (12 Week Lesson Plan) Lesson 1: Set Theory Textbook: Chapter One (pgs. 1 15) We begin the course by introducing the student to a new vocabulary and set of rules that will be foundational
More information4. Image Retrieval using Transformed Image Content
4. Image Retrieval using Transformed Image Content The desire of better and faster retrieval techniques has always fuelled to the research in content based image retrieval (CBIR). A class of unitary matrices
More informationDCT image denoising: a simple and effective image denoising algorithm
IPOL Journal Image Processing On Line DCT image denoising: a simple and effective image denoising algorithm Guoshen Yu, Guillermo Sapiro article demo archive published reference 2011-10-24 GUOSHEN YU,
More informationReview for the Final
Review for the Final CS 635 Review (Topics Covered) Image Compression Lossless Coding Compression Huffman Interpixel RLE Lossy Quantization Discrete Cosine Transform JPEG CS 635 Review (Topics Covered)
More informationCompression of RADARSAT Data with Block Adaptive Wavelets Abstract: 1. Introduction
Compression of RADARSAT Data with Block Adaptive Wavelets Ian Cumming and Jing Wang Department of Electrical and Computer Engineering The University of British Columbia 2356 Main Mall, Vancouver, BC, Canada
More informationGeometry. Course Requirements
Geometry Geometry is a full year, high school math course for the student who has successfully completed the prerequisite course, Algebra I. The course focuses on the skills and methods of linear, coordinate,
More informationCompressive Sensing for High-Dimensional Data
Compressive Sensing for High-Dimensional Data Richard Baraniuk Rice University dsp.rice.edu/cs DIMACS Workshop on Recent Advances in Mathematics and Information Sciences for Analysis and Understanding
More information(Refer Slide Time 3:31)
Digital Circuits and Systems Prof. S. Srinivasan Department of Electrical Engineering Indian Institute of Technology Madras Lecture - 5 Logic Simplification In the last lecture we talked about logic functions
More informationG Practical Magnetic Resonance Imaging II Sackler Institute of Biomedical Sciences New York University School of Medicine. Compressed Sensing
G16.4428 Practical Magnetic Resonance Imaging II Sackler Institute of Biomedical Sciences New York University School of Medicine Compressed Sensing Ricardo Otazo, PhD ricardo.otazo@nyumc.org Compressed
More informationA Brief Look at Optimization
A Brief Look at Optimization CSC 412/2506 Tutorial David Madras January 18, 2018 Slides adapted from last year s version Overview Introduction Classes of optimization problems Linear programming Steepest
More informationMeasurements and Bits: Compressed Sensing meets Information Theory. Dror Baron ECE Department Rice University dsp.rice.edu/cs
Measurements and Bits: Compressed Sensing meets Information Theory Dror Baron ECE Department Rice University dsp.rice.edu/cs Sensing by Sampling Sample data at Nyquist rate Compress data using model (e.g.,
More informationdiverging. We will be using simplified symbols of ideal lenses:
Chapter 4 Lenses A good reading for the beginning may be this Wikipedia article, down to the section Lensmaker s Equation (but not including). Beginning from the Lensmaker s Equation section the article
More informationComputational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision
Computational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision Part II of the sequel of 2 talks. Computation C/QC geometry was presented by Tony F. Chan Ronald Lok Ming Lui Department
More informationCPSC 535 Assignment 1: Introduction to Matlab and Octave
CPSC 535 Assignment 1: Introduction to Matlab and Octave The goal of this assignment is to become familiar with Matlab and Octave as tools for scientific investigation. Matlab, a product of Mathworks,
More informationEngineering Mathematics II Lecture 16 Compression
010.141 Engineering Mathematics II Lecture 16 Compression Bob McKay School of Computer Science and Engineering College of Engineering Seoul National University 1 Lossless Compression Outline Huffman &
More informationFourier Transforms and Signal Analysis
Fourier Transforms and Signal Analysis The Fourier transform analysis is one of the most useful ever developed in Physical and Analytical chemistry. Everyone knows that FTIR is based on it, but did one
More informationMRT based Fixed Block size Transform Coding
3 MRT based Fixed Block size Transform Coding Contents 3.1 Transform Coding..64 3.1.1 Transform Selection...65 3.1.2 Sub-image size selection... 66 3.1.3 Bit Allocation.....67 3.2 Transform coding using
More informationMATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007
MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007 Dr. Marcus Agustin email: magusti@siue.edu Office: SL 1325 1. Simulation Study of Software Reliability Models Prerequisites:
More informationRGB Digital Image Forgery Detection Using Singular Value Decomposition and One Dimensional Cellular Automata
RGB Digital Image Forgery Detection Using Singular Value Decomposition and One Dimensional Cellular Automata Ahmad Pahlavan Tafti Mohammad V. Malakooti Department of Computer Engineering IAU, UAE Branch
More informationEfficient Imaging Algorithms on Many-Core Platforms
Efficient Imaging Algorithms on Many-Core Platforms H. Köstler Dagstuhl, 22.11.2011 Contents Imaging Applications HDR Compression performance of PDE-based models Image Denoising performance of patch-based
More informationCompressed Point Cloud Visualizations
Compressed Point Cloud Visualizations Christopher Miller October 2, 2007 Outline Description of The Problem Description of The Wedgelet Algorithm Statistical Preprocessing Intrinsic Point Cloud Simplification
More informationFinal Review. Image Processing CSE 166 Lecture 18
Final Review Image Processing CSE 166 Lecture 18 Topics covered Basis vectors Matrix based transforms Wavelet transform Image compression Image watermarking Morphological image processing Segmentation
More informationDYADIC WAVELETS AND DCT BASED BLIND COPY-MOVE IMAGE FORGERY DETECTION
DYADIC WAVELETS AND DCT BASED BLIND COPY-MOVE IMAGE FORGERY DETECTION Ghulam Muhammad*,1, Muhammad Hussain 2, Anwar M. Mirza 1, and George Bebis 3 1 Department of Computer Engineering, 2 Department of
More informationESE 531: Digital Signal Processing
ESE 531: Digital Signal Processing Lec 23: April 20, 2017 Compressive Sensing Penn ESE 531 Spring 2017 Khanna Previously! Today " DTFT, DFT, FFT practice " Compressive Sampling/Sensing Penn ESE 531 Spring
More informationLossy Compression of Scientific Data with Wavelet Transforms
Chris Fleizach Progress Report Lossy Compression of Scientific Data with Wavelet Transforms Introduction Scientific data gathered from simulation or real measurement usually requires 64 bit floating point
More information(Refer Slide Time 00:17) Welcome to the course on Digital Image Processing. (Refer Slide Time 00:22)
Digital Image Processing Prof. P. K. Biswas Department of Electronics and Electrical Communications Engineering Indian Institute of Technology, Kharagpur Module Number 01 Lecture Number 02 Application
More informationSEG/New Orleans 2006 Annual Meeting
and its implications for the curvelet design Hervé Chauris, Ecole des Mines de Paris Summary This paper is a first attempt towards the migration of seismic data in the curvelet domain for heterogeneous
More informationCompressive Sensing Based Image Reconstruction using Wavelet Transform
Compressive Sensing Based Image Reconstruction using Wavelet Transform Sherin C Abraham #1, Ketki Pathak *2, Jigna J Patel #3 # Electronics & Communication department, Gujarat Technological University
More informationScientific Visualization Example exam questions with commented answers
Scientific Visualization Example exam questions with commented answers The theoretical part of this course is evaluated by means of a multiple- choice exam. The questions cover the material mentioned during
More informationIMAGE COMPRESSION USING FOURIER TRANSFORMS
IMAGE COMPRESSION USING FOURIER TRANSFORMS Kevin Cherry May 2, 2008 Math 4325 Compression is a technique for storing files in less space than would normally be required. This in general, has two major
More informationImage Compression. CS 6640 School of Computing University of Utah
Image Compression CS 6640 School of Computing University of Utah Compression What Reduce the amount of information (bits) needed to represent image Why Transmission Storage Preprocessing Redundant & Irrelevant
More informationx 2 + 3, r 4(x) = x2 1
Math 121 (Lesieutre); 4.2: Rational functions; September 1, 2017 1. What is a rational function? It s a function of the form p(x), where p(x) and q(x) are both polynomials. In other words, q(x) something
More informationAn Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010
An Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010 Luminita Vese Todd WiCman Department of Mathema2cs, UCLA lvese@math.ucla.edu wicman@math.ucla.edu
More informationToday. Lecture 4: Last time. The EM algorithm. We examine clustering in a little more detail; we went over it a somewhat quickly last time
Today Lecture 4: We examine clustering in a little more detail; we went over it a somewhat quickly last time The CAD data will return and give us an opportunity to work with curves (!) We then examine
More informationMath 144 Activity #4 Connecting the unit circle to the graphs of the trig functions
144 p 1 Math 144 Activity #4 Connecting the unit circle to the graphs of the trig functions Graphing the sine function We are going to begin this activity with graphing the sine function ( y = sin x).
More informationPRIMES Circle: High School Math Enrichment at MIT
PRIMES Circle: High School Math Enrichment at MIT Department of Mathematics, MIT ivogt@mit.edu June 25th, 2015 PRIMES Umbrella organization: research and outreach Four programs: MIT PRIMES: research on
More informationReplacement of Missing Data and Outliers Using Wavelet Transform Methods
Replacement of Missing Data and Outliers Using Wavelet Transform Methods Liqian Zhang, Research Associate Department of Chemical and Materials Engineering University of Alberta Outline 2 1. Motivation
More informationIsn t it Saturday? IMO Trainning Camp NUK, 2004_06_19 2
2004 6 19 Isn t it Saturday? IMO Trainning Camp NUK, 2004_06_19 2 But, I guess you want to be the IMO Trainning Camp NUK, 2004_06_19 3 So, let s go! IMO Trainning Camp NUK, 2004_06_19 4 Outline Brief introduction
More informationP257 Transform-domain Sparsity Regularization in Reconstruction of Channelized Facies
P257 Transform-domain Sparsity Regularization in Reconstruction of Channelized Facies. azemi* (University of Alberta) & H.R. Siahkoohi (University of Tehran) SUMMARY Petrophysical reservoir properties,
More informationNon-Differentiable Image Manifolds
The Multiscale Structure of Non-Differentiable Image Manifolds Michael Wakin Electrical l Engineering i Colorado School of Mines Joint work with Richard Baraniuk, Hyeokho Choi, David Donoho Models for
More informationTransportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 12/24/2009 1
Machine Vision Transportation Informatics Group University of Klagenfurt Alireza Fasih, 2009 12/24/2009 1 Address: L4.2.02, Lakeside Park, Haus B04, Ebene 2, Klagenfurt-Austria Image Processing & Transforms
More informationMAS.963 Special Topics: Computational Camera and Photography
MIT OpenCourseWare http://ocw.mit.edu MAS.963 Special Topics: Computational Camera and Photography Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationIllustrated Guide to the. UTeach. Electronic Portfolio
Illustrated Guide to the UTeach Electronic Portfolio UTeach Portfolio Guide 1 Revised Spring 2011 The Electronic Portfolio All UTeach students have access to the electronic portfolio. If you can t log
More informationLecture 12 Level Sets & Parametric Transforms. sec & ch. 11 of Machine Vision by Wesley E. Snyder & Hairong Qi
Lecture 12 Level Sets & Parametric Transforms sec. 8.5.2 & ch. 11 of Machine Vision by Wesley E. Snyder & Hairong Qi Spring 2017 16-725 (CMU RI) : BioE 2630 (Pitt) Dr. John Galeotti The content of these
More informationError-Correcting Codes
Error-Correcting Codes Michael Mo 10770518 6 February 2016 Abstract An introduction to error-correcting codes will be given by discussing a class of error-correcting codes, called linear block codes. The
More informationSAMLab Tip Sheet #1 Translating Mathematical Formulas Into Excel s Language
Translating Mathematical Formulas Into Excel s Language Introduction Microsoft Excel is a very powerful calculator; you can use it to compute a wide variety of mathematical expressions. Before exploring
More informationChapter 7. Conclusions and Future Work
Chapter 7 Conclusions and Future Work In this dissertation, we have presented a new way of analyzing a basic building block in computer graphics rendering algorithms the computational interaction between
More informationIntroduction to Topics in Machine Learning
Introduction to Topics in Machine Learning Namrata Vaswani Department of Electrical and Computer Engineering Iowa State University Namrata Vaswani 1/ 27 Compressed Sensing / Sparse Recovery: Given y :=
More informationBlock Diagram. Physical World. Image Acquisition. Enhancement and Restoration. Segmentation. Feature Selection/Extraction.
Block Diagram Physical World Image Acquisition Imaging Image Sampling, Quantization, Compression Image Processing Enhancement and Restoration Segmentation Image Analysis Feature Selection/Extraction Image
More informationProgram Changes Computer Systems Engineering
Department of Systems & Computer Engineering 1/11 Program Changes Computer Systems Engineering Department of Systems and Computer Engineering, Carleton University, Canada Why Are We Here? Substantial changes
More informationOn the Shape of Data
On the Shape of Data Caren Marzban!, Ulvi Yurtsever 2 1 Applied Physics Lab, and Dept of Statistics, University of Washington, Seattle, WA 98195 2 MathSense Analytics, 1273 Sunny Oaks Circle, Altadena,
More informationImage deblurring by multigrid methods. Department of Physics and Mathematics University of Insubria
Image deblurring by multigrid methods Marco Donatelli Stefano Serra-Capizzano Department of Physics and Mathematics University of Insubria Outline 1 Restoration of blurred and noisy images The model problem
More informationProgram Changes Communications Engineering
Department of Systems & Computer Engineering 1/12 Program Changes Communications Engineering Department of Systems and Computer Engineering, Carleton University, Canada Why Are We Here? Substantial changes
More informationVLSI Implementation of Daubechies Wavelet Filter for Image Compression
IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 7, Issue 6, Ver. I (Nov.-Dec. 2017), PP 13-17 e-issn: 2319 4200, p-issn No. : 2319 4197 www.iosrjournals.org VLSI Implementation of Daubechies
More informationOptimal transport and redistricting: numerical experiments and a few questions. Nestor Guillen University of Massachusetts
Optimal transport and redistricting: numerical experiments and a few questions Nestor Guillen University of Massachusetts From Rebecca Solnit s Hope in the dark (apropos of nothing in particular) To hope
More informationIncoherent noise suppression with curvelet-domain sparsity Vishal Kumar, EOS-UBC and Felix J. Herrmann, EOS-UBC
Incoherent noise suppression with curvelet-domain sparsity Vishal Kumar, EOS-UBC and Felix J. Herrmann, EOS-UBC SUMMARY The separation of signal and noise is a key issue in seismic data processing. By
More informationLimited view X-ray CT for dimensional analysis
Limited view X-ray CT for dimensional analysis G. A. JONES ( GLENN.JONES@IMPERIAL.AC.UK ) P. HUTHWAITE ( P.HUTHWAITE@IMPERIAL.AC.UK ) NON-DESTRUCTIVE EVALUATION GROUP 1 Outline of talk Industrial X-ray
More informationOne of the big complaints from remote
Remote Access Response Time Blues Robin Layland Robin Layland is president of Layland Consulting, a firm that specializes in network architecture and new technology. He has more than 25 years experience
More informationIntegrated Math, Part C Chapter 1 SUPPLEMENTARY AND COMPLIMENTARY ANGLES
Integrated Math, Part C Chapter SUPPLEMENTARY AND COMPLIMENTARY ANGLES Key Concepts: By the end of this lesson, you should understand:! Complements! Supplements! Adjacent Angles! Linear Pairs! Vertical
More informationMITOCW watch?v=kz7jjltq9r4
MITOCW watch?v=kz7jjltq9r4 PROFESSOR: We're going to look at the most fundamental of all mathematical data types, namely sets, and let's begin with the definitions. So informally, a set is a collection
More informationStructurally Random Matrices
Fast Compressive Sampling Using Structurally Random Matrices Presented by: Thong Do (thongdo@jhu.edu) The Johns Hopkins University A joint work with Prof. Trac Tran, The Johns Hopkins University it Dr.
More informationName Course Days/Start Time
Name Course Days/Start Time Mini-Project : The Library of Functions In your previous math class, you learned to graph equations containing two variables by finding and plotting points. In this class, we
More informationWavelet Transform (WT) & JPEG-2000
Chapter 8 Wavelet Transform (WT) & JPEG-2000 8.1 A Review of WT 8.1.1 Wave vs. Wavelet [castleman] 1 0-1 -2-3 -4-5 -6-7 -8 0 100 200 300 400 500 600 Figure 8.1 Sinusoidal waves (top two) and wavelets (bottom
More informationImage Compression Using Modified Fast Haar Wavelet Transform
World Applied Sciences Journal 7 (5): 67-653, 009 ISSN 88-95 IDOSI Publications, 009 Image Compression Using Modified Fast Haar Wavelet Transform Anuj Bhardwaj and Rashid Ali Department of Mathematics,
More informationCryptography. What is Cryptography?
Cryptography What is Cryptography? Cryptography is the discipline of encoding and decoding messages. It has been employed in various forms for thousands of years, and, whether or not you know it, is used
More information