Survey of the Mathematics of Big Data

Size: px
Start display at page:

Download "Survey of the Mathematics of Big Data"

Transcription

1 Survey of the Mathematics of Big Data Issues with Big Data, Mathematics to the Rescue Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) Math & Big Data Fall / 28

2 Introduction We survey some mathematical techniques used with Big Data. The goal here is to make you aware of these techniques rather than giving you detail about them. This will be done later on, at least for some of the techniques we survey. Philippe B. Laval (KSU) Math & Big Data Fall / 28

3 Outline 1 Issues with Big Data 2 How Can Mathematics Help Types of Data Mathematics to the Rescue! 3 Acquisition of Data Information Content Compressed Sensing 4 Data Analysis 5 Conclusion High Dimensional Data Imaging Data Philippe B. Laval (KSU) Math & Big Data Fall / 28

4 Issues with Big Data We live in a digital world, which generates a lot of data. New technologies produce enormous amount of data. We are gathering more data than ever, even from old technologies. Problem: Acquisition/storage, analysis and transmission of data. Total data generated > total storage. Increase in generation rate >> increase in communication rate. Analysis can be very complex. Problem: Data is noisy, unstructured and dynamic. Philippe B. Laval (KSU) Math & Big Data Fall / 28

5 How Can Mathematics Help? One answer is given in a video from a previous lecture, remembering that many of the skills mathematicians have are needed in programming. But also, mathematics......allows us to formalize both the data and the problem....provides a big "chest" of tools or methodologies....allows validation of the methodologies (proof of functionality). Philippe B. Laval (KSU) Math & Big Data Fall / 28

6 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Philippe B. Laval (KSU) Math & Big Data Fall / 28

7 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Philippe B. Laval (KSU) Math & Big Data Fall / 28

8 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Remove noise from the signal (PDE techniques, Fourier transform, wavelets, statistics) Philippe B. Laval (KSU) Math & Big Data Fall / 28

9 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Remove noise from the signal (PDE techniques, Fourier transform, wavelets, statistics) Extract features from the signal. Philippe B. Laval (KSU) Math & Big Data Fall / 28

10 How Can Mathematics Help? - Types of Data Signals. Can be represented by a function f : R R Once the signal is represented by f, we can: Enhance the signal. Remove noise from the signal (PDE techniques, Fourier transform, wavelets, statistics) Extract features from the signal. The next slide shows a clean signal (red), some noise (green) and a noisy signal. Philippe B. Laval (KSU) Math & Big Data Fall / 28

11 How Can Mathematics Help? - Types of Data Philippe B. Laval (KSU) Math & Big Data Fall / 28

12 How Can Mathematics Help? - Types of Data Images. Can be represented by a function f : R 2 R Philippe B. Laval (KSU) Math & Big Data Fall / 28

13 How Can Mathematics Help? - Types of Data Images. Can be represented by a function f : R 2 R Put a grid on the image (the finer the grid, the highest the resolution). Each cell of the grid contains a positive integer indicating a gray level (for gray images). That s the function f. For color images (RGB), each cell is a vector that contains 3 positive integers indicating the amount of Red, Green and Blue. As for signals, once we have f we can enhance the image, remove noise from it, extract features. Philippe B. Laval (KSU) Math & Big Data Fall / 28

14 Experiment: Clean Image and Image With 20% Noise Animated version Philippe B. Laval (KSU) Math & Big Data Fall / 28

15 Experiment: Clean Image and Image With 50% Noise Animated version Philippe B. Laval (KSU) Math & Big Data Fall / 28

16 How Can Mathematics Help? - Types of Data Data on manifolds. Can be represented by a function f : S 2 R Philippe B. Laval (KSU) Math & Big Data Fall / 28

17 Acquisition of Data As noted above, the main problem is the size of the data. However, this cannot be solved by increasing storage capacity. Possible solutions: Search for better ways to compress. Acquire less data. Philippe B. Laval (KSU) Math & Big Data Fall / 28

18 Acquisition of Data - Better Ways to Compress Data Compression saves storage but also decreases bandwidth. General ideas behind compression: Take advantage of redundant information. Only keep the most relevant information. Einstein: "Not everything that can be counted counts, and not everything that counts can be counted." Philippe B. Laval (KSU) Math & Big Data Fall / 28

19 Acquisition of Data - Better Ways to Compress The standard for data compression was JPEG. It is based on the discrete cosine transform (DCT) (see Fourier analysis, Fourier transform, fast Fourier transform (FFT) and the discrete fast Fourier transform (DFFT). It expresses the image in terms of building blocks, the functions cos [ π n ( i ) k ]. Definition The DCT is a linear, invertible function f : R n R n. It transforms the numbers (x 0, x 1,..., x n 1 ) into (X 0, X 1,..., X n 1 ) by the formula n 1 [ ( π X k = x i cos i + 1 ) ] k n 2 i=0 for k = 0, 1,..., n 1 Philippe B. Laval (KSU) Math & Big Data Fall / 28

20 Acquisition of Data - Better Ways to Compress The latest standard for data compression is JPEG2000. It is similar to JPEG, but it uses wavelets instead of the discrete cosine transform. The branch of mathematics which studies wavelets is called Harmonic Analysis. Like the DCT, wavelets decompose the image in terms of building blocks. But the building blocks are not limited to the cosine function. Both the DCT and wavelets use the divide and conquer method. Decompose an image in terms of its building blocks. Only keep the most relevant building blocks. Philippe B. Laval (KSU) Math & Big Data Fall / 28

21 Acquisition of Data - Better Ways to Compress Problem: The raw data still has to be stored first Solution: Compressed sensing (Donoho, Candès, Romberg, Tao (2006) Philippe B. Laval (KSU) Math & Big Data Fall / 28

22 Acquisition of Data - Compressed Sensing Main idea: Goal: Assumption: Only a small percentage of the data to be captured is really relevant (sparse data). Problem: We don t know which. Solution: Use random building blocks. This is pushing the sampling theorem beyond its limits! Goal: To capture a signal with as few points as possible. Thus the raw data will be already compressed. Requires a lot of linear algebra, solving sparse systems. Philippe B. Laval (KSU) Math & Big Data Fall / 28

23 Applications of Compressed Sensing Business Compression Astronomy Radar Biology Communications Imaging Science Geology Medicine Information theory Remote sensing Optics Philippe B. Laval (KSU) Math & Big Data Fall / 28

24 Data Analysis There are many techniques, statistical and mathematical which already exist. Problem: The analysis maybe be too complex for current computing power. Data can be noisy, unstructured and dynamic. However, these problems cannot be simply solved by more computing power. Possible solutions include: Graph Theory. TDA (Topological Data Analysis). Philippe B. Laval (KSU) Math & Big Data Fall / 28

25 Data Analysis - High-Dimensional Data Strategy: Detection of inner structure. Reduction of dimension Examples: A circle can be approximated by lines. A sphere can be approximated by flat surfaces. Philippe B. Laval (KSU) Math & Big Data Fall / 28

26 Data Analysis - High-Dimensional Data Philippe B. Laval (KSU) Math & Big Data Fall / 28

27 Data Analysis - High-Dimensional Data Question: How do we identify inner structure? By using topology. The link will open a website. Scroll down to play the video. Philippe B. Laval (KSU) Math & Big Data Fall / 28

28 Data Analysis - Imaging Data Tasks: Removing Noise. Pattern recognition. Reconstructing missing data.... Tools: Statistics. Fourier and harmonic analysis. Partial differential equations. Compressed sensing. Linear Algebra. Philippe B. Laval (KSU) Math & Big Data Fall / 28

29 Conclusion Big Data is here to stay. We need to tame it! The techniques presented are fairly diffi cult and require a lot knowledge in various branches of mathematics, statistics and science. Not everybody needs to be a mathematician. But chances are you will work with one. Knowing at least some mathematics will make the communication and the teamwork easier. Questions? Philippe B. Laval (KSU) Math & Big Data Fall / 28

30 Some Questions 1 Name some new technologies which generate data which were not mentioned during the talk. 2 Give examples of unstructured data not mentioned during the talk. 3 Why is removing noise from data (images as well as other data) important? 4 Give applications of pattern recognition in images. Philippe B. Laval (KSU) Math & Big Data Fall / 28

31 Online Articles to Read 1 The Mathematical Shape of Things to Come from Quanta Magazine. 2 The Real Secret to Unlocking Big Data? Math. 3 The New Shape of Big Data. 4 New Mathematical Method May Help Tame Big Data from Communications of the ACM. 5 Better Way to Make Sense of Big Data from Science Daily. Philippe B. Laval (KSU) Math & Big Data Fall / 28

The Mathematics of Big Data

The Mathematics of Big Data The Mathematics of Big Data Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) Math & Big Data Fall 2017 1 / 10 Introduction We briefly present Big Data and the issues associated with Big Data. Philippe

More information

Rectangular Coordinates in Space

Rectangular Coordinates in Space Rectangular Coordinates in Space Philippe B. Laval KSU Today Philippe B. Laval (KSU) Rectangular Coordinates in Space Today 1 / 11 Introduction We quickly review one and two-dimensional spaces and then

More information

Image Processing. Filtering. Slide 1

Image Processing. Filtering. Slide 1 Image Processing Filtering Slide 1 Preliminary Image generation Original Noise Image restoration Result Slide 2 Preliminary Classic application: denoising However: Denoising is much more than a simple

More information

ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis

ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis Yuejie Chi Departments of ECE and BMI The Ohio State University September 24, 2015 Time, location, and office hours Time: Tue/Thu

More information

Preparation Meeting. Recent Advances in the Analysis of 3D Shapes. Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers

Preparation Meeting. Recent Advances in the Analysis of 3D Shapes. Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers Preparation Meeting Recent Advances in the Analysis of 3D Shapes Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers What You Will Learn in the Seminar Get an overview on state of the art

More information

Discrete Wavelets and Image Processing

Discrete Wavelets and Image Processing Discrete Wavelets and Image Processing Helmut Knaust Department of Mathematical Sciences The University of Texas at El Paso El Paso TX 79968-0514 hknaust@utep.edu October 16, 2009 Math 5311: Applied Mathematics

More information

Compressive Sensing for Multimedia. Communications in Wireless Sensor Networks

Compressive Sensing for Multimedia. Communications in Wireless Sensor Networks Compressive Sensing for Multimedia 1 Communications in Wireless Sensor Networks Wael Barakat & Rabih Saliba MDDSP Project Final Report Prof. Brian L. Evans May 9, 2008 Abstract Compressive Sensing is an

More information

Tomographic reconstruction: the challenge of dark information. S. Roux

Tomographic reconstruction: the challenge of dark information. S. Roux Tomographic reconstruction: the challenge of dark information S. Roux Meeting on Tomography and Applications, Politecnico di Milano, 20-22 April, 2015 Tomography A mature technique, providing an outstanding

More information

Research in Computational Differential Geomet

Research in Computational Differential Geomet Research in Computational Differential Geometry November 5, 2014 Approximations Often we have a series of approximations which we think are getting close to looking like some shape. Approximations Often

More information

Modern Signal Processing and Sparse Coding

Modern Signal Processing and Sparse Coding Modern Signal Processing and Sparse Coding School of Electrical and Computer Engineering Georgia Institute of Technology March 22 2011 Reason D etre Modern signal processing Signals without cosines? Sparse

More information

Introduction to the Mathematics of Big Data. Philippe B. Laval

Introduction to the Mathematics of Big Data. Philippe B. Laval Introduction to the Mathematics of Big Data Philippe B. Laval Fall 2017 Introduction In recent years, Big Data has become more than just a buzz word. Every major field of science, engineering, business,

More information

Massive Data Analysis

Massive Data Analysis Professor, Department of Electrical and Computer Engineering Tennessee Technological University February 25, 2015 Big Data This talk is based on the report [1]. The growth of big data is changing that

More information

Compressed Sensing and Applications by using Dictionaries in Image Processing

Compressed Sensing and Applications by using Dictionaries in Image Processing Advances in Computational Sciences and Technology ISSN 0973-6107 Volume 10, Number 2 (2017) pp. 165-170 Research India Publications http://www.ripublication.com Compressed Sensing and Applications by using

More information

What is a... Manifold?

What is a... Manifold? What is a... Manifold? Steve Hurder Manifolds happens all the time! We just have to know them when we see them. Manifolds have dimension, just like Euclidean space: 1-dimension is the line, 2-dimension

More information

Planar Graphs and Surfaces. Graphs 2 1/58

Planar Graphs and Surfaces. Graphs 2 1/58 Planar Graphs and Surfaces Graphs 2 1/58 Last time we discussed the Four Color Theorem, which says that any map can be colored with at most 4 colors and not have two regions that share a border having

More information

Tracking Computer Vision Spring 2018, Lecture 24

Tracking Computer Vision Spring 2018, Lecture 24 Tracking http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 24 Course announcements Homework 6 has been posted and is due on April 20 th. - Any questions about the homework? - How

More information

CHAPTER 9 INPAINTING USING SPARSE REPRESENTATION AND INVERSE DCT

CHAPTER 9 INPAINTING USING SPARSE REPRESENTATION AND INVERSE DCT CHAPTER 9 INPAINTING USING SPARSE REPRESENTATION AND INVERSE DCT 9.1 Introduction In the previous chapters the inpainting was considered as an iterative algorithm. PDE based method uses iterations to converge

More information

Video Compression An Introduction

Video Compression An Introduction Video Compression An Introduction The increasing demand to incorporate video data into telecommunications services, the corporate environment, the entertainment industry, and even at home has made digital

More information

Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi

Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi 1. Introduction The choice of a particular transform in a given application depends on the amount of

More information

The Normal Curve. June 20, Bryan T. Karazsia, M.A.

The Normal Curve. June 20, Bryan T. Karazsia, M.A. The Normal Curve June 20, 2006 Bryan T. Karazsia, M.A. Overview Hand-in Homework Why are distributions so important (particularly the normal distribution)? What is the normal distribution? Z-scores Using

More information

Volume 2, Issue 9, September 2014 ISSN

Volume 2, Issue 9, September 2014 ISSN Fingerprint Verification of the Digital Images by Using the Discrete Cosine Transformation, Run length Encoding, Fourier transformation and Correlation. Palvee Sharma 1, Dr. Rajeev Mahajan 2 1M.Tech Student

More information

Redundant Data Elimination for Image Compression and Internet Transmission using MATLAB

Redundant Data Elimination for Image Compression and Internet Transmission using MATLAB Redundant Data Elimination for Image Compression and Internet Transmission using MATLAB R. Challoo, I.P. Thota, and L. Challoo Texas A&M University-Kingsville Kingsville, Texas 78363-8202, U.S.A. ABSTRACT

More information

G009 Scale and Direction-guided Interpolation of Aliased Seismic Data in the Curvelet Domain

G009 Scale and Direction-guided Interpolation of Aliased Seismic Data in the Curvelet Domain G009 Scale and Direction-guided Interpolation of Aliased Seismic Data in the Curvelet Domain M. Naghizadeh* (University of Alberta) & M. Sacchi (University of Alberta) SUMMARY We propose a robust interpolation

More information

Data-Driven Modeling. Scientific Computation J. NATHAN KUTZ OXPORD. Methods for Complex Systems & Big Data

Data-Driven Modeling. Scientific Computation J. NATHAN KUTZ OXPORD. Methods for Complex Systems & Big Data Data-Driven Modeling & Scientific Computation Methods for Complex Systems & Big Data J. NATHAN KUTZ Department ofapplied Mathematics University of Washington OXPORD UNIVERSITY PRESS Contents Prolegomenon

More information

Digital Signal Processing. Soma Biswas

Digital Signal Processing. Soma Biswas Digital Signal Processing Soma Biswas 2017 Partial credit for slides: Dr. Manojit Pramanik Outline What is FFT? Types of FFT covered in this lecture Decimation in Time (DIT) Decimation in Frequency (DIF)

More information

CS 521 Data Mining Techniques Instructor: Abdullah Mueen

CS 521 Data Mining Techniques Instructor: Abdullah Mueen CS 521 Data Mining Techniques Instructor: Abdullah Mueen LECTURE 2: DATA TRANSFORMATION AND DIMENSIONALITY REDUCTION Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major Tasks

More information

Module 9 : Numerical Relaying II : DSP Perspective

Module 9 : Numerical Relaying II : DSP Perspective Module 9 : Numerical Relaying II : DSP Perspective Lecture 36 : Fast Fourier Transform Objectives In this lecture, We will introduce Fast Fourier Transform (FFT). We will show equivalence between FFT and

More information

Application of Daubechies Wavelets for Image Compression

Application of Daubechies Wavelets for Image Compression Application of Daubechies Wavelets for Image Compression Heydari. Aghile 1,*, Naseri.Roghaye 2 1 Department of Math., Payame Noor University, Mashad, IRAN, Email Address a_heidari@pnu.ac.ir, Funded by

More information

EE123 Digital Signal Processing

EE123 Digital Signal Processing EE123 Digital Signal Processing Lecture 24 Compressed Sensing III M. Lustig, EECS UC Berkeley RADIOS https://inst.eecs.berkeley.edu/~ee123/ sp15/radio.html Interfaces and radios on Wednesday -- please

More information

CS 335 Graphics and Multimedia. Image Compression

CS 335 Graphics and Multimedia. Image Compression CS 335 Graphics and Multimedia Image Compression CCITT Image Storage and Compression Group 3: Huffman-type encoding for binary (bilevel) data: FAX Group 4: Entropy encoding without error checks of group

More information

An introduction to JPEG compression using MATLAB

An introduction to JPEG compression using MATLAB An introduction to JPEG compression using MATLAB Arno Swart 30 October, 2003 1 Introduction This document describes the popular JPEG still image coding format. The aim is to compress images while maintaining

More information

More Formulas: circles Elementary Education 12

More Formulas: circles Elementary Education 12 More Formulas: circles Elementary Education 12 As the title indicates, this week we are interested in circles. Before we begin, please take some time to define a circle: Due to the geometric shape of circles,

More information

Introduction to Functions of Several Variables

Introduction to Functions of Several Variables Introduction to Functions of Several Variables Philippe B. Laval KSU Today Philippe B. Laval (KSU) Functions of Several Variables Today 1 / 20 Introduction In this section, we extend the definition of

More information

Outcomes List for Math Multivariable Calculus (9 th edition of text) Spring

Outcomes List for Math Multivariable Calculus (9 th edition of text) Spring Outcomes List for Math 200-200935 Multivariable Calculus (9 th edition of text) Spring 2009-2010 The purpose of the Outcomes List is to give you a concrete summary of the material you should know, and

More information

A Image Comparative Study using DCT, Fast Fourier, Wavelet Transforms and Huffman Algorithm

A Image Comparative Study using DCT, Fast Fourier, Wavelet Transforms and Huffman Algorithm International Journal of Engineering Research and General Science Volume 3, Issue 4, July-August, 15 ISSN 91-2730 A Image Comparative Study using DCT, Fast Fourier, Wavelet Transforms and Huffman Algorithm

More information

Game Mathematics. (12 Week Lesson Plan)

Game Mathematics. (12 Week Lesson Plan) Game Mathematics (12 Week Lesson Plan) Lesson 1: Set Theory Textbook: Chapter One (pgs. 1 15) We begin the course by introducing the student to a new vocabulary and set of rules that will be foundational

More information

4. Image Retrieval using Transformed Image Content

4. Image Retrieval using Transformed Image Content 4. Image Retrieval using Transformed Image Content The desire of better and faster retrieval techniques has always fuelled to the research in content based image retrieval (CBIR). A class of unitary matrices

More information

DCT image denoising: a simple and effective image denoising algorithm

DCT image denoising: a simple and effective image denoising algorithm IPOL Journal Image Processing On Line DCT image denoising: a simple and effective image denoising algorithm Guoshen Yu, Guillermo Sapiro article demo archive published reference 2011-10-24 GUOSHEN YU,

More information

Review for the Final

Review for the Final Review for the Final CS 635 Review (Topics Covered) Image Compression Lossless Coding Compression Huffman Interpixel RLE Lossy Quantization Discrete Cosine Transform JPEG CS 635 Review (Topics Covered)

More information

Compression of RADARSAT Data with Block Adaptive Wavelets Abstract: 1. Introduction

Compression of RADARSAT Data with Block Adaptive Wavelets Abstract: 1. Introduction Compression of RADARSAT Data with Block Adaptive Wavelets Ian Cumming and Jing Wang Department of Electrical and Computer Engineering The University of British Columbia 2356 Main Mall, Vancouver, BC, Canada

More information

Geometry. Course Requirements

Geometry. Course Requirements Geometry Geometry is a full year, high school math course for the student who has successfully completed the prerequisite course, Algebra I. The course focuses on the skills and methods of linear, coordinate,

More information

Compressive Sensing for High-Dimensional Data

Compressive Sensing for High-Dimensional Data Compressive Sensing for High-Dimensional Data Richard Baraniuk Rice University dsp.rice.edu/cs DIMACS Workshop on Recent Advances in Mathematics and Information Sciences for Analysis and Understanding

More information

(Refer Slide Time 3:31)

(Refer Slide Time 3:31) Digital Circuits and Systems Prof. S. Srinivasan Department of Electrical Engineering Indian Institute of Technology Madras Lecture - 5 Logic Simplification In the last lecture we talked about logic functions

More information

G Practical Magnetic Resonance Imaging II Sackler Institute of Biomedical Sciences New York University School of Medicine. Compressed Sensing

G Practical Magnetic Resonance Imaging II Sackler Institute of Biomedical Sciences New York University School of Medicine. Compressed Sensing G16.4428 Practical Magnetic Resonance Imaging II Sackler Institute of Biomedical Sciences New York University School of Medicine Compressed Sensing Ricardo Otazo, PhD ricardo.otazo@nyumc.org Compressed

More information

A Brief Look at Optimization

A Brief Look at Optimization A Brief Look at Optimization CSC 412/2506 Tutorial David Madras January 18, 2018 Slides adapted from last year s version Overview Introduction Classes of optimization problems Linear programming Steepest

More information

Measurements and Bits: Compressed Sensing meets Information Theory. Dror Baron ECE Department Rice University dsp.rice.edu/cs

Measurements and Bits: Compressed Sensing meets Information Theory. Dror Baron ECE Department Rice University dsp.rice.edu/cs Measurements and Bits: Compressed Sensing meets Information Theory Dror Baron ECE Department Rice University dsp.rice.edu/cs Sensing by Sampling Sample data at Nyquist rate Compress data using model (e.g.,

More information

diverging. We will be using simplified symbols of ideal lenses:

diverging. We will be using simplified symbols of ideal lenses: Chapter 4 Lenses A good reading for the beginning may be this Wikipedia article, down to the section Lensmaker s Equation (but not including). Beginning from the Lensmaker s Equation section the article

More information

Computational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision

Computational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision Computational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision Part II of the sequel of 2 talks. Computation C/QC geometry was presented by Tony F. Chan Ronald Lok Ming Lui Department

More information

CPSC 535 Assignment 1: Introduction to Matlab and Octave

CPSC 535 Assignment 1: Introduction to Matlab and Octave CPSC 535 Assignment 1: Introduction to Matlab and Octave The goal of this assignment is to become familiar with Matlab and Octave as tools for scientific investigation. Matlab, a product of Mathworks,

More information

Engineering Mathematics II Lecture 16 Compression

Engineering Mathematics II Lecture 16 Compression 010.141 Engineering Mathematics II Lecture 16 Compression Bob McKay School of Computer Science and Engineering College of Engineering Seoul National University 1 Lossless Compression Outline Huffman &

More information

Fourier Transforms and Signal Analysis

Fourier Transforms and Signal Analysis Fourier Transforms and Signal Analysis The Fourier transform analysis is one of the most useful ever developed in Physical and Analytical chemistry. Everyone knows that FTIR is based on it, but did one

More information

MRT based Fixed Block size Transform Coding

MRT based Fixed Block size Transform Coding 3 MRT based Fixed Block size Transform Coding Contents 3.1 Transform Coding..64 3.1.1 Transform Selection...65 3.1.2 Sub-image size selection... 66 3.1.3 Bit Allocation.....67 3.2 Transform coding using

More information

MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007

MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007 MATH 498 Brief Description of Some Possible Topics for the Senior Assignment Fall 2007 Dr. Marcus Agustin email: magusti@siue.edu Office: SL 1325 1. Simulation Study of Software Reliability Models Prerequisites:

More information

RGB Digital Image Forgery Detection Using Singular Value Decomposition and One Dimensional Cellular Automata

RGB Digital Image Forgery Detection Using Singular Value Decomposition and One Dimensional Cellular Automata RGB Digital Image Forgery Detection Using Singular Value Decomposition and One Dimensional Cellular Automata Ahmad Pahlavan Tafti Mohammad V. Malakooti Department of Computer Engineering IAU, UAE Branch

More information

Efficient Imaging Algorithms on Many-Core Platforms

Efficient Imaging Algorithms on Many-Core Platforms Efficient Imaging Algorithms on Many-Core Platforms H. Köstler Dagstuhl, 22.11.2011 Contents Imaging Applications HDR Compression performance of PDE-based models Image Denoising performance of patch-based

More information

Compressed Point Cloud Visualizations

Compressed Point Cloud Visualizations Compressed Point Cloud Visualizations Christopher Miller October 2, 2007 Outline Description of The Problem Description of The Wedgelet Algorithm Statistical Preprocessing Intrinsic Point Cloud Simplification

More information

Final Review. Image Processing CSE 166 Lecture 18

Final Review. Image Processing CSE 166 Lecture 18 Final Review Image Processing CSE 166 Lecture 18 Topics covered Basis vectors Matrix based transforms Wavelet transform Image compression Image watermarking Morphological image processing Segmentation

More information

DYADIC WAVELETS AND DCT BASED BLIND COPY-MOVE IMAGE FORGERY DETECTION

DYADIC WAVELETS AND DCT BASED BLIND COPY-MOVE IMAGE FORGERY DETECTION DYADIC WAVELETS AND DCT BASED BLIND COPY-MOVE IMAGE FORGERY DETECTION Ghulam Muhammad*,1, Muhammad Hussain 2, Anwar M. Mirza 1, and George Bebis 3 1 Department of Computer Engineering, 2 Department of

More information

ESE 531: Digital Signal Processing

ESE 531: Digital Signal Processing ESE 531: Digital Signal Processing Lec 23: April 20, 2017 Compressive Sensing Penn ESE 531 Spring 2017 Khanna Previously! Today " DTFT, DFT, FFT practice " Compressive Sampling/Sensing Penn ESE 531 Spring

More information

Lossy Compression of Scientific Data with Wavelet Transforms

Lossy Compression of Scientific Data with Wavelet Transforms Chris Fleizach Progress Report Lossy Compression of Scientific Data with Wavelet Transforms Introduction Scientific data gathered from simulation or real measurement usually requires 64 bit floating point

More information

(Refer Slide Time 00:17) Welcome to the course on Digital Image Processing. (Refer Slide Time 00:22)

(Refer Slide Time 00:17) Welcome to the course on Digital Image Processing. (Refer Slide Time 00:22) Digital Image Processing Prof. P. K. Biswas Department of Electronics and Electrical Communications Engineering Indian Institute of Technology, Kharagpur Module Number 01 Lecture Number 02 Application

More information

SEG/New Orleans 2006 Annual Meeting

SEG/New Orleans 2006 Annual Meeting and its implications for the curvelet design Hervé Chauris, Ecole des Mines de Paris Summary This paper is a first attempt towards the migration of seismic data in the curvelet domain for heterogeneous

More information

Compressive Sensing Based Image Reconstruction using Wavelet Transform

Compressive Sensing Based Image Reconstruction using Wavelet Transform Compressive Sensing Based Image Reconstruction using Wavelet Transform Sherin C Abraham #1, Ketki Pathak *2, Jigna J Patel #3 # Electronics & Communication department, Gujarat Technological University

More information

Scientific Visualization Example exam questions with commented answers

Scientific Visualization Example exam questions with commented answers Scientific Visualization Example exam questions with commented answers The theoretical part of this course is evaluated by means of a multiple- choice exam. The questions cover the material mentioned during

More information

IMAGE COMPRESSION USING FOURIER TRANSFORMS

IMAGE COMPRESSION USING FOURIER TRANSFORMS IMAGE COMPRESSION USING FOURIER TRANSFORMS Kevin Cherry May 2, 2008 Math 4325 Compression is a technique for storing files in less space than would normally be required. This in general, has two major

More information

Image Compression. CS 6640 School of Computing University of Utah

Image Compression. CS 6640 School of Computing University of Utah Image Compression CS 6640 School of Computing University of Utah Compression What Reduce the amount of information (bits) needed to represent image Why Transmission Storage Preprocessing Redundant & Irrelevant

More information

x 2 + 3, r 4(x) = x2 1

x 2 + 3, r 4(x) = x2 1 Math 121 (Lesieutre); 4.2: Rational functions; September 1, 2017 1. What is a rational function? It s a function of the form p(x), where p(x) and q(x) are both polynomials. In other words, q(x) something

More information

An Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010

An Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010 An Introduc+on to Mathema+cal Image Processing IAS, Park City Mathema2cs Ins2tute, Utah Undergraduate Summer School 2010 Luminita Vese Todd WiCman Department of Mathema2cs, UCLA lvese@math.ucla.edu wicman@math.ucla.edu

More information

Today. Lecture 4: Last time. The EM algorithm. We examine clustering in a little more detail; we went over it a somewhat quickly last time

Today. Lecture 4: Last time. The EM algorithm. We examine clustering in a little more detail; we went over it a somewhat quickly last time Today Lecture 4: We examine clustering in a little more detail; we went over it a somewhat quickly last time The CAD data will return and give us an opportunity to work with curves (!) We then examine

More information

Math 144 Activity #4 Connecting the unit circle to the graphs of the trig functions

Math 144 Activity #4 Connecting the unit circle to the graphs of the trig functions 144 p 1 Math 144 Activity #4 Connecting the unit circle to the graphs of the trig functions Graphing the sine function We are going to begin this activity with graphing the sine function ( y = sin x).

More information

PRIMES Circle: High School Math Enrichment at MIT

PRIMES Circle: High School Math Enrichment at MIT PRIMES Circle: High School Math Enrichment at MIT Department of Mathematics, MIT ivogt@mit.edu June 25th, 2015 PRIMES Umbrella organization: research and outreach Four programs: MIT PRIMES: research on

More information

Replacement of Missing Data and Outliers Using Wavelet Transform Methods

Replacement of Missing Data and Outliers Using Wavelet Transform Methods Replacement of Missing Data and Outliers Using Wavelet Transform Methods Liqian Zhang, Research Associate Department of Chemical and Materials Engineering University of Alberta Outline 2 1. Motivation

More information

Isn t it Saturday? IMO Trainning Camp NUK, 2004_06_19 2

Isn t it Saturday? IMO Trainning Camp NUK, 2004_06_19 2 2004 6 19 Isn t it Saturday? IMO Trainning Camp NUK, 2004_06_19 2 But, I guess you want to be the IMO Trainning Camp NUK, 2004_06_19 3 So, let s go! IMO Trainning Camp NUK, 2004_06_19 4 Outline Brief introduction

More information

P257 Transform-domain Sparsity Regularization in Reconstruction of Channelized Facies

P257 Transform-domain Sparsity Regularization in Reconstruction of Channelized Facies P257 Transform-domain Sparsity Regularization in Reconstruction of Channelized Facies. azemi* (University of Alberta) & H.R. Siahkoohi (University of Tehran) SUMMARY Petrophysical reservoir properties,

More information

Non-Differentiable Image Manifolds

Non-Differentiable Image Manifolds The Multiscale Structure of Non-Differentiable Image Manifolds Michael Wakin Electrical l Engineering i Colorado School of Mines Joint work with Richard Baraniuk, Hyeokho Choi, David Donoho Models for

More information

Transportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 12/24/2009 1

Transportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 12/24/2009 1 Machine Vision Transportation Informatics Group University of Klagenfurt Alireza Fasih, 2009 12/24/2009 1 Address: L4.2.02, Lakeside Park, Haus B04, Ebene 2, Klagenfurt-Austria Image Processing & Transforms

More information

MAS.963 Special Topics: Computational Camera and Photography

MAS.963 Special Topics: Computational Camera and Photography MIT OpenCourseWare http://ocw.mit.edu MAS.963 Special Topics: Computational Camera and Photography Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Illustrated Guide to the. UTeach. Electronic Portfolio

Illustrated Guide to the. UTeach. Electronic Portfolio Illustrated Guide to the UTeach Electronic Portfolio UTeach Portfolio Guide 1 Revised Spring 2011 The Electronic Portfolio All UTeach students have access to the electronic portfolio. If you can t log

More information

Lecture 12 Level Sets & Parametric Transforms. sec & ch. 11 of Machine Vision by Wesley E. Snyder & Hairong Qi

Lecture 12 Level Sets & Parametric Transforms. sec & ch. 11 of Machine Vision by Wesley E. Snyder & Hairong Qi Lecture 12 Level Sets & Parametric Transforms sec. 8.5.2 & ch. 11 of Machine Vision by Wesley E. Snyder & Hairong Qi Spring 2017 16-725 (CMU RI) : BioE 2630 (Pitt) Dr. John Galeotti The content of these

More information

Error-Correcting Codes

Error-Correcting Codes Error-Correcting Codes Michael Mo 10770518 6 February 2016 Abstract An introduction to error-correcting codes will be given by discussing a class of error-correcting codes, called linear block codes. The

More information

SAMLab Tip Sheet #1 Translating Mathematical Formulas Into Excel s Language

SAMLab Tip Sheet #1 Translating Mathematical Formulas Into Excel s Language Translating Mathematical Formulas Into Excel s Language Introduction Microsoft Excel is a very powerful calculator; you can use it to compute a wide variety of mathematical expressions. Before exploring

More information

Chapter 7. Conclusions and Future Work

Chapter 7. Conclusions and Future Work Chapter 7 Conclusions and Future Work In this dissertation, we have presented a new way of analyzing a basic building block in computer graphics rendering algorithms the computational interaction between

More information

Introduction to Topics in Machine Learning

Introduction to Topics in Machine Learning Introduction to Topics in Machine Learning Namrata Vaswani Department of Electrical and Computer Engineering Iowa State University Namrata Vaswani 1/ 27 Compressed Sensing / Sparse Recovery: Given y :=

More information

Block Diagram. Physical World. Image Acquisition. Enhancement and Restoration. Segmentation. Feature Selection/Extraction.

Block Diagram. Physical World. Image Acquisition. Enhancement and Restoration. Segmentation. Feature Selection/Extraction. Block Diagram Physical World Image Acquisition Imaging Image Sampling, Quantization, Compression Image Processing Enhancement and Restoration Segmentation Image Analysis Feature Selection/Extraction Image

More information

Program Changes Computer Systems Engineering

Program Changes Computer Systems Engineering Department of Systems & Computer Engineering 1/11 Program Changes Computer Systems Engineering Department of Systems and Computer Engineering, Carleton University, Canada Why Are We Here? Substantial changes

More information

On the Shape of Data

On the Shape of Data On the Shape of Data Caren Marzban!, Ulvi Yurtsever 2 1 Applied Physics Lab, and Dept of Statistics, University of Washington, Seattle, WA 98195 2 MathSense Analytics, 1273 Sunny Oaks Circle, Altadena,

More information

Image deblurring by multigrid methods. Department of Physics and Mathematics University of Insubria

Image deblurring by multigrid methods. Department of Physics and Mathematics University of Insubria Image deblurring by multigrid methods Marco Donatelli Stefano Serra-Capizzano Department of Physics and Mathematics University of Insubria Outline 1 Restoration of blurred and noisy images The model problem

More information

Program Changes Communications Engineering

Program Changes Communications Engineering Department of Systems & Computer Engineering 1/12 Program Changes Communications Engineering Department of Systems and Computer Engineering, Carleton University, Canada Why Are We Here? Substantial changes

More information

VLSI Implementation of Daubechies Wavelet Filter for Image Compression

VLSI Implementation of Daubechies Wavelet Filter for Image Compression IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 7, Issue 6, Ver. I (Nov.-Dec. 2017), PP 13-17 e-issn: 2319 4200, p-issn No. : 2319 4197 www.iosrjournals.org VLSI Implementation of Daubechies

More information

Optimal transport and redistricting: numerical experiments and a few questions. Nestor Guillen University of Massachusetts

Optimal transport and redistricting: numerical experiments and a few questions. Nestor Guillen University of Massachusetts Optimal transport and redistricting: numerical experiments and a few questions Nestor Guillen University of Massachusetts From Rebecca Solnit s Hope in the dark (apropos of nothing in particular) To hope

More information

Incoherent noise suppression with curvelet-domain sparsity Vishal Kumar, EOS-UBC and Felix J. Herrmann, EOS-UBC

Incoherent noise suppression with curvelet-domain sparsity Vishal Kumar, EOS-UBC and Felix J. Herrmann, EOS-UBC Incoherent noise suppression with curvelet-domain sparsity Vishal Kumar, EOS-UBC and Felix J. Herrmann, EOS-UBC SUMMARY The separation of signal and noise is a key issue in seismic data processing. By

More information

Limited view X-ray CT for dimensional analysis

Limited view X-ray CT for dimensional analysis Limited view X-ray CT for dimensional analysis G. A. JONES ( GLENN.JONES@IMPERIAL.AC.UK ) P. HUTHWAITE ( P.HUTHWAITE@IMPERIAL.AC.UK ) NON-DESTRUCTIVE EVALUATION GROUP 1 Outline of talk Industrial X-ray

More information

One of the big complaints from remote

One of the big complaints from remote Remote Access Response Time Blues Robin Layland Robin Layland is president of Layland Consulting, a firm that specializes in network architecture and new technology. He has more than 25 years experience

More information

Integrated Math, Part C Chapter 1 SUPPLEMENTARY AND COMPLIMENTARY ANGLES

Integrated Math, Part C Chapter 1 SUPPLEMENTARY AND COMPLIMENTARY ANGLES Integrated Math, Part C Chapter SUPPLEMENTARY AND COMPLIMENTARY ANGLES Key Concepts: By the end of this lesson, you should understand:! Complements! Supplements! Adjacent Angles! Linear Pairs! Vertical

More information

MITOCW watch?v=kz7jjltq9r4

MITOCW watch?v=kz7jjltq9r4 MITOCW watch?v=kz7jjltq9r4 PROFESSOR: We're going to look at the most fundamental of all mathematical data types, namely sets, and let's begin with the definitions. So informally, a set is a collection

More information

Structurally Random Matrices

Structurally Random Matrices Fast Compressive Sampling Using Structurally Random Matrices Presented by: Thong Do (thongdo@jhu.edu) The Johns Hopkins University A joint work with Prof. Trac Tran, The Johns Hopkins University it Dr.

More information

Name Course Days/Start Time

Name Course Days/Start Time Name Course Days/Start Time Mini-Project : The Library of Functions In your previous math class, you learned to graph equations containing two variables by finding and plotting points. In this class, we

More information

Wavelet Transform (WT) & JPEG-2000

Wavelet Transform (WT) & JPEG-2000 Chapter 8 Wavelet Transform (WT) & JPEG-2000 8.1 A Review of WT 8.1.1 Wave vs. Wavelet [castleman] 1 0-1 -2-3 -4-5 -6-7 -8 0 100 200 300 400 500 600 Figure 8.1 Sinusoidal waves (top two) and wavelets (bottom

More information

Image Compression Using Modified Fast Haar Wavelet Transform

Image Compression Using Modified Fast Haar Wavelet Transform World Applied Sciences Journal 7 (5): 67-653, 009 ISSN 88-95 IDOSI Publications, 009 Image Compression Using Modified Fast Haar Wavelet Transform Anuj Bhardwaj and Rashid Ali Department of Mathematics,

More information

Cryptography. What is Cryptography?

Cryptography. What is Cryptography? Cryptography What is Cryptography? Cryptography is the discipline of encoding and decoding messages. It has been employed in various forms for thousands of years, and, whether or not you know it, is used

More information