Compressive Sensing of High-Dimensional Visual Signals. Aswin C Sankaranarayanan Rice University
|
|
- Sydney Nicholson
- 5 years ago
- Views:
Transcription
1 Compressive Sensing of High-Dimensional Visual Signals Aswin C Sankaranarayanan Rice University
2 Interaction of light with objects Reflection Fog Volumetric scattering Human skin Sub-surface scattering Refraction Electron microscopy Tomography
3 Adelson and Bergen (91) The Plenoptic function Collection of all variations of light in a scene time (1D) space (3D) spectrum (1D) angle (2D) Different slices reveal different scene properties
4 Plenoptic function time (1D) space (3D) angle (2D) spectrum (1D) High-speed cameras Hyper-spectral imaging Lytro light-field camera
5 Sensing the plenoptic function Extremely high-dimensional 1000 samples/dim == 10^21 dimensional signal Greater than all the storage in the world Material costs Sensing beyond the visible spectrum Sensing time can be costly Medical imaging Need low-dimensional methods for sensing!
6 Signal models Many signals exhibit concise geometric structures
7 Signal models Many signals exhibit concise geometric structures Subspaces Union of subspaces Sparse models Low-dim. non-linear models GOAL: Tractable low-dimensional models for parsimonious sensing and efficient processing of high-dimensional visual data
8 Roadmap time (1D) space (3D) spectrum (1D) A brief tour of compressive sensing Video sensing beyond the visible spectrum Hyper-spectral imaging
9 Roadmap time (1D) space (3D) spectrum (1D) A brief tour of compressive sensing Video sensing beyond the visible spectrum Hyper-spectral imaging
10 Linear sensing y = x + e y M measurements x N-dim signal Arbitrary signal Measurement matrix of rank N Number of measurements Least squares recovery M N
11 Linear sensing y = x + e y M measurements x N-dim signal Is it possible to recover when? No for arbitrary x x M<N
12 Simple example: 1-sparse signal y = x + e compressive measurements signal Signal prior: 1-sparse signal 1 nonzero entry Possible with M = 2 measurements! y 1 = X k x k = signal value y 2 = X k kx k = signal value location
13 Candes,(Romberg,(Tao((06),(Donoho((06)( K-sparse signals y = x + e compressive measurements signal Signal recovery K-sparse signal nonzero entries Measurement matrix is i.i.d. sub-gaussian Number of measurements M K log(n/k) Recovery via a convex program
14 Compressive sensing y = x + e compressive measurements sparse signal Signal recovery K-sparse signal Signal prior Measurement matrix is i.i.d. sub-gaussian nonzero entries Measurement matrix design Number of measurements M K log(n/k) Sampling rate Recovery via a convex program Recovery algorithm
15 Compressive sensing y = x + e compressive measurements sparse signal System is under-determined nonzero entries Under-sampling factor: M/N Smaller M/N implies gains when sensing is costly
16 Single-Pixel CS Camera scene single photon detector image reconstruction or processing DMD DMD random pattern on DMD array Kelly lab
17 Kelly lab, Rice University Single pixel camera Each configuration of micro-mirrors yield ONE compressive measurement Photo-detector A single photodetector tuned to the wavelength of interest Digital micro-mirror device Resolution scalable
18 First Image Acquisition target pixels measurements (16%) 1300 measurements (2%)
19 Roadmap time (1D) space (3D) spectrum (1D) A brief tour of compressive sensing Video sensing beyond the visible spectrum Hyper-spectral imaging
20 SPC on a time-varying scene!me$varying$ scene$ measurements t=1 t=w initial estimate Simple model for recovering video frames from a single-pixel camera (SPC): Group W measurements together to estimate each video frame (image) Value of W ~ aperture time of the video camera
21 SPC Video Uncertainty Principle t=1 t=w (small) t=w (large) Small%W% Less$mo!on$blur$ More$spa!al$blur$ $ Large%W% More$mo!on$blur$ Less$spa!al$blur$ $ [Wakin, 2010]
22 SPC Video Uncertainty Principle t=1 t=w (small) t=w (large) total%mse% Find$and$exploit$$ op/mal%balance%% between$spa!al$$ and$mo!on$blurs$ W"
23 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t Step 1: Given knowledge of the speed of the scene s motion, choose W to optimize the spatial/temporal resolution tradeoff total$mse$ W" [AS,$Studer,$Baraniuk$2012]$
24 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t Step 1: Choose W to optimize the spatial/temporal resolution tradeoff Step 2: Acquire full-rate measurements using low-pass codes matched to blur induced by W total$mse$ W"
25 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t low-resolution estimates b 1 b j b F Step 2: Acquire full-rate measurements using low-pass codes matched to blur induced by W Step 3: Recover low-resolution video frames from low-pass measurements (can use simple least squares)
26 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t low-resolution estimates b 1 b j b F Step 3: Recover low-resolution video frames from low-pass measurements (can use simple least squares) Step 4: Estimate the optical flow between low-resolution frames
27 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t low-resolution estimates b 1 b j b F Step 5: Acquire 2 nd set of interleaved measurements using full-resolution codes Step 6: Recover high-resolution video frames from 2 nd set of measurements + low-res video frames, low-res optical flow, sparsity
28 Multiscale Sensing Codes Problem: 2x measurement rate (low-res and high-res measurement codes) Solution: Design full-res codes that become optimally matched low-res codes when downsampled in space (automatically interleaved) Low-res: Hadamard code High-res: Upsample Hadamard code using random innovations
29 Multiscale Sensing Codes 1. Start with a row of the Hadamard matrix 2. Upsample$ 3. Add high-freq component Key Idea: Constructing measurement matrices that have good properties when downsampled AS, Studer, Baraniuk (12)
30 Result
31 Single pixel camera setup CS-MUVI on SPC
32 CS-MUVI: IR spectrum InGaAs Photo-detector (Short-wave IR) SPC sampling rate: 10,000 sample/s Number of compressive measurements: M = 16,384 Recovered video: N = 128 x 128 x 61 = 61*M Preview (initial estimate) Upsampled 4x Recovered Video Joint work with Xu, Studer, Kelly, Baraniuk
33 CS-MUVI on SPC Conventional CS-based recovery CS-MUVI Joint work with Xu, Studer, Kelly, Baraniuk
34 More results Number of compressive measurements: Total duration of data acquisition: 6 seconds Reconstructed video resolution: 128x128x256 Preview (6 different videos) *animated gifs* CS-MUVI (6 different videos) *animated gifs*
35 More results Number of compressive measurements: Total duration of data acquisition: 6 seconds Reconstructed video resolution: 128x128x256 Preview (6 different videos) *animated gifs* CS-MUVI (6 different videos) *animated gifs*
36 Achievable Spatial resolution Comparing a recovered frame to a static image of the scene Static Image Full res. Static Image 2x down. Static Image 4x down. CS-MUVI 64x Comp. CS-MUVI Preview
37 CS-MUVI summary Key points Signal prior: Motion model Measurement matrix: Multiscale design A practical video recovery algorithm for the SPC Scales across wavelengths Extensions to hyper-spectral video camera Coming soon to a camera near you
38 Roadmap time (1D) space (3D) spectrum (1D) A brief tour of compressive sensing Video sensing beyond the visible spectrum Hyper-spectral imaging
39 Hyper-spectral data Hyper-spectral data provides fingerprints for materials Wide range of applications Agriculture, mineralogy Microscopy Surveillance, chemical imaging Hyper-spectral image of the Deepwater Horizon oil spill (Image courtesy SpecTIR.com)
40 Hyper-spectral data
41 Signal models for HS data Low rank [x 1,x 2,...,x L ] Rank depends on number of materials in the scene Spectral unmixing problem Sparsity x i be the image at wavelength i Sparse in a wavelet basis
42 Low rank (subspace models) Individual spectral images lie close to a subspace C x i = C i C 2 R N d i 2 R d Concise geometric structure: d-dim. space d N Subspace spanned by C
43 Recovery problem Given y i = i x i + e i = i C i + e i Recover Basis subspace coeff. C 1, 2,..., T Challenges: Bilinearity of unknowns Sparsity of C
44 Recovery problem Given y i = i x i + e i = i C i + e i Structured measurement matrix y i = apple ŷi ỹ i = apple ˆ i C i + e i [ŷ 1, ŷ 2,...ŷ L ]=ˆC [ 1, 2,... L ]+E Singular value decomposition of [ŷ 1, ŷ 2,...ŷ L ]=U V T
45 Recovery problem Given y i = i x i + e i y i = = i C i + e i Structured measurement matrix apple ŷi ỹ i = apple ˆ i 1. SVD to recover subspace coefficients 2. Solve convex program to recover C C i + e i min kck 1 s.t. 8i, ky i i C ˆ i k 2 apple
46 CS - Linear dynamical systems Scene x 1 :T Common measurements Innovations measurements Φ Φ ~ t y 1: T y~ 1:T Estimate coefficients αˆ 1:T Estimate matrix C xˆ t = Ĉαˆ Ĉ t xˆ 1:T Measurement matrix is structured Alleviates the bilinearity of unknowns Solving a sequence of linear and convex programs A sparse prior to estimate subspace basis C AS, Turaga, Chellappa and Baraniuk (10)(12)
47 Hyper-spectral imaging Weather data 2300 Spectral bands in mid-wave to long-wave IR ( microns) Spatial resolution 128 x 64 Rank 5 Ground Truth 2% 1%%
48 M/N = 10% M/N = 2% M/N = 1% (rank = 20)
49 Broader applications Low-rank models are widely applicable Video MRI Ground truth M/N = 2%
50 Broader applications Low-rank models are widely applicable Traffic video Video MRI Classification on compressive data Purposive sensing Ground truth Recovered video M/N = 4% Expt%1% Expt%2% Expt%3% Expt%4% Oracle$LDS$ 85.71$ 85.93$ 87.5$ 92.06$ CSOLDS$ 84.12$ 87.5$ 89.06$ 85.91$ Classification performance in [%] (CS-LDS at 4% under-sampling) AS(et(al.((10)(
51 Summary Visual signals are very high-dimensional Interplay between concise signal models and novel imaging architectures Signal models beyond sparsity Rich models from computer vision and image processing Not always easy to bridge the gap Measurement matrices beyond random iid
52 Collaborators$ Richard$Baraniuk$ Rama$Chellappa$ Kevin$Kelly$ Christoph$Studer$ Lina$Xu$ Yun$Li$ Pavan$Turaga$
53 References$ Park and Wakin, A multi-scale framework for compressive sensing of videos, PCS 2009 Reddy, Veeraraghavan, Chellappa, P2C2: Programmable pixel compressive cameras for high speed imaging, CVPR 2011 Sankaranarayanan, Studer, Baraniuk, CS-MUVI: Video compressive sensing for spatial multiplexing cameras, ICCP 2012 Sankaranarayanan, Turaga, Chellappa, Baraniuk, Compressive sensing of dynamic scenes, SIIMS (under review)
54
55 Initial estimate is low-resolution Low resolution estimate measurements t=1 t=w t=t 0 t=t 0 +W t=t initial estimate Initial estimate is called the preview Fast to compute!!! Linear estimation Fast transform
56 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t initial estimate motion compensation Estimate the optical flow between low-resolution frames Recovery of video at HIGH resolution with sparse models and optical-flow constraints
57 CS-MUVI (CS MUltiscale VIdeo recovery) measurements t=1 t=w t=t 0 t=t 0 +W t=t initial estimate motion compensation min P F i=1 k x ik 1 s.t ky t t x t kapple OF constraints between x t and x t 1
Tutorial: Compressive Sensing of Video
Tutorial: Compressive Sensing of Video Venue: CVPR 2012, Providence, Rhode Island, USA June 16, 2012 Richard Baraniuk Mohit Gupta Aswin Sankaranarayanan Ashok Veeraraghavan Tutorial: Compressive Sensing
More informationCompressive Sensing: Opportunities and Perils for Computer Vision
Compressive Sensing: Opportunities and Perils for Computer Vision Rama Chellappa And Volkan Cevher (Rice) Joint work with Aswin C. Sankaranarayanan Dikpal Reddy Dr. Ashok Veeraraghavan (MERL) Prof. Rich
More informationShort-course Compressive Sensing of Videos
Short-course Compressive Sensing of Videos Venue CVPR 2012, Providence, RI, USA June 16, 2012 Organizers: Richard G. Baraniuk Mohit Gupta Aswin C. Sankaranarayanan Ashok Veeraraghavan Part 2: Compressive
More informationCS-MUVI: Video Compressive Sensing for Spatial-Multiplexing Cameras
CS-MUVI: Video Compressive Sensing for Spatial-Multiplexing Cameras Aswin C. Sankaranarayanan, Christoph Studer, and Richard G. Baraniuk Rice University Abstract Compressive sensing (CS)-based spatial-multiplexing
More informationNon-Differentiable Image Manifolds
The Multiscale Structure of Non-Differentiable Image Manifolds Michael Wakin Electrical l Engineering i Colorado School of Mines Joint work with Richard Baraniuk, Hyeokho Choi, David Donoho Models for
More informationCompressive Sensing. A New Framework for Sparse Signal Acquisition and Processing. Richard Baraniuk. Rice University
Compressive Sensing A New Framework for Sparse Signal Acquisition and Processing Richard Baraniuk Rice University Better, Stronger, Faster Accelerating Data Deluge 1250 billion gigabytes generated in 2010
More informationVideo Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models
SIAM J. IMAGING SCIENCES Vol. 8, No. 3, pp. 1489 1518 c 2015 Society for Industrial and Applied Mathematics Video Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models Aswin C.
More informationADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING
ADAPTIVE LOW RANK AND SPARSE DECOMPOSITION OF VIDEO USING COMPRESSIVE SENSING Fei Yang 1 Hong Jiang 2 Zuowei Shen 3 Wei Deng 4 Dimitris Metaxas 1 1 Rutgers University 2 Bell Labs 3 National University
More informationSparse Reconstruction / Compressive Sensing
Sparse Reconstruction / Compressive Sensing Namrata Vaswani Department of Electrical and Computer Engineering Iowa State University Namrata Vaswani Sparse Reconstruction / Compressive Sensing 1/ 20 The
More informationCompressive Sensing: Theory and Practice
Compressive Sensing: Theory and Practice Mark Davenport Rice University ECE Department Sensor Explosion Digital Revolution If we sample a signal at twice its highest frequency, then we can recover it exactly.
More informationMeasurements and Bits: Compressed Sensing meets Information Theory. Dror Baron ECE Department Rice University dsp.rice.edu/cs
Measurements and Bits: Compressed Sensing meets Information Theory Dror Baron ECE Department Rice University dsp.rice.edu/cs Sensing by Sampling Sample data at Nyquist rate Compress data using model (e.g.,
More informationCompressive Sensing for High-Dimensional Data
Compressive Sensing for High-Dimensional Data Richard Baraniuk Rice University dsp.rice.edu/cs DIMACS Workshop on Recent Advances in Mathematics and Information Sciences for Analysis and Understanding
More informationIntroduction to Topics in Machine Learning
Introduction to Topics in Machine Learning Namrata Vaswani Department of Electrical and Computer Engineering Iowa State University Namrata Vaswani 1/ 27 Compressed Sensing / Sparse Recovery: Given y :=
More informationThe Fundamentals of Compressive Sensing
The Fundamentals of Compressive Sensing Mark A. Davenport Georgia Institute of Technology School of Electrical and Computer Engineering Sensor explosion Data deluge Digital revolution If we sample a signal
More informationCompressive Spectral Anomaly Detection
Compressive Spectral Anomaly Detection Vishwanath Saragadam, Jian Wang, Xin Li and Aswin C. Sankaranarayanan ECE Department, Carnegie Mellon University, Pittsburgh PA ECE Department, Duke University, Durham
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera
More informationThe end of affine cameras
The end of affine cameras Affine SFM revisited Epipolar geometry Two-view structure from motion Multi-view structure from motion Planches : http://www.di.ens.fr/~ponce/geomvis/lect3.pptx http://www.di.ens.fr/~ponce/geomvis/lect3.pdf
More informationCompressive Sensing. Part IV: Beyond Sparsity. Mark A. Davenport. Stanford University Department of Statistics
Compressive Sensing Part IV: Beyond Sparsity Mark A. Davenport Stanford University Department of Statistics Beyond Sparsity Not all signal models fit neatly into the sparse setting The concept of dimension
More informationCompressive Sensing for Multimedia. Communications in Wireless Sensor Networks
Compressive Sensing for Multimedia 1 Communications in Wireless Sensor Networks Wael Barakat & Rabih Saliba MDDSP Project Final Report Prof. Brian L. Evans May 9, 2008 Abstract Compressive Sensing is an
More informationCompressive Spectral Anomaly Detection
Compressive Spectral Anomaly Detection Vishwanath Saragadam, Jian Wang, Xin Li and Aswin C. Sankaranarayanan ECE Department, Carnegie Mellon University, Pittsburgh PA ECE Department, Duke University, Durham
More informationCompressive Acquisition of Dynamic Scenes Æ
Compressive Acquisition of Dynamic Scenes Æ Aswin C. Sankaranarayanan 1, Pavan K. Turaga 2, Richard G. Baraniuk 1, and Rama Chellappa 2 1 Rice University, Houston, TX 77005, USA 2 University of Maryland,
More informationBilevel Sparse Coding
Adobe Research 345 Park Ave, San Jose, CA Mar 15, 2013 Outline 1 2 The learning model The learning algorithm 3 4 Sparse Modeling Many types of sensory data, e.g., images and audio, are in high-dimensional
More informationComputational Cameras: Exploiting Spatial- Angular Temporal Tradeoffs in Photography
Mitsubishi Electric Research Labs (MERL) Computational Cameras Computational Cameras: Exploiting Spatial- Angular Temporal Tradeoffs in Photography Amit Agrawal Mitsubishi Electric Research Labs (MERL)
More informationCompressive Sensing: Opportunities and pitfalls for Computer Vision
Compressive Sensing: Opportunities and pitfalls for Computer Vision Rama Chellappa Joint work with Vishal Patel Jai Pillai Dikpal Reddy Aswin C. Sankaranarayanan Ashok Veeraraghavan Dr. Volkan Cevher (Rice)
More informationABSTRACT. Model-Based Acquisition for Compressive Sensing & Imaging. Yun Li
ABSTRACT Model-Based Acquisition for Compressive Sensing & Imaging by Yun Li Compressive sensing (CS) is a novel imaging technology based on the inherent redundancy of natural scenes. The minimum number
More informationA COMPRESSIVE SAMPLING SCHEME FOR ITERATIVE HYPERSPECTRAL IMAGE RECONSTRUCTION
A COMPRESSIVE SAMPLING SCHEME FOR ITERATIVE HYPERSPECTRAL IMAGE RECONSTRUCTION A. Abrardo, M. Barni, C.M. Carretti, S. Kuiteing Kamdem Università di Siena Dipartimento di Ingegneria dell Informazione {surname}@dii.unisi.it
More informationThe STONE Transform: Multi-Resolution Image Enhancement and Real-Time Compressive Video
1 The STONE Transform: Multi-Resolution Image Enhancement and Real-Time Compressive Video Tom Goldstein, Lina Xu, Kevin F. Kelly, and Richard Baraniuk arxiv:1311.3405v [cs.cv] 15 Nov 013 Abstract Compressive
More informationComputational Imaging for Self-Driving Vehicles
CVPR 2018 Computational Imaging for Self-Driving Vehicles Jan Kautz--------Ramesh Raskar--------Achuta Kadambi--------Guy Satat Computational Imaging for Self-Driving Vehicles Jan Kautz--------Ramesh Raskar--------Achuta
More informationBIL Computer Vision Apr 16, 2014
BIL 719 - Computer Vision Apr 16, 2014 Binocular Stereo (cont d.), Structure from Motion Aykut Erdem Dept. of Computer Engineering Hacettepe University Slide credit: S. Lazebnik Basic stereo matching algorithm
More informationECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis
ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis Yuejie Chi Departments of ECE and BMI The Ohio State University September 24, 2015 Time, location, and office hours Time: Tue/Thu
More informationCS-Video: Algorithms, Architectures, and Applications for Compressive Video Sensing
CS-Video: Algorithms, Architectures, and Applications for Compressive Video Sensing 1 Richard G. Baraniuk, Tom Goldstein, Aswin C. Sankaranarayanan, Christoph Studer, Ashok Veeraraghavan, Michael B. Wakin
More informationA geometric approach to multi-view compressive imaging
RESEARCH Open Access A geometric approach to multi-view compressive imaging Jae Young Park 1* and Michael B Wakin 2 Abstract In this paper, we consider multi-view imaging problems in which an ensemble
More informationCS 664 Structure and Motion. Daniel Huttenlocher
CS 664 Structure and Motion Daniel Huttenlocher Determining 3D Structure Consider set of 3D points X j seen by set of cameras with projection matrices P i Given only image coordinates x ij of each point
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t R 2 3,t 3 Camera 1 Camera
More informationA COMPRESSIVE SAMPLING SCHEME FOR ITERATIVE HYPERSPECTRAL IMAGE RECONSTRUCTION
19th European Signal Processing Conference (EUSIPCO 2011) Barcelona, Spain, August 29 - September 2, 2011 A COMPRESSIVE SAMPLING SCHEME FOR ITERATIVE HYPERSPECTRAL IMAGE RECONSTRUCTION A. Abrardo, M. Barni,
More informationDetecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference
Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference Minh Dao 1, Xiang Xiang 1, Bulent Ayhan 2, Chiman Kwan 2, Trac D. Tran 1 Johns Hopkins Univeristy, 3400
More informationStructurally Random Matrices
Fast Compressive Sampling Using Structurally Random Matrices Presented by: Thong Do (thongdo@jhu.edu) The Johns Hopkins University A joint work with Prof. Trac Tran, The Johns Hopkins University it Dr.
More informationRecovery of Piecewise Smooth Images from Few Fourier Samples
Recovery of Piecewise Smooth Images from Few Fourier Samples Greg Ongie*, Mathews Jacob Computational Biomedical Imaging Group (CBIG) University of Iowa SampTA 2015 Washington, D.C. 1. Introduction 2.
More informationSignal Processing with Side Information
Signal Processing with Side Information A Geometric Approach via Sparsity João F. C. Mota Heriot-Watt University, Edinburgh, UK Side Information Signal processing tasks Denoising Reconstruction Demixing
More informationOutline Introduction Problem Formulation Proposed Solution Applications Conclusion. Compressed Sensing. David L Donoho Presented by: Nitesh Shroff
Compressed Sensing David L Donoho Presented by: Nitesh Shroff University of Maryland Outline 1 Introduction Compressed Sensing 2 Problem Formulation Sparse Signal Problem Statement 3 Proposed Solution
More informationStructure from Motion
Structure from Motion Outline Bundle Adjustment Ambguities in Reconstruction Affine Factorization Extensions Structure from motion Recover both 3D scene geoemetry and camera positions SLAM: Simultaneous
More informationStructure from Motion CSC 767
Structure from Motion CSC 767 Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R,t R 2,t 2 R 3,t 3 Camera??
More informationMultiresolution Image Processing
Multiresolution Image Processing 2 Processing and Analysis of Images at Multiple Scales What is Multiscale Decompostion? Why use Multiscale Processing? How to use Multiscale Processing? Related Concepts:
More informationOutlier Pursuit: Robust PCA and Collaborative Filtering
Outlier Pursuit: Robust PCA and Collaborative Filtering Huan Xu Dept. of Mechanical Engineering & Dept. of Mathematics National University of Singapore Joint w/ Constantine Caramanis, Yudong Chen, Sujay
More informationRobust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma
Robust Face Recognition via Sparse Representation Authors: John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma Presented by Hu Han Jan. 30 2014 For CSE 902 by Prof. Anil K. Jain: Selected
More informationCompressive Single Pixel Imaging Andrew Thompson University of Edinburgh. 2 nd IMA Conference on Mathematics in Defence
Compressive Single Piel Imaging Andrew Thompson University of Edinburgh 2 nd IMA Conference on Mathematics in Defence About the project Collaboration between the University of Edinburgh and SELEX Galileo
More informationSparse Models in Image Understanding And Computer Vision
Sparse Models in Image Understanding And Computer Vision Jayaraman J. Thiagarajan Arizona State University Collaborators Prof. Andreas Spanias Karthikeyan Natesan Ramamurthy Sparsity Sparsity of a vector
More informationENHANCED RADAR IMAGING VIA SPARSITY REGULARIZED 2D LINEAR PREDICTION
ENHANCED RADAR IMAGING VIA SPARSITY REGULARIZED 2D LINEAR PREDICTION I.Erer 1, K. Sarikaya 1,2, H.Bozkurt 1 1 Department of Electronics and Telecommunications Engineering Electrics and Electronics Faculty,
More informationCompressive. Graphical Models. Volkan Cevher. Rice University ELEC 633 / STAT 631 Class
Compressive Sensing and Graphical Models Volkan Cevher volkan@rice edu volkan@rice.edu Rice University ELEC 633 / STAT 631 Class http://www.ece.rice.edu/~vc3/elec633/ Digital Revolution Pressure is on
More informationCopyright. Jianbo Chen
Copyright Jianbo Chen 2016 ABSTRACT Exploiting compressive matrices for dynamic infrared object tracking by Jianbo Chen Recent development on compressive sensing (CS) presents a great potential for this
More informationCombinatorial Selection and Least Absolute Shrinkage via The CLASH Operator
Combinatorial Selection and Least Absolute Shrinkage via The CLASH Operator Volkan Cevher Laboratory for Information and Inference Systems LIONS / EPFL http://lions.epfl.ch & Idiap Research Institute joint
More informationADAPTIVE ACQUISITIONS IN BIOMEDICAL OPTICAL IMAGING BASED ON SINGLE PIXEL CAMERA: COMPARISON WITH COMPRESSIVE SENSING
IEEE International Symposium on Biomedical Imaging Prague April 14, 2016 ADAPTIVE ACQUISITIONS IN BIOMEDICAL OPTICAL IMAGING BASED ON SINGLE PIXEL CAMERA: COMPARISON WITH COMPRESSIVE SENSING Florian Rousset
More informationCompressive Sensing for Background Subtraction
Compressive Sensing for Background Subtraction Volkan Cevher 1, Aswin Sankaranarayanan 2, Marco F. Duarte 1, Dikpal Reddy 2, Richard G. Baraniuk 1, and Rama Chellappa 2 1 Rice University, ECE, Houston
More informationTime-resolved wavelet- based acquisitions using a single pixel camera
Florian Rousset 1,2, Nicolas Ducros 1, Andrea Farina 2, Gianluca Valentini 2, Cosimo D Andrea 2, Françoise Peyrin 1 1 Univ Lyon, INSA Lyon, CNRS 5220, INSERM U1206, CREATIS Lyon, France 2 Politecnico di
More informationThe Smashed Filter for Compressive Classification and Target Recognition
The Smashed Filter for Compressive Classification and Target Recognition Mark A. Davenport Joint work with Marco Duarte, Michael Wakin, Jason Laska, Dharmpal Takhar, Kevin Kelly and Rich Baraniuk dsp.rice.edu/cs
More informationA Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India
A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India Keshav Mahavidyalaya, University of Delhi, Delhi, India Abstract
More informationCOMPRESSIVE VIDEO SAMPLING
COMPRESSIVE VIDEO SAMPLING Vladimir Stanković and Lina Stanković Dept of Electronic and Electrical Engineering University of Strathclyde, Glasgow, UK phone: +44-141-548-2679 email: {vladimir,lina}.stankovic@eee.strath.ac.uk
More informationReconstruction-free Inference on Compressive Measurements
Carnegie Mellon University Research Showcase @ CMU Department of Electrical and Computer Engineering Carnegie Institute of Technology 6-2015 Reconstruction-free Inference on Compressive Measurements Suhas
More informationRobust image recovery via total-variation minimization
Robust image recovery via total-variation minimization Rachel Ward University of Texas at Austin (Joint work with Deanna Needell, Claremont McKenna College) February 16, 2012 2 Images are compressible
More informationImage-Based Rendering
Image-Based Rendering COS 526, Fall 2016 Thomas Funkhouser Acknowledgments: Dan Aliaga, Marc Levoy, Szymon Rusinkiewicz What is Image-Based Rendering? Definition 1: the use of photographic imagery to overcome
More informationMotion Estimation and Classification in Compressive Sensing from Dynamic Measurements
Motion Estimation and Classification in Compressive Sensing from Dynamic Measurements Vijay Rengarajan, A.N. Rajagopalan, and R. Aravind Department of Electrical Engineering, Indian Institute of Technology
More informationLearning and Inferring Depth from Monocular Images. Jiyan Pan April 1, 2009
Learning and Inferring Depth from Monocular Images Jiyan Pan April 1, 2009 Traditional ways of inferring depth Binocular disparity Structure from motion Defocus Given a single monocular image, how to infer
More informationCompressed Sensing for Rapid MR Imaging
Compressed Sensing for Rapid Imaging Michael Lustig1, Juan Santos1, David Donoho2 and John Pauly1 1 Electrical Engineering Department, Stanford University 2 Statistics Department, Stanford University rapid
More informationClassification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging
1 CS 9 Final Project Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging Feiyu Chen Department of Electrical Engineering ABSTRACT Subject motion is a significant
More informationC280, Computer Vision
C280, Computer Vision Prof. Trevor Darrell trevor@eecs.berkeley.edu Lecture 11: Structure from Motion Roadmap Previous: Image formation, filtering, local features, (Texture) Tues: Feature-based Alignment
More informationRandomized Dimensionality Reduction
Randomized Dimensionality Reduction with Applications to Signal Processing and Communications Richard Baraniuk Rice University The Digital Universe Size: 281 billion gigabytes generated in 2007 digital
More informationMotion Tracking and Event Understanding in Video Sequences
Motion Tracking and Event Understanding in Video Sequences Isaac Cohen Elaine Kang, Jinman Kang Institute for Robotics and Intelligent Systems University of Southern California Los Angeles, CA Objectives!
More informationUniqueness in Bilinear Inverse Problems with Applications to Subspace and Sparsity Models
Uniqueness in Bilinear Inverse Problems with Applications to Subspace and Sparsity Models Yanjun Li Joint work with Kiryung Lee and Yoram Bresler Coordinated Science Laboratory Department of Electrical
More informationSupplementary materials of Multispectral imaging using a single bucket detector
Supplementary materials of Multispectral imaging using a single bucket detector Liheng Bian 1, Jinli Suo 1,, Guohai Situ 2, Ziwei Li 1, Jingtao Fan 1, Feng Chen 1 and Qionghai Dai 1 1 Department of Automation,
More informationFace Recognition via Sparse Representation
Face Recognition via Sparse Representation John Wright, Allen Y. Yang, Arvind, S. Shankar Sastry and Yi Ma IEEE Trans. PAMI, March 2008 Research About Face Face Detection Face Alignment Face Recognition
More informationSignal Reconstruction from Sparse Representations: An Introdu. Sensing
Signal Reconstruction from Sparse Representations: An Introduction to Compressed Sensing December 18, 2009 Digital Data Acquisition Suppose we want to acquire some real world signal digitally. Applications
More informationAn adaptive hyperspectral imager: design, control, processing and applications
An adaptive hyperspectral imager: design, control, processing and applications Simon Lacroix LAAS/Robotics Antoine Monmayrant LAAS/Photonics Hervé Carfantan IRAP/Signal & Image LAAS-CNRS / Laboratoire
More informationLecture 38: Applications of Wavelets
WAVELETS AND MULTIRATE DIGITAL SIGNAL PROCESSING Lecture 38: Applications of Wavelets Prof.V. M. Gadre, EE, IIT Bombay 1 Introduction In this lecture, we shall see two applications of wavelets and time
More informationComputational Imaging for Self-Driving Vehicles
CVPR 2018 Computational Imaging for Self-Driving Vehicles Jan Kautz--------Ramesh Raskar--------Achuta Kadambi--------Guy Satat Computational Imaging for Self-Driving Vehicles Jan Kautz--------Ramesh Raskar--------Achuta
More informationBlind Compressed Sensing Using Sparsifying Transforms
Blind Compressed Sensing Using Sparsifying Transforms Saiprasad Ravishankar and Yoram Bresler Department of Electrical and Computer Engineering and Coordinated Science Laboratory University of Illinois
More informationStructure from Motion
11/18/11 Structure from Motion Computer Vision CS 143, Brown James Hays Many slides adapted from Derek Hoiem, Lana Lazebnik, Silvio Saverese, Steve Seitz, and Martial Hebert This class: structure from
More informationImage-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about
Image-Based Modeling and Rendering Image-Based Modeling and Rendering MIT EECS 6.837 Frédo Durand and Seth Teller 1 Some slides courtesy of Leonard McMillan, Wojciech Matusik, Byong Mok Oh, Max Chen 2
More informationCompressive Sensing Applications and Demonstrations: Synthetic Aperture Radar
Compressive Sensing Applications and Demonstrations: Synthetic Aperture Radar Shaun I. Kelly The University of Edinburgh 1 Outline 1 SAR Basics 2 Compressed Sensing SAR 3 Other Applications of Sparsity
More informationModern Signal Processing and Sparse Coding
Modern Signal Processing and Sparse Coding School of Electrical and Computer Engineering Georgia Institute of Technology March 22 2011 Reason D etre Modern signal processing Signals without cosines? Sparse
More informationLast lecture. Passive Stereo Spacetime Stereo
Last lecture Passive Stereo Spacetime Stereo Today Structure from Motion: Given pixel correspondences, how to compute 3D structure and camera motion? Slides stolen from Prof Yungyu Chuang Epipolar geometry
More informationLecture 10: Multi view geometry
Lecture 10: Multi view geometry Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Stereo vision Correspondence problem (Problem Set 2 (Q3)) Active stereo vision systems Structure from
More informationPerturbation Estimation of the Subspaces for Structure from Motion with Noisy and Missing Data. Abstract. 1. Introduction
Perturbation Estimation of the Subspaces for Structure from Motion with Noisy and Missing Data Hongjun Jia, Jeff Fortuna and Aleix M. Martinez Department of Electrical and Computer Engineering The Ohio
More informationComputational Photography Denoising
Computational Photography Denoising Jongmin Baek CS 478 Lecture Feb 13, 2012 Announcements Term project proposal Due Wednesday Proposal presentation Next Wednesday Send us your slides (Keynote, PowerPoint,
More informationELEG Compressive Sensing and Sparse Signal Representations
ELEG 867 - Compressive Sensing and Sparse Signal Representations Gonzalo R. Arce Depart. of Electrical and Computer Engineering University of Delaware Fall 211 Compressive Sensing G. Arce Fall, 211 1 /
More informationTERM PAPER ON The Compressive Sensing Based on Biorthogonal Wavelet Basis
TERM PAPER ON The Compressive Sensing Based on Biorthogonal Wavelet Basis Submitted By: Amrita Mishra 11104163 Manoj C 11104059 Under the Guidance of Dr. Sumana Gupta Professor Department of Electrical
More informationImage reconstruction based on back propagation learning in Compressed Sensing theory
Image reconstruction based on back propagation learning in Compressed Sensing theory Gaoang Wang Project for ECE 539 Fall 2013 Abstract Over the past few years, a new framework known as compressive sampling
More informationWeighted-CS for reconstruction of highly under-sampled dynamic MRI sequences
Weighted- for reconstruction of highly under-sampled dynamic MRI sequences Dornoosh Zonoobi and Ashraf A. Kassim Dept. Electrical and Computer Engineering National University of Singapore, Singapore E-mail:
More informationReconstruction-free Inference from Compressive Measurements. Suhas Anand Lohit
Reconstruction-free Inference from Compressive Measurements by Suhas Anand Lohit A Thesis Presented in Partial Fulfillment of the Requirements for the Degree Master of Science Approved March 2015 by the
More informationA Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation
, pp.162-167 http://dx.doi.org/10.14257/astl.2016.138.33 A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation Liqiang Hu, Chaofeng He Shijiazhuang Tiedao University,
More informationAdvanced Image Reconstruction Methods for Photoacoustic Tomography
Advanced Image Reconstruction Methods for Photoacoustic Tomography Mark A. Anastasio, Kun Wang, and Robert Schoonover Department of Biomedical Engineering Washington University in St. Louis 1 Outline Photoacoustic/thermoacoustic
More informationarxiv: v1 [cs.cv] 15 Sep 2017
Adaptive compressed 3D imaging based on wavelet trees and Hadamard multiplexing with a single photon counting detector Huidong Dai 1,3, Weiji He 1,2,3, Guohua Gu 1,*, Ling Ye 1, Tianyi Mao 1, and Qian
More informationTowards direct motion and shape parameter recovery from image sequences. Stephen Benoit. Ph.D. Thesis Presentation September 25, 2003
Towards direct motion and shape parameter recovery from image sequences Stephen Benoit Ph.D. Thesis Presentation September 25, 2003 September 25, 2003 Towards direct motion and shape parameter recovery
More informationCompressive Sensing Based Image Reconstruction using Wavelet Transform
Compressive Sensing Based Image Reconstruction using Wavelet Transform Sherin C Abraham #1, Ketki Pathak *2, Jigna J Patel #3 # Electronics & Communication department, Gujarat Technological University
More information3D Shape and Indirect Appearance By Structured Light Transport
3D Shape and Indirect Appearance By Structured Light Transport CVPR 2014 - Best paper honorable mention Matthew O Toole, John Mather, Kiriakos N. Kutulakos Department of Computer Science University of
More informationHyperspectral and Multispectral Image Fusion Using Local Spatial-Spectral Dictionary Pair
Hyperspectral and Multispectral Image Fusion Using Local Spatial-Spectral Dictionary Pair Yifan Zhang, Tuo Zhao, and Mingyi He School of Electronics and Information International Center for Information
More informationIntroduction to Image Super-resolution. Presenter: Kevin Su
Introduction to Image Super-resolution Presenter: Kevin Su References 1. S.C. Park, M.K. Park, and M.G. KANG, Super-Resolution Image Reconstruction: A Technical Overview, IEEE Signal Processing Magazine,
More informationFinal Exam Study Guide CSE/EE 486 Fall 2007
Final Exam Study Guide CSE/EE 486 Fall 2007 Lecture 2 Intensity Sufaces and Gradients Image visualized as surface. Terrain concepts. Gradient of functions in 1D and 2D Numerical derivatives. Taylor series.
More informationReconstruction of Images Distorted by Water Waves
Reconstruction of Images Distorted by Water Waves Arturo Donate and Eraldo Ribeiro Computer Vision Group Outline of the talk Introduction Analysis Background Method Experiments Conclusions Future Work
More informationOff-the-Grid Compressive Imaging: Recovery of Piecewise Constant Images from Few Fourier Samples
Off-the-Grid Compressive Imaging: Recovery of Piecewise Constant Images from Few Fourier Samples Greg Ongie PhD Candidate Department of Applied Math and Computational Sciences University of Iowa April
More informationMRI Physics II: Gradients, Imaging
MRI Physics II: Gradients, Imaging Douglas C., Ph.D. Dept. of Biomedical Engineering University of Michigan, Ann Arbor Magnetic Fields in MRI B 0 The main magnetic field. Always on (0.5-7 T) Magnetizes
More information