Data Mining Storm Attributes
|
|
- Sheryl Shields
- 5 years ago
- Views:
Transcription
1 Data Mining Storm Attributes VA L L I A P PA L A K S H M A N A N N AT I O N A L S E V E R E S T O R M S L A B O R AT O R Y / U N I V E R S I T Y O F O K L A H O M A L A K S H M A O U. E D U AT C I T Y U N I V E R S I T Y O F N E W Y O R K N O V E M B E R
2 Data Mining Storm Attributes What is data mining? A usable definition: Statistics + Computer Science + Large data sets What questions can data mining answer? How many days of 2 hail does a location experience? What is the likelihood of rainfall at X given that it rained at Y? What is the average US population affected by 2 hail every year? Given a climate forecast, what is the expected economic cost of damage? How about these questions? What is the likelihood that a supercell will produce a tornado? What is the likelihood of 2 hail from a squall line? What is the likelihood of a NYC tunnel flooding from a tropical storm? How is the second set of questions different from the first? 2
3 Key Challenges Storms do not have rigid boundaries Have to identify storms from remotely sensed images The definition of a storm is dependent on scale (supercell/squall line) Storms move over time Need to track and associate storms across multiple images Have to do this in multiple scales Need to classify storm types For probabilistic guidance 3
4 Example: SCAN in United States 4
5 Example: COTREC in Switzerland 5
6 Limitations SCAN is not multiple-scale Centroid-based tracking Useful in interactive use, but not for large-data analysis COTREC is an image forecast ( nowcast ) Also single-scale No storm identification or classification 6
7 Data Mining Storm Attributes Introduction Storm Identification Storm Association Extracting Storm characteristics Estimating Motion 7
8 Identifying Storms Simple idea: Areas of high reflectivity or low infrared temperature Area = contiguous range gates (or pixels, if Cartesian) Key pre-decisions: What field to use? Base reflectivity? Reflectivity at -10C Infrared temperature? Brightness count? Lightning flash density? Need to quality control the data first Clutter, sun-spikes, biological echoes, etc. Smooth the data Which smoothing filter? Gaussian/Median filters most common 8
9 Single Threshold A single threshold is problematic Could be too high, and miss initiating storms Could be too low and storms end up being unrealistically large 50 dbz 20 dbz There is no perfect threshold Threshold just right Threshold too low 30 dbz Threshold too high
10 Enhanced Watershed Storm = contiguous pixels above t2 that have at least one pixel above t1 t2 = highest value that will allow objects be at least N pixels 40 dbz 10 px 40 dbz 5 px Change N to get multi-scale 30 dbz 10 px 30 dbz 5 px 10
11 Vector quantization via K-Means clustering [1] Quantize the image into bands using K-Means Vector quantization because pixel value could be many channels Like contouring based on a cost function (pixel value & discontiguity) 11
12 Mathematical Description: Clustering Each pixel is moved among every available cluster and the cost function E(k) for cluster k for pixel (x,y) is computed as d E m xy Distance in measurement space (how similar are they?) ( k) d ( k) (1 ) d ( k) m, xy c, Discontiguity measure (how physically close are they?) n, xy ( k) k I d ( ) (1 ( )) xy c, xy k Sij k ij N xy xy Weight of distance vs. discontiguity (0 λ 1) Mean intensity value for cluster k Pixel intensity value Courtesy: Bob Kuligowski, NESDIS Number of pixels neighboring (x,y) that do NOT belong to cluster k 12
13 Tuning vector quantization (-d) The K in K-means is set by the data increment Large increments result in fatter bands Size of identified clusters will jump around more (addition/removal of bands to meet size threshold) Subsequent processing is faster Limiting case: single, global threshold Smaller increments result in thinner bands Size of identified clusters more consistent Subsequent processing is slower Extremely local maxima The minimum value determines probability of detection Local maxima less intense than the minimum will not be identified 13
14 Storm Cell Identification: Characteristics Cells grow until they reach a specific size threshold Cells are local maxima (not based on a global threshold) Optional: cells combined to reach size threshold 14
15 Enhanced Watershed Algorithm [2] Starting at a maximum, flood image Until specific size threshold is met: resulting basin is a storm cell Multiple (typically 3) size thresholds to create a multiscale algorithm 15
16 Tuning watershed transform (-d,-p) The watershed transform is driven from maximum until size threshold is reached up to a maximum depth 16
17 Data Mining Storm Attributes Introduction Storm Identification Storm Association Extracting Storm characteristics Estimating Motion 17
18 Associating Storms Suppose you identify a set of storms in one image And have the set of storms identified in previous image Need to associate the two sets of storms Methods: Find centroids and associate the closest centroid Project the centroid at previous time to its new expected location Associate the closest centroid (within some sanity limits) Use cost function that weights distance and storm characteristics Minimize cost function: this is a linear optimization problem called the Munkres or Hungarian algorithm Greedy optimization Rank storms based on importance (so that stronger, longer-lived storms get associated first, for example) 18
19 Difficulties in storm association Misidentification Storm splits and merges 19
20 Unique matches; size-based radius; longevity; cost [4] Project cells identified at t n-1 to expected location at t n Sort cells at t n-1 by track length so that longer-lived tracks are considered first For each projected centroid, find all centroids that are within sqrt(a/pi) kms of centroid where A is area of storm If unique, then associate the two storms Repeat until no changes Resolve ties using cost fn. based on size, intensity or 20
21 Resolve ties using cost function Define a cost function to associate candidate cell i at t n and cell j projected forward from t n-1 as: Location (x,y) of centroid Area of cluster Peak value of cluster Max Magnitude For each unassociated centroid at t n, associate the cell for which the cost function is minimum or call it a new cell 21
22 Data Mining Storm Attributes Introduction Storm Identification Storm Association Extracting Storm characteristics Estimating Motion 22
23 Storm characteristics Identified storm cells have an area Can extract statistics of other spatial grids within those areas Track properties over time Alternately, extract stats in neighborhood of centroid Things to think about: Is outline of object exact? Impact of using watershed approach on spatial properties Impact of using thresholds on initiation/intensification properties Problem of core vs. periphery Use properties + data mining to make predictions 23
24 Geometric, spatial and temporal attributes [3] Geometric: Number of pixels -> area of cell Fit each cluster to an ellipse: estimate orientation and aspect ratio Spatial: remap other spatial grids (model, radar, etc.) Find pixel values on remapped grids Compute scalar statistics (min, max, count, etc.) within each cell Temporal can be done in one of two ways: Using association of cells: find change in spatial/geometric property Assumes no split/merge Project pixels backward using motion estimate: compute scalar statistics on older image Assumes no growth/decay 24
25 Specifying attributes to extract (-X) Attributes should fall inside the cluster boundary C-G lightning in anvil won t be picked up if only cores are identified May need to smooth/dilate spatial fields before attribute extraction Should consider what statistic to extract Average VIL? Maximum VIL? Area with VIL > 20? Fraction of area with VIL > 20? Should choose method of computing temporal properties Maximum hail? Project clusters backward Hail tends to be in core of storm, so storm growth/decay not problem Maximum shear? Use cell association Tends to be at extremity of core 25
26 26 Initiation Forecast
27 Data Mining Storm Attributes Introduction Storm Identification Storm Association Extracting Storm characteristics Estimating Motion 27
28 Estimating Motion Three ways to estimate motion: Object based: use object association to find velocity of each object Interpolate motion field between objects Works best for small objects; size changes problematic Optical flow Consider a rectangular window centered around each pixel Move window around in previous frame and maximize cross-correlation or some other measure of matching skill Can also be done using phase correlation Works well for large objects; subject to aperture problem Hybrid Identify objects and move object around in previous frame to minimize mean absolute error (does not depend on associating objects) 28
29 Cluster-to-image cross correlation [1] Pixels in each cluster overlaid on previous image and shifted The mean absolute error (MAE) is computed for each pixel shift Lowest MAE -> motion vector at cluster centroid Motion vectors objectively analyzed Forms a field of motion vectors u(x,y) Field smoothed over time using Kalman filters 29
30 Motion Estimation: Characteristics Because of interpolation, motion field covers most places Optionally, can default to model wind field far away from storms The field is smooth in space and time Not tied too closely to storm centroids Storm cells do cause local perturbation in field 30
31 Cluster-to-image cross correlation [1] The pixels in each cluster are overlaid on the previous image and shifted, and the mean absolute error (MAE) is computed for each pixel shift: Number of pixels in cluster k Summation over all pixels in cluster k MAE k ( x x, y y) 1 n k xy k I t ( x, y) I t t ( x x, y y) Intensity of pixel (x,y) at current time Intensity of pixel (x,y) at previous time To reduce noise, the centroid of the offsets with MAE values within 20% of the minimum is used as the basis for the motion vector. Courtesy: Bob Kuligowski, NESDIS 31
32 Interpolate spatially and temporally After computing the motion vectors for each cluster (which are assigned to its centroid, a field of motion vectors u(x,y) is created via interpolation: Motion vector for cluster k Sum over all motion vectors u( x, y) k k u k w w k k ( x, ( x, The motion vectors are smoothed over time using a Kalman filter (constant-acceleration model) y) y) w k ( x, y) Nk xy c Number of pixels in cluster k Euclidean distance between point (x,y) and centroid of cluster k k
33 Data Mining Storm Attributes Introduction Storm Identification Storm Association Extracting Storm characteristics Estimating Motion WDSS-II w2segmotionll 33
34 segmotion is a general-purpose algorithm Segmentation + Motion Estimation Segmentation --> identifying parts ( segments ) of an image Here, the parts to be identified are storm cells segmotion consists of image processing steps for: Identifying cells Estimating motion Associating cells across time Extracting cell properties Advecting grids based on motion field segmotion is part of WDSS-II Can be downloaded from Can be applied to any uniform spatial grid Has been applied to radar, satellite, model grids, 2D/3D lightning Some applications interested only in advection; others only on attribute extraction 34
35 Try things out Download WDSS-II from Follow Quick Start to learn how to run algorithms Download radar data from NCDC Convert to netcdf using ldm2netcdf Use c option to create composite Run w2segmotioncg on ReflectivityComposite Experiment with various options as described on the following slides Try applying QC/smoothing to data first w2qcnn w2smooth (or k option to w2segmotioncg) 35
36 Tuning motion estimation (-O) Motion estimates are more robust if movement is on the order of several pixels If time elapsed is too short, may get zero motion If time elapsed is too long, storm evolution may cause flat crosscorrelation function Finding peaks of flat functions is error-prone! 36
37 Preprocessing (-k) affects everything The degree of pre-smoothing has tremendous impact Affects scale of cells that can be found More smoothing -> less cells, larger cells only Less smoothing -> smaller cells, more time to process image Affects quality of cross-correlation and hence motion estimates More smoothing -> flatter cross-correlation function, harder to find best match between images 37
38 Evaluate advected field using motion estimate [1] Use motion estimate to project entire field forward Compare with actual observed field at the later time Caveat: much of the error is due to storm evolution But can still ensure that speed/direction are reasonable 38
39 Evaluate tracks on mismatches, jumps & duration Better cell tracks: Exhibit less variability in consistent properties such as VIL Are more linear Are longer Can use these criteria to choose best parameters for identification and tracking algorithm 39
40 Extrapolating images Extrapolation of radar echoes Intuitive approach: put Take current echoes Move them forward in time (advect) by their motion field put is subject to holes in the created images get results in the wrong motion field being used Simple put followed by get Move echoes forward, fill in gaps via interpolation Results in ghost echoes Smarter approach: Advect the motion field, interpolating within gaps Now, do get using advected motion field 40
41 Example 41
42 WDSS-II w2segmotionll References Algorithm for identifying and tracking cells from spatial grids Identify cells using vector quantization and watershed transform [2] Estimate motion using cross-correlation and interpolation [1] Track cells: longevity, size-based search radius and cost function [4] Extract attributes: geometric, spatial and temporal [3] How to evaluate algorithm: Evaluate cell tracks using mismatches, jumps & duration [4] Evaluate motion field using advected products [1] 1) V. Lakshmanan, R. Rabin, and V. DeBrunner, ``Multiscale storm identification and forecast,'' J. Atm. Res., vol. 67, pp , July ) V. Lakshmanan, K. Hondl, and R. Rabin, ``An efficient, general-purpose technique for identifying storm cells in geospatial images,'' J. Ocean. Atmos. Tech., vol. 26, no. 3, pp , ) V. Lakshmanan and T. Smith, ``Data mining storm attributes from spatial grids,'' J. Ocea. and Atmos. Tech., vol. 26, no. 11, pp , ) V. Lakshmanan and T. Smith, ``An objective method of evaluating and devising storm tracking algorithms,'' Wea. and Forecasting, vol. 25, no. 2, pp ,
43 WDSS-II Programs w2segmotionll Multiscale cell identification and tracking: this is the program that much of this talk refers to. w2advectorll w2scoreforecast Uses the motion estimates produced by w2segmotionll (or any other motion estimate, such as that from a model) to project a spatial field forward The program used to evaluate a motion field. This is how the MAE and CSI charts were created w2scoretrack The program used to evaluate a cell track. This is how the mismatch, jump and duration bar plots were created. 43
Tuning an Algorithm for Identifying and Tracking Cells
Tuning an Algorithm for Identifying and Tracking Cells VA L L I A P PA L A K S H M A N A N N AT I O N A L S E V E R E S T O R M S L A B O R AT O R Y / U N I V E R S I T Y O F O K L A H O M A J U LY, 2
More information6. Object Identification L AK S H M O U. E D U
6. Object Identification L AK S H M AN @ O U. E D U Objects Information extracted from spatial grids often need to be associated with objects not just an individual pixel Group of pixels that form a real-world
More informationIdea. Found boundaries between regions (edges) Didn t return the actual region
Region Segmentation Idea Edge detection Found boundaries between regions (edges) Didn t return the actual region Segmentation Partition image into regions find regions based on similar pixel intensities,
More informationClustering Part 4 DBSCAN
Clustering Part 4 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville DBSCAN DBSCAN is a density based clustering algorithm Density = number of
More informationCHAPTER 5 MOTION DETECTION AND ANALYSIS
CHAPTER 5 MOTION DETECTION AND ANALYSIS 5.1. Introduction: Motion processing is gaining an intense attention from the researchers with the progress in motion studies and processing competence. A series
More informationModel Verification Using Gaussian Mixture Models
Model Verification Using Gaussian Mixture Models A Parametric, Feature-Based Method Valliappa Lakshmanan 1,2 John Kain 2 1 Cooperative Institute of Mesoscale Meteorological Studies University of Oklahoma
More informationAn Efficient, General-Purpose Technique to Identify. Storm Cells in Geospatial Images
An Efficient, General-Purpose Technique to Identify Storm Cells in Geospatial Images Valliappa Lakshmanan 1,2,Kurt Hondl 2, Robert Rabin 2 Corresponding author: V Lakshmanan, 120 David L. Boren Blvd, Norman
More informationIntroduction to Medical Imaging (5XSA0) Module 5
Introduction to Medical Imaging (5XSA0) Module 5 Segmentation Jungong Han, Dirk Farin, Sveta Zinger ( s.zinger@tue.nl ) 1 Outline Introduction Color Segmentation region-growing region-merging watershed
More informationRegion-based Segmentation
Region-based Segmentation Image Segmentation Group similar components (such as, pixels in an image, image frames in a video) to obtain a compact representation. Applications: Finding tumors, veins, etc.
More informationDIGITAL IMAGE ANALYSIS. Image Classification: Object-based Classification
DIGITAL IMAGE ANALYSIS Image Classification: Object-based Classification Image classification Quantitative analysis used to automate the identification of features Spectral pattern recognition Unsupervised
More informationBiometrics Technology: Image Processing & Pattern Recognition (by Dr. Dickson Tong)
Biometrics Technology: Image Processing & Pattern Recognition (by Dr. Dickson Tong) References: [1] http://homepages.inf.ed.ac.uk/rbf/hipr2/index.htm [2] http://www.cs.wisc.edu/~dyer/cs540/notes/vision.html
More informationHOUGH TRANSFORM CS 6350 C V
HOUGH TRANSFORM CS 6350 C V HOUGH TRANSFORM The problem: Given a set of points in 2-D, find if a sub-set of these points, fall on a LINE. Hough Transform One powerful global method for detecting edges
More informationImage Processing. Bilkent University. CS554 Computer Vision Pinar Duygulu
Image Processing CS 554 Computer Vision Pinar Duygulu Bilkent University Today Image Formation Point and Blob Processing Binary Image Processing Readings: Gonzalez & Woods, Ch. 3 Slides are adapted from
More informationUniversity of Florida CISE department Gator Engineering. Clustering Part 4
Clustering Part 4 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville DBSCAN DBSCAN is a density based clustering algorithm Density = number of
More informationUlrik Söderström 16 Feb Image Processing. Segmentation
Ulrik Söderström ulrik.soderstrom@tfe.umu.se 16 Feb 2011 Image Processing Segmentation What is Image Segmentation? To be able to extract information from an image it is common to subdivide it into background
More informationERAD Optical flow in radar images. Proceedings of ERAD (2004): c Copernicus GmbH 2004
Proceedings of ERAD (2004): 454 458 c Copernicus GmbH 2004 ERAD 2004 Optical flow in radar images M. Peura and H. Hohti Finnish Meteorological Institute, P.O. Box 503, FIN-00101 Helsinki, Finland Abstract.
More information3. Data Structures for Image Analysis L AK S H M O U. E D U
3. Data Structures for Image Analysis L AK S H M AN @ O U. E D U Different formulations Can be advantageous to treat a spatial grid as a: Levelset Matrix Markov chain Topographic map Relational structure
More informationCS 664 Segmentation. Daniel Huttenlocher
CS 664 Segmentation Daniel Huttenlocher Grouping Perceptual Organization Structural relationships between tokens Parallelism, symmetry, alignment Similarity of token properties Often strong psychophysical
More information9.913 Pattern Recognition for Vision. Class 8-2 An Application of Clustering. Bernd Heisele
9.913 Class 8-2 An Application of Clustering Bernd Heisele Fall 2003 Overview Problem Background Clustering for Tracking Examples Literature Homework Problem Detect objects on the road: Cars, trucks, motorbikes,
More informationLecture 9: Hough Transform and Thresholding base Segmentation
#1 Lecture 9: Hough Transform and Thresholding base Segmentation Saad Bedros sbedros@umn.edu Hough Transform Robust method to find a shape in an image Shape can be described in parametric form A voting
More informationIDENTIFYING AND TRACKING STORMS IN SATELLITE IMAGES
IDENTIFYING AND TRACKING STORMS IN SATELLITE IMAGES V. Lakshmanan 1,2, R. Rabin 1,3, V. DeBrunner 2 1 National Severe Storms Laboratory, Norman OK 2 University of Oklahoma, Norman OK 3 University of Wisconsin,
More informationFeature Tracking and Optical Flow
Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who 1 in turn adapted slides from Steve Seitz, Rick Szeliski,
More informationEE 701 ROBOT VISION. Segmentation
EE 701 ROBOT VISION Regions and Image Segmentation Histogram-based Segmentation Automatic Thresholding K-means Clustering Spatial Coherence Merging and Splitting Graph Theoretic Segmentation Region Growing
More informationVisual Tracking. Image Processing Laboratory Dipartimento di Matematica e Informatica Università degli studi di Catania.
Image Processing Laboratory Dipartimento di Matematica e Informatica Università degli studi di Catania 1 What is visual tracking? estimation of the target location over time 2 applications Six main areas:
More informationCOMPUTER AND ROBOT VISION
VOLUME COMPUTER AND ROBOT VISION Robert M. Haralick University of Washington Linda G. Shapiro University of Washington A^ ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California
More informationMarcel Worring Intelligent Sensory Information Systems
Marcel Worring worring@science.uva.nl Intelligent Sensory Information Systems University of Amsterdam Information and Communication Technology archives of documentaries, film, or training material, video
More informationECG782: Multidimensional Digital Signal Processing
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Spring 2014 TTh 14:30-15:45 CBC C313 Lecture 10 Segmentation 14/02/27 http://www.ee.unlv.edu/~b1morris/ecg782/
More informationCS443: Digital Imaging and Multimedia Binary Image Analysis. Spring 2008 Ahmed Elgammal Dept. of Computer Science Rutgers University
CS443: Digital Imaging and Multimedia Binary Image Analysis Spring 2008 Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines A Simple Machine Vision System Image segmentation by thresholding
More informationMotion illusion, rotating snakes
Motion illusion, rotating snakes Local features: main components 1) Detection: Find a set of distinctive key points. 2) Description: Extract feature descriptor around each interest point as vector. x 1
More informationSYDE Winter 2011 Introduction to Pattern Recognition. Clustering
SYDE 372 - Winter 2011 Introduction to Pattern Recognition Clustering Alexander Wong Department of Systems Design Engineering University of Waterloo Outline 1 2 3 4 5 All the approaches we have learned
More informationCHAPTER 4: CLUSTER ANALYSIS
CHAPTER 4: CLUSTER ANALYSIS WHAT IS CLUSTER ANALYSIS? A cluster is a collection of data-objects similar to one another within the same group & dissimilar to the objects in other groups. Cluster analysis
More informationComputer Vision for HCI. Topics of This Lecture
Computer Vision for HCI Interest Points Topics of This Lecture Local Invariant Features Motivation Requirements, Invariances Keypoint Localization Features from Accelerated Segment Test (FAST) Harris Shi-Tomasi
More informationC E N T E R A T H O U S T O N S C H O O L of H E A L T H I N F O R M A T I O N S C I E N C E S. Image Operations I
T H E U N I V E R S I T Y of T E X A S H E A L T H S C I E N C E C E N T E R A T H O U S T O N S C H O O L of H E A L T H I N F O R M A T I O N S C I E N C E S Image Operations I For students of HI 5323
More information2D image segmentation based on spatial coherence
2D image segmentation based on spatial coherence Václav Hlaváč Czech Technical University in Prague Center for Machine Perception (bridging groups of the) Czech Institute of Informatics, Robotics and Cybernetics
More informationCS4733 Class Notes, Computer Vision
CS4733 Class Notes, Computer Vision Sources for online computer vision tutorials and demos - http://www.dai.ed.ac.uk/hipr and Computer Vision resources online - http://www.dai.ed.ac.uk/cvonline Vision
More informationCS 378: Computer Game Technology
CS 378: Computer Game Technology Dynamic Path Planning, Flocking Spring 2012 University of Texas at Austin CS 378 Game Technology Don Fussell Dynamic Path Planning! What happens when the environment changes
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational
More informationCLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS
CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CHAPTER 4 CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS 4.1 Introduction Optical character recognition is one of
More informationApplications. Oversampled 3D scan data. ~150k triangles ~80k triangles
Mesh Simplification Applications Oversampled 3D scan data ~150k triangles ~80k triangles 2 Applications Overtessellation: E.g. iso-surface extraction 3 Applications Multi-resolution hierarchies for efficient
More informationLecture 7: Decision Trees
Lecture 7: Decision Trees Instructor: Outline 1 Geometric Perspective of Classification 2 Decision Trees Geometric Perspective of Classification Perspective of Classification Algorithmic Geometric Probabilistic...
More informationSpatial Outlier Detection
Spatial Outlier Detection Chang-Tien Lu Department of Computer Science Northern Virginia Center Virginia Tech Joint work with Dechang Chen, Yufeng Kou, Jiang Zhao 1 Spatial Outlier A spatial data point
More informationIntroduction to Objective Analysis
Chapter 4 Introduction to Objective Analysis Atmospheric data are routinely collected around the world but observation sites are located rather randomly from a spatial perspective. On the other hand, most
More informationSensor Tasking and Control
Sensor Tasking and Control Outline Task-Driven Sensing Roles of Sensor Nodes and Utilities Information-Based Sensor Tasking Joint Routing and Information Aggregation Summary Introduction To efficiently
More informationAutomatic Image Alignment (feature-based)
Automatic Image Alignment (feature-based) Mike Nese with a lot of slides stolen from Steve Seitz and Rick Szeliski 15-463: Computational Photography Alexei Efros, CMU, Fall 2006 Today s lecture Feature
More informationMatching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.
Matching Compare region of image to region of image. We talked about this for stereo. Important for motion. Epipolar constraint unknown. But motion small. Recognition Find object in image. Recognize object.
More informationVisual Tracking. Antonino Furnari. Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania
Visual Tracking Antonino Furnari Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania furnari@dmi.unict.it 11 giugno 2015 What is visual tracking? estimation
More informationImage Segmentation. Shengnan Wang
Image Segmentation Shengnan Wang shengnan@cs.wisc.edu Contents I. Introduction to Segmentation II. Mean Shift Theory 1. What is Mean Shift? 2. Density Estimation Methods 3. Deriving the Mean Shift 4. Mean
More informationNormalized cuts and image segmentation
Normalized cuts and image segmentation Department of EE University of Washington Yeping Su Xiaodan Song Normalized Cuts and Image Segmentation, IEEE Trans. PAMI, August 2000 5/20/2003 1 Outline 1. Image
More informationApplications. Foreground / background segmentation Finding skin-colored regions. Finding the moving objects. Intelligent scissors
Segmentation I Goal Separate image into coherent regions Berkeley segmentation database: http://www.eecs.berkeley.edu/research/projects/cs/vision/grouping/segbench/ Slide by L. Lazebnik Applications Intelligent
More informationGeometric Rectification of Remote Sensing Images
Geometric Rectification of Remote Sensing Images Airborne TerrestriaL Applications Sensor (ATLAS) Nine flight paths were recorded over the city of Providence. 1 True color ATLAS image (bands 4, 2, 1 in
More informationChapter 9 Object Tracking an Overview
Chapter 9 Object Tracking an Overview The output of the background subtraction algorithm, described in the previous chapter, is a classification (segmentation) of pixels into foreground pixels (those belonging
More informationSegmentation and Grouping
Segmentation and Grouping How and what do we see? Fundamental Problems ' Focus of attention, or grouping ' What subsets of pixels do we consider as possible objects? ' All connected subsets? ' Representation
More informationImage Segmentation. Selim Aksoy. Bilkent University
Image Segmentation Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Examples of grouping in vision [http://poseidon.csd.auth.gr/lab_research/latest/imgs/s peakdepvidindex_img2.jpg]
More information6. Applications - Text recognition in videos - Semantic video analysis
6. Applications - Text recognition in videos - Semantic video analysis Stephan Kopf 1 Motivation Goal: Segmentation and classification of characters Only few significant features are visible in these simple
More informationLocal Features: Detection, Description & Matching
Local Features: Detection, Description & Matching Lecture 08 Computer Vision Material Citations Dr George Stockman Professor Emeritus, Michigan State University Dr David Lowe Professor, University of British
More informationAnno accademico 2006/2007. Davide Migliore
Robotica Anno accademico 6/7 Davide Migliore migliore@elet.polimi.it Today What is a feature? Some useful information The world of features: Detectors Edges detection Corners/Points detection Descriptors?!?!?
More informationFeature Tracking and Optical Flow
Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who in turn adapted slides from Steve Seitz, Rick Szeliski,
More informationTypes of Edges. Why Edge Detection? Types of Edges. Edge Detection. Gradient. Edge Detection
Why Edge Detection? How can an algorithm extract relevant information from an image that is enables the algorithm to recognize objects? The most important information for the interpretation of an image
More informationGeometric Modeling. Mesh Decimation. Mesh Decimation. Applications. Copyright 2010 Gotsman, Pauly Page 1. Oversampled 3D scan data
Applications Oversampled 3D scan data ~150k triangles ~80k triangles 2 Copyright 2010 Gotsman, Pauly Page 1 Applications Overtessellation: E.g. iso-surface extraction 3 Applications Multi-resolution hierarchies
More informationEvaluation Metrics. (Classifiers) CS229 Section Anand Avati
Evaluation Metrics (Classifiers) CS Section Anand Avati Topics Why? Binary classifiers Metrics Rank view Thresholding Confusion Matrix Point metrics: Accuracy, Precision, Recall / Sensitivity, Specificity,
More informationClustering in Data Mining
Clustering in Data Mining Classification Vs Clustering When the distribution is based on a single parameter and that parameter is known for each object, it is called classification. E.g. Children, young,
More informationCorner Detection. Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology
Corner Detection Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology rhody@cis.rit.edu April 11, 2006 Abstract Corners and edges are two of the most important geometrical
More informationLecture 8: Fitting. Tuesday, Sept 25
Lecture 8: Fitting Tuesday, Sept 25 Announcements, schedule Grad student extensions Due end of term Data sets, suggestions Reminder: Midterm Tuesday 10/9 Problem set 2 out Thursday, due 10/11 Outline Review
More informationLecture 6: Edge Detection
#1 Lecture 6: Edge Detection Saad J Bedros sbedros@umn.edu Review From Last Lecture Options for Image Representation Introduced the concept of different representation or transformation Fourier Transform
More informationImage Analysis Image Segmentation (Basic Methods)
Image Analysis Image Segmentation (Basic Methods) Christophoros Nikou cnikou@cs.uoi.gr Images taken from: R. Gonzalez and R. Woods. Digital Image Processing, Prentice Hall, 2008. Computer Vision course
More informationSpectral Classification
Spectral Classification Spectral Classification Supervised versus Unsupervised Classification n Unsupervised Classes are determined by the computer. Also referred to as clustering n Supervised Classes
More informationModule 7 VIDEO CODING AND MOTION ESTIMATION
Module 7 VIDEO CODING AND MOTION ESTIMATION Lesson 20 Basic Building Blocks & Temporal Redundancy Instructional Objectives At the end of this lesson, the students should be able to: 1. Name at least five
More informationCHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS
130 CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS A mass is defined as a space-occupying lesion seen in more than one projection and it is described by its shapes and margin
More informationImage Segmentation. Ross Whitaker SCI Institute, School of Computing University of Utah
Image Segmentation Ross Whitaker SCI Institute, School of Computing University of Utah What is Segmentation? Partitioning images/volumes into meaningful pieces Partitioning problem Labels Isolating a specific
More informationTopic 4 Image Segmentation
Topic 4 Image Segmentation What is Segmentation? Why? Segmentation important contributing factor to the success of an automated image analysis process What is Image Analysis: Processing images to derive
More informationMultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A
MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A. 205-206 Pietro Guccione, PhD DEI - DIPARTIMENTO DI INGEGNERIA ELETTRICA E DELL INFORMAZIONE POLITECNICO DI BARI
More informationEdge and corner detection
Edge and corner detection Prof. Stricker Doz. G. Bleser Computer Vision: Object and People Tracking Goals Where is the information in an image? How is an object characterized? How can I find measurements
More informationClustering CS 550: Machine Learning
Clustering CS 550: Machine Learning This slide set mainly uses the slides given in the following links: http://www-users.cs.umn.edu/~kumar/dmbook/ch8.pdf http://www-users.cs.umn.edu/~kumar/dmbook/dmslides/chap8_basic_cluster_analysis.pdf
More informationBioimage Informatics
Bioimage Informatics Lecture 14, Spring 2012 Bioimage Data Analysis (IV) Image Segmentation (part 3) Lecture 14 March 07, 2012 1 Outline Review: intensity thresholding based image segmentation Morphological
More informationNetwork Traffic Measurements and Analysis
DEIB - Politecnico di Milano Fall, 2017 Introduction Often, we have only a set of features x = x 1, x 2,, x n, but no associated response y. Therefore we are not interested in prediction nor classification,
More informationMotion and Tracking. Andrea Torsello DAIS Università Ca Foscari via Torino 155, Mestre (VE)
Motion and Tracking Andrea Torsello DAIS Università Ca Foscari via Torino 155, 30172 Mestre (VE) Motion Segmentation Segment the video into multiple coherently moving objects Motion and Perceptual Organization
More informationOperators-Based on Second Derivative double derivative Laplacian operator Laplacian Operator Laplacian Of Gaussian (LOG) Operator LOG
Operators-Based on Second Derivative The principle of edge detection based on double derivative is to detect only those points as edge points which possess local maxima in the gradient values. Laplacian
More informationWeka ( )
Weka ( http://www.cs.waikato.ac.nz/ml/weka/ ) The phases in which classifier s design can be divided are reflected in WEKA s Explorer structure: Data pre-processing (filtering) and representation Supervised
More informationTopics to be Covered in the Rest of the Semester. CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester
Topics to be Covered in the Rest of the Semester CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester Charles Stewart Department of Computer Science Rensselaer Polytechnic
More information6.801/866. Segmentation and Line Fitting. T. Darrell
6.801/866 Segmentation and Line Fitting T. Darrell Segmentation and Line Fitting Gestalt grouping Background subtraction K-Means Graph cuts Hough transform Iterative fitting (Next time: Probabilistic segmentation)
More informationImage Segmentation. Selim Aksoy. Bilkent University
Image Segmentation Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Examples of grouping in vision [http://poseidon.csd.auth.gr/lab_research/latest/imgs/s peakdepvidindex_img2.jpg]
More informationPattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition
Pattern Recognition Kjell Elenius Speech, Music and Hearing KTH March 29, 2007 Speech recognition 2007 1 Ch 4. Pattern Recognition 1(3) Bayes Decision Theory Minimum-Error-Rate Decision Rules Discriminant
More informationAutomatic Grayscale Classification using Histogram Clustering for Active Contour Models
Research Article International Journal of Current Engineering and Technology ISSN 2277-4106 2013 INPRESSCO. All Rights Reserved. Available at http://inpressco.com/category/ijcet Automatic Grayscale Classification
More informationCSE 252B: Computer Vision II
CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribes: Jeremy Pollock and Neil Alldrin LECTURE 14 Robust Feature Matching 14.1. Introduction Last lecture we learned how to find interest points
More informationEdge detection. Convert a 2D image into a set of curves. Extracts salient features of the scene More compact than pixels
Edge Detection Edge detection Convert a 2D image into a set of curves Extracts salient features of the scene More compact than pixels Origin of Edges surface normal discontinuity depth discontinuity surface
More informationCOMP 465: Data Mining Still More on Clustering
3/4/015 Exercise COMP 465: Data Mining Still More on Clustering Slides Adapted From : Jiawei Han, Micheline Kamber & Jian Pei Data Mining: Concepts and Techniques, 3 rd ed. Describe each of the following
More informationData Mining 4. Cluster Analysis
Data Mining 4. Cluster Analysis 4.5 Spring 2010 Instructor: Dr. Masoud Yaghini Introduction DBSCAN Algorithm OPTICS Algorithm DENCLUE Algorithm References Outline Introduction Introduction Density-based
More informationAutomatic Image Alignment
Automatic Image Alignment with a lot of slides stolen from Steve Seitz and Rick Szeliski Mike Nese CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2018 Live Homography
More informationSome material taken from: Yuri Boykov, Western Ontario
CS664 Lecture #22: Distance transforms, Hausdorff matching, flexible models Some material taken from: Yuri Boykov, Western Ontario Announcements The SIFT demo toolkit is available from http://www.evolution.com/product/oem/d
More informationDigital Image Processing. Prof. P.K. Biswas. Department of Electronics & Electrical Communication Engineering
Digital Image Processing Prof. P.K. Biswas Department of Electronics & Electrical Communication Engineering Indian Institute of Technology, Kharagpur Image Segmentation - III Lecture - 31 Hello, welcome
More informationCS 664 Slides #11 Image Segmentation. Prof. Dan Huttenlocher Fall 2003
CS 664 Slides #11 Image Segmentation Prof. Dan Huttenlocher Fall 2003 Image Segmentation Find regions of image that are coherent Dual of edge detection Regions vs. boundaries Related to clustering problems
More informationComputer Vision 6 Segmentation by Fitting
Computer Vision 6 Segmentation by Fitting MAP-I Doctoral Programme Miguel Tavares Coimbra Outline The Hough Transform Fitting Lines Fitting Curves Fitting as a Probabilistic Inference Problem Acknowledgements:
More informationColor Image Segmentation
Color Image Segmentation Yining Deng, B. S. Manjunath and Hyundoo Shin* Department of Electrical and Computer Engineering University of California, Santa Barbara, CA 93106-9560 *Samsung Electronics Inc.
More informationBSB663 Image Processing Pinar Duygulu. Slides are adapted from Selim Aksoy
BSB663 Image Processing Pinar Duygulu Slides are adapted from Selim Aksoy Image matching Image matching is a fundamental aspect of many problems in computer vision. Object or scene recognition Solving
More informationImage Segmentation. Ross Whitaker SCI Institute, School of Computing University of Utah
Image Segmentation Ross Whitaker SCI Institute, School of Computing University of Utah What is Segmentation? Partitioning images/volumes into meaningful pieces Partitioning problem Labels Isolating a specific
More informationComputer Vision I - Filtering and Feature detection
Computer Vision I - Filtering and Feature detection Carsten Rother 30/10/2015 Computer Vision I: Basics of Image Processing Roadmap: Basics of Digital Image Processing Computer Vision I: Basics of Image
More informationClustering: Classic Methods and Modern Views
Clustering: Classic Methods and Modern Views Marina Meilă University of Washington mmp@stat.washington.edu June 22, 2015 Lorentz Center Workshop on Clusters, Games and Axioms Outline Paradigms for clustering
More informationClassification and Detection in Images. D.A. Forsyth
Classification and Detection in Images D.A. Forsyth Classifying Images Motivating problems detecting explicit images classifying materials classifying scenes Strategy build appropriate image features train
More informationDigital Image Analysis and Processing
Digital Image Analysis and Processing CPE 0907544 Image Segmentation Part II Chapter 10 Sections : 10.3 10.4 Dr. Iyad Jafar Outline Introduction Thresholdingh Fundamentals Basic Global Thresholding Optimal
More informationC E N T E R A T H O U S T O N S C H O O L of H E A L T H I N F O R M A T I O N S C I E N C E S. Image Operations II
T H E U N I V E R S I T Y of T E X A S H E A L T H S C I E N C E C E N T E R A T H O U S T O N S C H O O L of H E A L T H I N F O R M A T I O N S C I E N C E S Image Operations II For students of HI 5323
More information