The Raster Data Model

Similar documents
Raster Data Models 9/18/2018

The Raster Data Model

Rasters are: The Raster Data Model. Cell location specified by: Why squares? Raster Data Models 9/25/2014. GEO327G/386G, UT Austin 1

Lecture 06. Raster and Vector Data Models. Part (1) Common Data Models. Raster. Vector. Points. Points. ( x,y ) Area. Area Line.

RASTER ANALYSIS GIS Analysis Fall 2013

RASTER ANALYSIS GIS Analysis Winter 2016

v SMS Tutorials Working with Rasters Prerequisites Requirements Time Objectives

MRR (Multi Resolution Raster) Revolutionizing Raster

By Colin Childs, ESRI Education Services. Catalog

Introduction to Geographic Information Science. Some Updates. Last Lecture 4/6/2017. Geography 4103 / Raster Data and Tesselations.

The GIS Spatial Data Model

Georeferencing & Spatial Adjustment 2/13/2018

The Problem. Georeferencing & Spatial Adjustment. Nature Of The Problem: For Example: Georeferencing & Spatial Adjustment 9/20/2016

Georeferencing & Spatial Adjustment

v Working with Rasters SMS 12.1 Tutorial Requirements Raster Module Map Module Mesh Module Time minutes Prerequisites Overview Tutorial

Chapter 3: Maps as Numbers

Purpose: To explore the raster grid and vector map element concepts in GIS.

Alaska Department of Transportation Roads to Resources Project LiDAR & Imagery Quality Assurance Report Juneau Access South Corridor

L7 Raster Algorithms

Raster Data. James Frew ESM 263 Winter

Geometric Rectification of Remote Sensing Images

Topic 5: Raster and Vector Data Models

Lecture 9. Raster Data Analysis. Tomislav Sapic GIS Technologist Faculty of Natural Resources Management Lakehead University

Geographic Information Systems (GIS) Spatial Analyst [10] Dr. Mohammad N. Almasri. [10] Spring 2018 GIS Dr. Mohammad N. Almasri Spatial Analyst

ENVI Tutorial: Map Composition

Maps as Numbers: Data Models

GEOGRAPHIC INFORMATION SYSTEMS Lecture 02: Feature Types and Data Models

Spatial Data Models. Raster uses individual cells in a matrix, or grid, format to represent real world entities

Managing Imagery and Raster Data Using Mosaic Datasets

v Importing Rasters SMS 11.2 Tutorial Requirements Raster Module Map Module Mesh Module Time minutes Prerequisites Overview Tutorial

The Problem. Georeferencing & Spatial Adjustment. Nature of the problem: For Example: Georeferencing & Spatial Adjustment 2/4/2014

Reality Check: Processing LiDAR Data. A story of data, more data and some more data

Contents of Lecture. Surface (Terrain) Data Models. Terrain Surface Representation. Sampling in Surface Model DEM

Representing Geography

A Public Domain Tool for Wavelet Image Coding for Remote Sensing and GIS Applications

Terrain Analysis. Using QGIS and SAGA

Technical Specifications

Introduction to Computer Science (I1100) Data Storage

Using Imagery for Intelligence Analysis

Welcome to NR402 GIS Applications in Natural Resources. This course consists of 9 lessons, including Power point presentations, demonstrations,

Files Used in this Tutorial

Unpacking Instructions

JPEG 2000 compression

RASTER ANALYSIS S H A W N L. P E N M A N E A R T H D A T A A N A LY S I S C E N T E R U N I V E R S I T Y O F N E W M E X I C O

Introduction to Image Processing

ENVI Classic Tutorial: 3D SurfaceView and Fly- Through

INTRODUCTION TO GIS WORKSHOP EXERCISE

Spatial data and QGIS

Managing Imagery And Raster Data Using Mosaic Dataset. Peter Becker & Cody Benkelman

Digital Elevation Models

ERDAS Image Web Server Datasheet

Using LiDAR (Light Distancing And Ranging) data to more accurately describe avalanche terrain

Lecture 20 - Chapter 8 (Raster Analysis, part1)

1. (10 pts) Order the following three images by how much memory they occupy:

PART 1. Answers module 6: 'Transformations'

Smart GIS Course. Developed By. Mohamed Elsayed Elshayal. Elshayal Smart GIS Map Editor and Surface Analysis. First Arabian GIS Software

Introduction to the Google Earth Engine Workshop

Map Library ArcView Version 1 02/20/03 Page 1 of 12. ArcView GIS

Maps as Numbers: Data Models

GEOGRAPHIC INFORMATION SYSTEMS Lecture 25: 3D Analyst

Questions and Answers

APPENDIX E2. Vernal Pool Watershed Mapping

Introduction to GIS 2011

17/07/2013 RASTER DATA STRUCTURE GIS LECTURE 4 GIS DATA MODELS AND STRUCTURES RASTER DATA MODEL& STRUCTURE TIN- TRIANGULAR IRREGULAR NETWORK

Classify Multi-Spectral Data Classify Geologic Terrains on Venus Apply Multi-Variate Statistics

Terrain and Imagery Tutorial. Contents. By: Brian Zager

ENVI Classic Tutorial: Multispectral Analysis of MASTER HDF Data 2

Understanding Geospatial Data Models

Caching Imagery Using ArcGIS

Introduction to SAGA GIS

Lab 5: Georeferencing, Digitization, and Processing

3. Map Overlay and Digitizing

User Guide to the ESG MrSID Tools for ER Mapper

Exercise # 6: Using the NHDPlus Raster Data Sets Last Updated 3/28/2006

GY301 Geomorphology Lab 5 Topographic Map: Final GIS Map Construction

Review of Cartographic Data Types and Data Models

MARS v Release Notes Revised: May 23, 2018 (Builds and )

DATA MODELS IN GIS. Prachi Misra Sahoo I.A.S.R.I., New Delhi

What s New in Imagery in ArcGIS. Presented by: Christopher Patterson Date: September 12, 2017

Imagery and Raster Data in ArcGIS. Abhilash and Abhijit

GSSHA WMS Basics Loading DEMs, Contour Options, Images, and Projection Systems

Download elevation model page 2 Re-Project DEM coordinates page 5 Cut region of interest page 10

Managing Image Data on the ArcGIS Platform Options and Recommended Approaches

Web Map Caching and Tiling. Overview David M. Horwood June 2011

Watershed Sciences 4930 & 6920 GEOGRAPHIC INFORMATION SYSTEMS

Main concepts of ILWIS 3.0

Data Representation From 0s and 1s to images CPSC 101

Introducing ArcScan for ArcGIS

Airborne Hyperspectral Imaging Using the CASI1500

Terms and definitions * keep definitions of processes and terms that may be useful for tests, assignments

Creating Contours using ArcMap

Lecture 23 - LiDAR. GEOL 452/552 - GIS for Geoscientists I. Scanning Lidar. 30 m DEM. Lidar representations:

Files Used in this Tutorial

Your Prioritized List. Priority 1 Faulted gridding and contouring. Priority 2 Geoprocessing. Priority 3 Raster format

Aerial Photo Rectification

Class #2. Data Models: maps as models of reality, geographical and attribute measurement & vector and raster (and other) data structures

Alberta-wide ALOS DSM "ALOS_DSM15.tif", "ALOS_DSM15_c6.tif"

Figure 1: Workflow of object-based classification

Common File Formats. Need a standard to store images Raster data Photos Synthetic renderings. Vector Graphic Illustrations Fonts

Image Services for Elevation Data

Transcription:

The Raster Data Model 2 2 2 2 8 8 2 2 8 8 2 2 2 2 2 2 8 8 2 2 2 2 2 2 2 2 2 Llano River, Mason Co., TX 1

Rasters are: Regular square tessellations Matrices of values distributed among equal-sized, square cells 6 73 82 90 7 80 9 600 79 81 97 601 80 600 620 632 2

Why squares? Computer scanners and output devices use square pixels Bit-mapping technology/theory can be adapted from computer sciences 1-to-1 integer mapping to grid coordinate systems! 3

Cell Location Specified by: Row/column (R/C) address Origin is upper left cell (1,1) Relative or geographic coordinates can be specified 1 1,1 1 2 3 4 1020 600300 2 3 4,3 UTM coordinates 4 600180 10400 4

Registration to World Coordinates 0 0 600300 10400 Unregistered Registered

Registration to World Coordinates Y rows X columns 10400 600300 y 30 m Image Space Requires world file : Map Space x Specify coords. of upper left corner Specify ground dimensions of cell, in same units 6

World File DRG Example 2.43840000000000 CELL SIZE IN X DIRECTION (m) 0.00000000000000 ROTATION TERM 0.00000000000000 ROTATION TERM -2.43840000000000 CELL SIZE IN Y DIRECTION (m) 487988.641470983000 UTM EASTING OF UPPER LEFT CORNER (m) 3401923.723013010000 UTM NORTHING OF UPPER LEFT CORNER (m) /* UTM Zone 14 N with NAD83 /* This world file shifts the upper left image coordinate to the corresponding /* NAD83 location, resulting in an approximated NAD83 image. /* Map Name: Art /* Map Date: 1982 /* Map Scale: 24000 7

Spatial Resolution Defined by area or dimension of each cell Spatial Resolution = (cell height) X (cell width) High resolution: cell represent small area Low resolution: cell represent larger area Defined by size of one edge of cell (e.g. 30 m DEM ) For fixed area, file size increases with resolution Low Res. Hi Res. 40 m 100 m 2 2 m 2 10 m m 40 m 8

30 m vs. ~90 m Pixel Size Resolution of 30 m data is 9 times better (9X as many pixels) than 90 m data Packsaddle Mountain (0 m contours, vector data layer) 30 m 90 m 9

Resolution Constraint Cell size should be less than half of the size of the smallest object to be represented ( Minimum mapping unit; MMU ) Cell size = MMU Cell size ~ ½ MMU 10

e.g. DOQQ Resolutions Resolution is size of sampled area on ground, not MMU 1 m 1/3 m 1 m resolution raster data (E. Mall Circle Drive) 1/3 m resolution raster data 1 m 2 1/3 m MMU= 2 m MMU= ~ 2/3 m 11

Raster Dimension: Number of rows x columns E.g. Monitor with 1900 x1200 pixels 6 73 82 90 Dimension = 4 x 4 7 80 9 600 79 81 97 601 80 600 620 632 12

Two types: Raster Attributes 1. Integer codes assigned to raster cells E.g. rock type, land use, vegetation Codes are technically nominal or ordinal data 2. Measured real values Can be integer or floating-point (decimal) values; technically interval or ratio data E.g. topography, em spectrum, temperature, rainfall, concentration of a chemical element 13

Integer Code Attributes Code is referenced to attribute via a look-up table or value attribute table VAT Commonly many cells with the same code Different attributes must be stored in different raster layers 2 2 2 2 8 8 2 2 8 8 2 2 2 2 2 2 8 8 2 2 2 2 2 2 2 2 2 Nominal Coded Raster VAT Value Count Rock Type 2 21 Marble 37 Gneiss 8 6 Granite 14

Mixed Pixel Problem Severity is resolution dependant Rules to assign mixed pixels include: edge pixels : not assigned to any feature define a new class Assign to feature that comprises most of pixel 1

Coded Value Raster Types Single-band: Thematic data Black & White: binary (1 bit) (0 = black, 1 = white) Panchromatic ( Grayscale ) (8 bit): 0 (black) 2 (white) or graduated color ramps (e.g. blue to red, light to dark red) Colormaps ( Indexed Color ) (8 bit): code cells by values that match prescribed R-G-B combinations in a lookup table B & W Panchromatic Color Map Lookup/index table Figures from: Modeling our World, ESRI press 16

Single Band Examples Black & White (Grayscale) Black & White - 1 bit 4 Grayscale 8 bit; black, white & 24 shades of gray 17

Single Band Example Color Map (Indexed Color) E.g. Austin East 7. Digital Raster Graph (10 of 12 values shown) Each pixel contains one of 12 unique values, each corresponding to a prescribed color (Red, Green & Blue combination) 18

Measured, Real Value Attributes Commonly stored as floating point values Different attributes must be stored in different layers, e.g. spectral bands in satellite imagery Compression techniques for rasters of integervalued cells, but not floating point (see below) 19

Multiband Image Raster Attributes Multi-band Spectral Data Band 3 Red Green Blue Attribute values 0-2 Figures from: Modeling our World, ESRI press RGB Composite 2 0 Band 1 Band 2 Visible Spectrum Band = segment of Em spectrum Map intensities of each band as red, green or blue. Display alone or as composite 20

Multiband Image 8 bits/band, 3 Band RGB E.g. Austin East 7. Color Infrared Digital Orthophotograph ( CIR DOQ ) Band 1 Band 2 Band 3 21

Cell Values Apply To: Middle of cell, e.g. Digital Elevation Models (DEM) Whole cell, e.g. most other data Source: Modeling our World, ESRI press 22

Digital Elevation Model Southern Tetons, Wyoming 23

Airborn Magnetic (TFI) Map TFI Pixel Values Southern Tetons, Wyoming 24

How Are Rasters Projected? Problem: Square cells must remain square after projection. Solution: Resampling (interpolation); add, remove, reassign cells to conform to new spatial reference. 2

Raster File Size fixed by dimension, not information 8 x 8 8 x 8 At 1 bit/cell, file size = 8 x 8 x 1 = 64 bits (8 bytes) 26

Raster File Size File Size = Rows x columns x bit-depth Bit depth: number of bits used to represent pixel value 8-bit data can represent 26 values (2 8 ) 16-bit data (2 16 ) allows 6,36 values 32-bit data allows ~4.3 billion values 27

File Structure 2 2 2 2 8 8 2 2 8 8 2 2 2 2 2 2 8 8 2 2 2 2 2 2 2 2 2 8 x 8 raster Header: (dimension, max. cell value) + resolution, coordinate of one corner pixel, etc. 8, 8, 8 2 2 2 2 8 8 2 2 2 2 2 2 8 8 2 2 2 2 2 2 2 2 2 Data File (linear array) 2 2 8 8 28

File Compression E.g. Run-length encoding 2 2 2 2 8 8 2 2 8 8 2 2 2 2 2 2 8 8 2 2 2 2 2 2 2 2 2 Before: 64 characters Row, Run Freq., Value 1,1 8, 2,3 4, 2,2 2, 3,3 4, 2,2 2,8 4,3 4, 2,2 2,8,2 6,2 2,8 6,2 2,2 6, 7,2 4,2 4, 8,3 1, 3,2 4, After: 46 characters (28% reduction; ratio of 1.4: 1) 29

File Compression E.g. Block encoding 1 2 3 4 6 7 8 1 2 3 4 6 7 8 2 2 2 2 8 8 2 2 8 8 2 2 2 2 2 2 8 8 2 2 2 2 2 2 2 2 2 Before: 64 characters Block Size Value Coordinates 1,1 6,1 3,6 4,6 8,6 8,7 1 8 7, 6, 1 2 3, 4, 1,7 2,7 2,8 4 7,1 4 2,2,4 1, 3,7 4 8 7,3 9,6 16 1,1 After: 61 characters (% reduction ratio of 1.0: 1) 1,8 8,8 30

MrSID or ECW (Wavelet) Compression - Multi-resolution Seamless Image Database commercialized by LizardTech Compression ratios of 1-20:1 for single band 8-bit images Ratios of 2-100:1 (!) for multiband color images also ECW by ER Mapper Ltd. (now Intergraph/ERDAS) *** Enormous raster data sets now manageable on PCs and across web with this technology *** 31

Lossy vs. Lossless Compression Techniques that combine similar attribute information to reduce file size are lossy e.g. JPEG, GIFF, PNG, MrSID Lossless formats; TIFF, BMP, GRID 32

Raster Pyramids Store reduced-resolution copies of a raster for rapid display e.g ArcGIS, Google, many others Often combined with image tiling and compression for rapid rendering of images pixel Source: ESRI ArcGIS Help file 33

Image Tiling Split raster into small contiguous rectangles or squares = Tiles Display only the tile required upon zooming Level 0 = 100% of image = 16 low res. tiles Level 1 = higher res. (parts of 4 med. res. tiles) Level 2 = highest res. (1+ high res. tiles) Level 0 Level 1 Level 2 34

Supported Raster Formats See ArcCatalog>Tools> Options Each explained in Help 24 supported formats 3

Vector or Raster? Spatially continuous data = raster Modeling of data with high degree of variability = raster Objects with well defined boundaries = vector Geographic precision & accuracy = vector Topological dependencies = vector or raster 36

Raster or Vector? Raster Simple data structure Ease of analytical operation Format for scanned or sensed data easy, cheap data entry But. Less compact Querry-based analysis difficult Coarser graphics More difficult to transform & project Vector Compact data structure Efficient topology Sharper graphics Object-orientation better for some modeling But. More complex data structure Overlay operations computationally intensive Not good for data with high degree of spatial variability Slow data entry 38