Managing Image Data on the ArcGIS Platform Options and Recommended Approaches

Transcription

1 Managing Image Data on the ArcGIS Platform Options and Recommended Approaches Peter Becker Petroleum requirements for imagery and raster Traditional solutions and issues Overview of ArcGIS imaging capabilities Demonstration Resolving the imagery issues Recommendations

2 Imagery and Rasters in the Petroleum Industry Base for most geospatial applications Background image Source for interpretation Temporal change Raster Analysis Multiple sources: Satellites: QB, Ikonos,.. Aerial photography: orthophotos, (few raw camera data) Scanned maps Elevation data Most petroleum companies have a high investment in imagery and rasters 2

3 Requirements in Petroleum Industry Need to maximize the value of imagery Provide Accessibility Large range of applications Different locations Data Managers Large collections of existing imagery New imagery being acquired Users Accessibility Capability

4 Data Managers Traditional Approach Handle images as individual files Stored on disk Multiple formats Stored in database Managed ArcSDE Raster Catalogs Create mosaic Raster Mosaic ArcSDE Bunch of (tif) files MrSID, ECW, JPEG2000

5 Data Managers Traditional Issues Data management Volume Data duplication Disparate datasets Different resolutions Temporal Dynamics Security?? t1 t2 t3 t4 t5??

6 Users Traditional Approach & Issues Traditional - Open File Updated - Open web service Issues Which image / service Formats TIF, JPEG, JPEG2000, NITF, ECW, MrSID, ERS, BIL, FLT, RAW.. Projections DD WGS84, UTM, StatePlane,. Speed zzzzzzzzzzzzzzz Bandwidth DSL connection Metadata what metadata? Capability What can I do? Dynamics New imagery available

7 What has changed? ArcGIS Desktop Improvements ArcGIS Server Image Services ArcGIS Server Image Extension (Image Server) ArcGIS Server Map Caching Web Applications WebMap, JavaScript, Silverlight, ArcGIS Explorer, Google Earth, Virtual Earth

8 ArcGIS Provides Enterprise Image Management Manages catalogs of imagery from various sources Integrates imagery into workflows to Collect, Manage, Produce and Exploit all forms of geospatial data ESRI has a long history of imagery/raster solutions ESRI users are the largest collection of professional imagery users in the world. Imagery adds value to GIS, GIS adds value to imagery They are two sides of the same coin

9 ArcGIS Integrates Imagery As part of the complete Enterprise GIS ArcGIS provides: A scalable, standards based and generic, cross industry platform technology to: Manage Process Analyze Disseminate Visualize Exploit Use Serve Imagery, in a wide range of applications Desktop Explorer Web Map Viewer Enterprise Service Bus ImageServices GIS Server Mobile Open APIs Author Arc Map None Rectified Rectified Scene Mosaic Tile Raster Mosaic UC 2008 Tech Workshop 9

10 Components of a complete Enterprise Image Management solution ArcGIS Desktop Integrates all forms of geospatial data including imagery Is the authoring tool for information and knowledge ArcGIS Server Provides the Services Orientated Architecture Provides the GeoDatabase ArcGIS Server Image Extension Provides the solution for large numbers of images Other important components include: ArcGIS Explorer, Spatial Analyst, GeoDatabase Rasters, ArcGIS Online, Appliances, Professional Services, Partner Solutions

11 ArcGIS Desktop provides for Imagery Access Individual Rasters Raster Catalogs/Mosaics Image Services Visualization Band combination, Band stretch, Contrast Projection Pan Sharpen, Orthorectification Analysis / Processing Mosaic, clip Georeferencing Pan Sharpen, Orthorectification Spatial Analysis Management Files, GDB rasters, Image Services GP Tools Raster Catalog Image Service ArcGIS Server ArcGIS Desktop Raster Mosaic MosaicRectified None Tile SceneRectified IS Direct Connect Image Server WMS/ WCS

12 ArcGIS Server Family Imagery is an integral part of a complete GIS Desktop Explorer Web Map Mobile Open Enterprise Viewer APIs Service Bus 3 Tiers Use Many Clients Map Services Globe Services Image Services GeoCoding Services GeoData Services Analysis & Modeling Services Serve Author Desktop Multi-platform

13 ArcGIS Server provides for Imagery Access Image Services Serve any raster dataset Open Standards: WMS, WCS, SOAP, REST, KML Imagery data, not just pictures Many clients ArcMap, 3 rd Party, JavaScript, Flex, Image extraction Caching for optimized very large scale web access Processing Server rendering Geoprocessing Management Simple Web based & ArcCatalog Desktop Arc Engine Arc Map 3 rd Party Arc Globe Image Service Definition Web WebMap.NET/Java ArcGIS Explorer OGC WCS OGC WMS Map ArcGIS Server Map Doc. Google Earth KML Google Maps Microsoft Virtual Earth Mashup SOAP, REST WMS, WCS, KML Globe Mobile Mobile Mobile.Net

14 ArcGIS Server - Image Extension ArcGIS Image Server technology Extends ArcGIS Server to: Access Single point of access to large collections of images Client control over imagery mosaic / delivery Maintain source information for every pixel Additional CAD & GIS clients Processing Dynamic mosaicking On-the-fly processing Multiple products from same source (Natural Color, False Color, IR, NDVI) without data duplication Management Maintain source data and metadata Define image processing Limited pre-processing required Use Serve Author ArcGIS Server Image Extension Service Definition Service Definition Service Definition

15 ArcGIS Image Server Paradigm Combine Processing with Serving Keep imagery in native form Author service definition (catalog) Properties of images Processing to be applied Properties of the service Generate service overviews (optional) Publish image service Client application accesses image service Defines area of interest Server accesses and processes imagery Required image transmitted to client Client displays image Use Serve Author ArcGIS Server Image Extension Service Definition Service Definition Service Definition

16 Radiometric Processes Extract / Stack Bands Image Algebra, NDVI Spectral Matrix Grayscale Stretch Convolution Filter Pan-sharpen Trend Classify Colormap Elevation Visualization Histogram

17 Geometric Processes Reproject, Warp, Orthorectify Single Sampling, improves quality Clip/crop image to: Exclude non wanted areas Seamlessly blend images Mosaicking Methods Reorder overlapping imagery By Attribute Date, SunAngle,.. Closest Nadir Most top down Viewpoint North, East, South, West Lock Image Specific image(s) Seamline Blend

18 Client Controllable Image Service Properties Projection Define output projection, irrespective of input projections Sampling methods Nearest neighbor, bilinear, cubic convolution Compression for transmission JPEG, JPEG 2000, LZ77 Enables access over low bandwidth networks Mosaic method Controls overlap Lock Image Metadata Access

19 Accessing Image Services Large Number of clients Desktop ArcGIS, AutoCAD, Microstation, GeoMedia, ArcGIS Explorer 900 WMS, WMC Web WebMap, JavaScript, Flash, Silverlight WMS, WCS

20 Demonstration Accessing image Services Author image service of satellite imagery Author image service of elevation data

21 Additional Applications Geospatial Raster Analysis Spatial Analysis Partners Provide Best of Breed technology Image Analysis ITT ENVI Feature Extraction ITT ENVI FX, Ecognition Stereo Capture BAE, DAT/EM Service Orientated Architectures ArcGIS Server Image Service ArcGIS Server GeoProcesing Service

22 Users New Approach & Issues Resolved Open Application Zoom to AOI View Imagery Access Metadata Change properties Issues? Which image / service: Combined, Best imagery on top Formats: Irrelevant Projections: Resolved Speed: Fast Bandwidth: Low if necessary Metadata: Accessible Capability: Use as picture (view) or data (analysis) Order imagery to exploit temporal Utilize dynamic range and multispectral Dynamics: New imagery become available

23 Data Managers New Approach & Resolved Issues Leave images in their existing locations/formats Create and Serve Image Service Definition Create multiple image products Update as new imagery or parameters becomes available Issues Data management: Simplified Volume Reduced: No data duplication, compression where possible Disparate datasets: No issue Different resolutions: No issue Temporal: Can be exploited Dynamics: Update as required Security: Solved t1 t2 t3 t4 t5

24 How to achieve requirements? Catalog and Serve existing data Create Image Services New image acquisition Add to existing Image Services Use Image Services to make imagery accessible Value of imagery increased Rapid Return of Investment

25 Implementation Recommendations Identify all imagery/rasters Formats, volume, type, projections, metadata Remove duplicates & derived products (eg reprojected/mosaicked) Add to central storage (DAS,NAS,SAN) Create Best Image Services Imagery Color Imagery False-Color Imagery NDVI Elevation Elevation Shaded Relief Relief Shade Aspect Add metadata attributes (eg source) Use in all geospatial applications Create Special Service (Security, application specific) If need to scale to very large number of users Create Map Cache from Image Service Distribute Cache on separate location

26 Scaling to very large number of user More Advanced Users General Users ImageService WMS, WCS, KML Cache, WMS,KML Tiles Author Service Definition Service Definition Service Definition ArcGIS Server Image Extension Caching GP ArcGIS Server On Demand Caching Service Overviews Basic Imagery

27 Use Serve ArcGIS Server Image Extension Author Service Definition Service Definition Service Definition

28 Use Serve ArcGIS Server Image Extension Collect ArcGIS Server Image Extension Manage Parameters Author Service Definition Service Definition Service Definition Produce Services/Orthos Geo Data Files base Exploit Visualize/Analyze

29 Information Centric Approach to Workflows ArcGIS is the interoperable organizing system to enable workflows Collect Imagery Manage ArcGIS Server Image Extension Produce Files Geo Data base GIS Vectors Exploit GeoDatabase Common information model. Simplifies integration of disparate systems ArcGIS Server Enables SOA + Federated/Distributed storage and management ArcGIS Desktop Uniform and integrated environment for managing and authoring Web clients Web query and exploitation

30 ArcGIS Imagery Based Workflows / Solutions Workflows contain many standard tasks Name used depends on industry Acquire Procure Catalog Refine Radiometry (Color Enhance) Refine Geometry Plan Maintain ArcGIS Server Image Extension Files Geo Data base Process Mosaic Exploit Order of the tasks need not be linear Analyze Visualize

31 ArcGIS Maximizes the Value of Imagery Enterprise wide image accessibility Increases access and use Very large image datasets Within GIS, CAD, imaging, and Web applications Direct read of imagery in its native form Simplifies data management Reduces redundancy Reduce delay in making imagery accessible On-the-fly server-based image processing Dynamic Mosaicking Serves multiple customized imagery products From a single source Utilizes image depth Makes imagery dynamic End users get Fast image access Optimized to their requirements Improved image quality Important image metadata