Scientific Data Plat f or m

Transcription

1 Usi n g Ar cgis as a Scientific Data Plat f or m Feroz Kadar Sudhir Raj Shrestha

2 Top i cs Introduction Ingesting and managing Visualizing and analyzing Disseminating and consuming The road ahead

3 Scientific Data Oceanographic Salinity Sea Temperature Ocean current Meteorological Temperature Humidity Wind speed/direction Terrestrial Soil moisture NDVI Land cover

4 Challenges Manage Analyze Sh ar e variety of formats volume & velocity redundancy portability scalability reproducibility integration standards accessibility

5 Multidimensional Rasters Gridded Multidimensional Multivariate

6 Dem o Using data & information products in a WebGIS

7 Ingesting and Managing Data

8 Multidimensional Mosaic Dataset mosaic mosaic dataset table HDF GRIB n e tcdf d-aware rasters spatially-indexed catalog m u lti-resolution, multivariate, multidimensional reduce storage redundancy & pixel resampling defines information products on-demand processing raster pixels Representing multivariate collection of multidimensional rasters in ArcGIS

9 Tabular View Raster Shape Variable StdTime StdZ Temperature 3/22/ Temperature 3/23/ Temperature 3/24/ Salinity 3/22/ Salinity 3/23/ Salinity 3/24/ Temperature 3/22/ Temperature 3/23/ Tabular view of items in a multivariate multidimensional mosaic dataset

10 Metadata Variables Dimensions Values Statistics Describing the structure of a multivariate multidimensional mosaic dataset

11 Raster Types data on disk raster type mosaic dataset netcdf HDF GRIB d-aware rasters crawls disk identifies rasters extracts metadata attaches processing stores no pixels references rasters stores processing & metadata Format-agnostic direct ingestion of rasters into a mosaic dataset

12 Geoprocessing Tools building blocks for managing data Data Management Raster Mosaic Dataset Intuitive UI for interactive workflows Mode lbu ilde r: composite operations Python: automate or extend Managing a mosaic dataset

13 Dem o Make a netcdf raster layer

14 Dem o Make a netcdf raster layer Populate a mosaic dataset using a raster type Properties of a multidimensional mosaic dataset Attribute table of a mosaic layer

15 On Ar cgis f or Ser v er mosaic dataset image service dynamic, on-demand web-based access to data rich information model Make your mosaic dataset accessible to other users as a web-enabled dynamic image service

16 Visualizing and Analyzing

17 Filtering multidimensional filter variables value range(s) per dimension SQL WHERE clause dimension-orthogonal cutting & chopping slicing & dicing a multivariate multidimensional mosaic dataset

18 Filtering in ArcMap netcdf raster layer properties Select by Dimension GP tool Multidimensional mosaic layer properties

19 Rendering

20 Rendering Choose and customize Scalar or vector field Export and reuse Control how original or transformed data is presented on a map

21 Dem o Vector-field mosaic dataset Multidimensional mosaic layer on map Dimensional slicing & animation

22 Dem o Vector-field mosaic dataset Multidimensional mosaic layer on map Dimensional slicing & animation

23 Tool-based Analytic Models using Geoprocessing

24 Transforming Raster Data raster function output raster raster-valued transformation piecewise, scale-aware local / focal on-demand processing input rasters arity: unary, binary,, n-ary, p olyadic using raster functions for on-the-fly processing

25 Chaining Raster Functions to compose a complex analytic model

26 Dem o Applying a simple transformation

27 Dimensional Aggregation dimensional filtering aggregating function Multidimensional filtering followed by aggregation using a raster function

28 Extending Analytic Capabilities Learn more at: github.com/esri/rast er-functions Choose from dozens of built-in functions or implement your own algorithm using Python

29 Raster Models raster variables A portable & reusable chain of raster functions

30 Raster Model: Grouping

31 Dem o Combining variables using a raster model

32 Dem o Raster models on a mosaic dataset Aggregating temporal slices Difference of means

33 Applying a Raster Model image layer on a desktop map choose & cust omize a raster model mosaic dataset mosaic dataset item(s) image service layer on a web map choose & cust omize a raster model define & t ransmit a raster model image service

34 Disseminating and Consuming

35 Disseminating Deskt op Web Device professional geospatial analysts multivariate multidimensional mosaic dataset Server Online Content and Services

36 Dissemination Strategies Tiled map service Dynamic map service Dynamic image service

37 Sharing your data as an image Mosaic Dataset Generate Tile Cache Avoid copyin g sou rce im age to ArcGIS On lin e Cache tiles generated using ArcGIS for Desktop Accessed via tiled map service Enable access to a static representation of your data as a map service

38 Sharing your map File Sh a re As Se rvice Features overlaid on rasters Static vs Dyn am ic m ap service Mu ltid im e n sion al WMS

39 Sharing data & information products Mosaic Dataset Share As Image Service Pixe ls & ite m m e tad ata On-demand server-side processing Raster models: predefined or client-spe cifie d m u ltid im e n sion al in fo, filte rin g, ve ctor fie ld s Enable access to a dynamic representation of your information product as an image service

40 Dem o Publishing a multidimensional mosaic dataset

41 Consuming your services In any ArcGIS application or any WMS client In a web map Identify web services driven by maps or datasets Bring service layers into a web map In a map-based application Configurable apps St or y M aps Web AppBuilder Custom web apps using ArcGIS API for JavaScript

42 Maps & Apps Office of Electricity Delivery and Energy Reliability, U.S. Department of Energy Sea Level Rise and Storm Surge Effects on Energy Assets

43 Maps & Apps National Energy Technology Laboratory, U.S. Department of Energy St or ymap highlighting issues around induced seismicity

44 Maps & Apps Chesapeake Bay Program and Region 3 of the U.S. Environmental Protection Agency

45 Dem o Using image service layers in ArcGIS Online map viewer

46 The Road Ahead Python Raster Types: extensible data ingestion Raster processing models: on GitHub and out-of-the-box NetCDF, HDF, GRIB: as raster products, raster layer, image service Collection Processing: scalable transformation of large sets of rasters Raster Analytics: distributed analysis and processing of imagery or rasters in a Web GIS with ArcGIS 10.5

47

48 GIS workflows that scale Manage Analyze Sh ar e mosaic dataset raster types geoprocessing tools multidimensional filter animation & rendering raster functions dynamic web services web maps & apps raster analytics built for the characteristics of multidimensional scientific data

49 Please take our Survey Your feedback allows us to help maintain high standards and to help presenters Find your event in the Esr i Even t s Ap p Find the session you want to review Scroll down to the bottom of the session Answer survey questions and submit

50