Data Discovery Tools and Services Part A

Transcription

1 Data Discovery Tools and Services Part A A Panel Presentation: Pat Liggett, Ron Weaver, Sean Hardman, Ben Holt (with help from Dave Gallaher, SIDC) October 15, Burbank Airport Marriott

2 User Scenario: Arctic Ice ASA Views the Polar Region User Case Scenario: Scientific and comprehensive data view/access/news for polar regions. Starting point was SIDC Arctic Sea Ice ews and Analysis page. Present Sea ice extent Daily-Anomaly Present Ocean Winds Ex.Monthly Climatology Arctic Data Collection Region Time Ice extent Sea surface temperature Ocean winds Data - AMSR-E, SSM/I, QuikSCAT Data - QuikSCAT, AMSR-E, SSM/I Ocean color Sea ice freeboard Present Sea Surface Temperature Ex. Annual (monthly) Anomaly Present Ocean Color Ex. Annual (monthly) Anomaly Sea ice motion Clouds Albedo Atmospheric fields Etc. Data - AVHRR, Modis, GHRSST Data - Modis, SeaWiFS ote: Could extend to land, ice sheets etc Additional products -Sea ice freeboard, Sea ice age, etc Additional products- Sea ice motion, Clouds, Atmospheric fields,etc B. Holt-JPL

3 Joint Implementation Scenario 10/14/ UWG 3

4 Example of a Dual Purpose Interface

5

6 Backup Material July 16-17, 2008 PO.DAAC Review, ASA HQ 6

7 The Objective Create a simple to use interface(s) for Cryospheric and Physical Oceanographic data Get more data distributed to more users Build the 80% solution for experts to novices Get the user just the data they need, in the format they want quickly. Accelerate the use of data. Allow users to display and interact with the data Create a standard & flexible framework for new applications Build a system that allows the user to analyze the data, at the server, so they don t t need to move as much data Allow the system to be expanded by users or other machines

8 Quick search, retrieval, display & delivery In the order the user wants: 1. User describes what they want 2. User selects What data (product) 3. User selects Where (location) 4. User selects When (time interval) 5. User selects filters (if any) Then: 6. If the number of data files is small the user is given thumbnails 7. User can view the thumbnail 8. The user can analyze the data 9. User can select the output format

9 Implementation Scenario of Arctic Ice Scenario at PODAAC and SIDC Extend Sea Ice Extent Map to be accessible through both PODAAC and SIDC. Single map, accessible from PODAAC and SIDC. Map interface is modified and maintained by SIDC based on shared requirements from PODAAC and SIDC Provide local and remote access to data products identified by region selected via an interactive table. PODAAC middle ware developed to allow access to products at both sites. Technology is operational from both sites and is modified and maintained by PODAAC based on shared requirements from PODAAC and SIDC. Provide Level 2 and Level 3 subsetting capability for all available products for the area of interest and based upon requirements for interoperability and data display and distribution. PODAAC develops and extends L2, L3 subsetters for PODAAC products. SIDC develops and extends L2, L3 subsetters for SIDC products. Provide all products in a compatible form and format for display and further tool input. PODAAC and SIDC provide all products in an agreed form and format for display and further tool input and distribution. Provide visualization capability for all selected products. PODAAC and/or SIDC develops visualization capability for product overlay to Ice Extent map based on agreed upon formats and requirements. Provide DataCasting availability at both sites for notification of products JPL developed Datacasting will be ported and configured for SIDC by PODAAC. Provide a single User Interface accessible from both sites that integrates the Sea Ice Extent Map, InteractiveTable of Products, visualization capability, format conversion, datacasting and product delivery. Interface is developed and maintained by SIDC based upon requirements from both PODAAC and SIDC. Provide machine to machine accessible products from both SIDC and PODAAC SIDC and PODAAC select a single point of access for user selected products. FTP directory specific to the user selection located at one or the other site. July 16-17, 2008 PO.DAAC Review, ASA HQ 9

10 Target Capabilities Query & Display Map - Query and display data in the same widow so the the context of the data relative to the region of interest can be seen along with the thumbnail view. Value Filtering - Filtering of search results by parameter values, e.g. minimum, maximum, distribution, etc. Periodic - The user may want the same time-series period for a study, for example, September of the past 10 years. Multi-Data Selection - Allow multiple product selections Region Search - Using geographic terms for spatial specification, e.g. Greenland, Antarctica, Alaska etc.

11 Target Capabilities - Continued Display data in Polar coordinates - such as Polar Stereo Linked List & Map - Dynamically link the top listed granule to the top displayed thumbnail Analyze, Plot & Animate - Give the user the chance to work with the data. On demand subsetting - select just the data in the region of interest. Dual data display - Allow comparisons by time, product and location. Multi-format output - Give it to the user in the format they need. Subscription - Allow users to get new data as available. User modeling - Allow users to build their own processes, models and plug-ins to extend the system. (machine to machine)

12 Capabilities - Comparison Polar View / User Modeling Query & Map Display / Multi-Data Selection / / ASA WIST Subscriptio n Multi-format Output Dual Displ ay On Demand Subsetting Analyze, Plot & Animate Linked List & Map Regions Periodic Value Filter Agency System / / / / / / Alaska Ocean Observing University of ew Hamp. University of Arizona ASA SIDC ASA Goddard OAA Data Catalog Explorer Arctic RIMS RangeView EO DADDI Giovanni CDC

13 Operational Scenario A user at either PODAAC or SIDC selects a tool for searching for and selecting data. The tool, by all appearances, is identical at either site. Only the banners are specific to the data center. The tool provides the ability to select a region of interest anywhere on the globe. The user is able to enter a time or time range for the area of interest. After entering this information, a list of available products in the area of interest and time at both PODAAC and SIDC (at a minimum) is provided. This list of products allows the user to select products from the list for display and/or download. As products are selected, a display of the region of interest is updated with a visualization of the product overlaying the region. The updated display is also annotated with the information from the data related to time, location, name of product and information pertinant to the data (speed, temperature, etc). Products can be overlayed upon each other, or can be displayed individually on the area of interest. The user can download a copy of the image currently displayed which will include the annotation information. In addition, the user can request data products for download in one of several available formats. The selectable formats shall include but not be limited to: HDF, etcdf. The user can request to be notified of new products from this list as they become available in this region. The user can also request notification for any other products, not in the list but within the region when they become available at any of the data locations, PODAAC and SIDC (at a minimum). The user can request that these products be available as input into other tools or services provided by the data locations, PODAAC and SIDC (at a minimum) for further manipulation, display or analysis. July 16-17, 2008 PO.DAAC Review, ASA HQ 13

14 Functional Requirements Functional Requirements for a single tool providing both PODAAC or SIDC data JPL s Requirements List Support user request for information and/or products within a specified area and time from a range of products resident locally and remotely. Provide ability to select area of interest by location and time. Provide ability to select data available in area of interest by location and time from multiple measurements both local and remote. Provide data center identification of data location. Provide visualization of selected products as an overlay within specified area of interest. Provide overlay visualization capability of multiple selected products within specified area of interest. Provide annotation of the visualized overlays which includes not less than name of product, time of acquisition, lat/lon, measurement value range and type (speed, height, temperature). Provide acquisition of annotated image products displayed within area of interest. Provide acquisition of selected data products displayed within area of interest. Provide acquired data products in selectable data format of at least HDF and etcdf Provide notification of new products as they become available within a specified period of time. Provide notification of new products as they become available within the specified area of interest. Provide machine to machine interface for acquisition of products via FTP. Provide data linkage for selected products to other available tools and services at local and remote data center. Provide access to tool described above from either PODAAC or SIDC. Provide data center unique product emphasis such as product table list order, or area of interest emphasis (masking, etc). July 16-17, 2008 PO.DAAC Review, ASA HQ 14

15 Functional Requirements Functional Requirements for a single tool providing both PODAAC or SIDC data SIDC s Requirements List A Web-accessible system to provide SIDC's users the ability to preview and analyze key data sets in our collection. The interface will be straightforward, in the spirit of the CDC reanalysis web site, but will provide "something better" which is TBD. The system will initially focus on the Greenland area, but will not be limited to only work in that region Performance and Design Objectives 1. system response times will depend on action performed: 1. 5-second response time for display results, or in-progress indicator 2.??-second response time for data delivery (this should probably be a rate, as in seconds per file ordered, or seconds per GB of data ordered) 2. the user will be able to access the system with a common web browser, with no plug-ins or special software for the user to download; Ajax functionality is specifically in-scope; the current list of supported browsers is 1. Windows: IE 7.x; Firefox Macintosh/Linux: Firefox 3.x 3. system will be built with open source (C) and/or Government-funded technologies (C) (W says "preferably open source") 4. the user experience will be consistent; users will not be required to to know where the data are coming from, and will not be required to learn this in order to use the system. 5. to maximize reuse and minimize maintenance costs, there will be a standard user interface built for each kind of information (spatial, temporal, etc). Each of these interfaces may have different ways for the user to specify input, (e.g. specifying a date using a calendar widget vs. a text box, but there will not be 2 implementations of a calendar widget) 6. the system will incorporate reasonable security measures, for example, using ssl for at least user authentication July 16-17, 2008 PO.DAAC Review, ASA HQ 15