Developments in FEWS. Marc van Dijk (Deltares) Gerben Boot (Deltares) 16 October 2008

Transcription

1 Developments in FEWS Marc van Dijk (Deltares) Gerben Boot (Deltares)

2 Outline Developments Delft-FEWS organisation > staff > support > fews board > software development Delft-FEWS features Delft-FEWS User Interface Questions & Discussion

3 Deltares: Where are Operational Systems? WL Delft Hydraulics situation (until 1/1/2008) unit Inland Water Systems > Hydrology group Deltares situation (from 1/1/2008) Operational Water Management Systems > unit Inland Water Systems Operational Water Management (OWM) > unit Coastal Systems Hydrodynamics and Operational Systems (HOS) erik simone karel

4 Delft-FEWS organisation Delft-FEWS Product Management Since 1/10/2007 From 1/10/2008 Developments Support & Maintenance gerben astrid gerben marcel new!!

5 Delft-FEWS Developers deltares - operational water management jitka juzer erik deltares software centre andre onno arjen frank frederik arno mr. X

6 Delft-FEWS Project Leaders/Managers karel marc micha dirk paolo alex albrecht matthijs klaasjan frederiek daniel annette

7 Delft-FEWS Support marcel (online) support & analysis remote assistence patching remote installation(s) training simone frederiek juzer erik alex gerben

8 Deltares ICT Support Installation of operational water management (live) systems in Delft and at clients More than Delft-FEWS: Matroos/Nautboom arthur snow personel

9 FEWS Board FEWS Features Board weekly meeting of FEWS-PM / developer(s) / PL(s) discuss / estimate / planning Main goals collection of new developments (brought in by clients / PLs) FEWS development strategy / direction observation of overlap > between features combine efforts/costs for clients > awareness of features for other clients Main outcomes time / costs estimate for proposals planning of developers (internal) commitment for developments

10 Software development design sessions issue/feature tracking system (JIRA) build server functionality (TeamCity) source code repository (SubVersion) documentation through WIKI FEWS Support (password protected) FEWS documentation (public)

11 Patching mechanism remote update of the Delft-FEWS code (binaries); valid for code + other rootconfiguration patch.jar or _patch.jar OC and FSS content *.jar-file overrules Delft-FEWS code in /bin/ directory content is based on the difference between the build# of installed /bin/ and the new version of the build in which bugs are repaired small selection of java-classes (± 1Mb) compared to /bin/ (± 200Mb) Upload through the Configuration Manager (rootconfigfiles) and distributed by the synchronisation process For Stand Alone (SA): manually copy this file to root configuration

12 Next steps FEWS forward (2) Delft-FEWS Product Management New developer(s) Support team extension (2 members) New PLs New markets New features release and beyond

13 Contents Deltares Integration of existing operational systems New features in latest release New features under development

14 Deltares Integration of operational systems Deltares consists of 4 institutes with multiple operational systems Delft-FEWS Generic Flow Forecasting System HYMOS Hydrological Database and Analysis System Matroos Central Forecast Archive Nautboom Forecast Modelling Script

15 Deltares Integration of operational systems In 2008 a project started to integrate the 4 operational systems Is there overlapping functionality? What are the strong and weak points of each system? HYMOS Hydrological database and Analysis System Database functionality is limited (to current standards) Extensive library of hydrological and statistical analysis functions Matroos Central Forecast Archive (Open) Operational database for coastal forecasting systems in the Netherlands Web-interface to retrieve and display data Nautboom Forecast Modelling Script Library of Perl scripts to collect, and process data Adapters to run WAQUA and SWAN models Runs on Linux cluster (multiple processors)

16 Deltares Integration of operational systems First integration steps have been made: Data exchange between Matroos and FEWS through NetCDF and NOOS data files (standard formats in coastal applications) Nautboom will run within FEWS as an external module with adapter 2 Pilot projects have been defined: Forecasting System for the IJssellake WAQUA, SWAN Models in Nautboom FEWS as Operator Tool Matroos as Forecast Archive Viewer for Rotterdam Pilots WAQUA models in Nautboom Matroos as Forecast Display Matroos as Forecast Archive FEWS as data viewer for Pilots

17 Just a FEW(S) Applications

18 New features in the latest release Displays Operator Client Features Timeseries Display Spatial Display Forecast Manager Modules FSS Features New imports Transformation General Adapter Central System MC/AI/OC Features Synchronisation Some FEWS Applications

19 Displays - Time Series Display Statistics: Tabular Information Base statistics min/max/mean/sum percentile exceedance standard deviation Counts reliables/unreliables/doubtfuls missings/corrected/completed Statistics: Graphical Information hydrograph time aggregate moving average duration curves

20 Displays - Time Series Display Display of Longitudinal Profiles

21 Displays - Time Series Display Longitudinal Profiles for data validation Use Interpolation module to convert scalar data to profiles

22 Displays - Time Series Display Enhancement of Historic Events functionality Compound Include Well known information Information historic with events actions taken

23 Displays - Spatial Display New ASCII Grid Layers Digital Elevation Models Static gridded information Animate Values at point locations

24 Displays - Spatial Display (also Explorer) Multi-color shapes in Map layers

25 Displays - Spatial Display Display of curved irregular grids (> 10 6 cells)

26 Displays - Spatial Display Local map cache: update maps locally when file on network is updated Multiple gridded time series in one animation Contour lines Draw & plot cross sections Draw areas & compute mass balance

27 Display Forecast Manager Permissions for viewing/deleting taskruns Re-download of forecast (different synchronisation profile) Delete a Forecast from Central Database Chang Forecast Expiry Time

28 Operator Client other features Help Context sensitive help (PDF-file based) Users & Permissions Allow management of access to: Accessibility of Explorer Tasks Accessibility of Filters Allow Data Editing Accessibility of Workflows/Task runs (view, run, approve, delete taskrun)

29 Modules Import Module FEWS Import Module - more import formats added OFSDE SHEF SSE NetCDF (CF-convention) NOOS Free data sources Tropical Rainfall Measuring Mission (TRMM) NOAA Global Forecasting System (GFS) Check the FEWS WIKI HowTo pages

30 Modules Transformation module Transformation Module - Statistical calculation options Functions min/max/mean/sum/count/mean/median percentiles/quartiles std.dev/ skewness/ kurtosis/ variance/root sqr. Apply to any timeseries (points, longitudinal profiles, grids, polygons)

31 Modules Other General Adapter Update of Delft FEWS Published Interface XML New Model Adapters (Nautboom, Delft3D, PcOverslag, HecRas,..) PCRaster grid engine Module Direct link between FEWS and PCRaster using the PCraster API Raster GIS script engine with hydrological functions See FEWS WIKI for examples

32 Configuration using attributes Enhanced FEWS Configuration Locations with attributes can be defined in Shape/DBF file Attributes contain coordinates, tooltip info, idmaps, locationsets-grouping LocationSets can be composed with where statements refering to attributes Example LocationSets XML Validation XML

33 MC/Admin Interface Admin Interface Redesign layout Manual failover mechanism for dual MC systems Option to view FSS log files from the AI Synchronisation On-the-fly downloads first meta-data is synchronised to client and data remains at server data is downloaded on-the-fly when client display needs it

34 JDBC Server Open the FEWS database to other applications Request data through standard SQL Build your own viewer on the FEWS database Examples of a JDBC Server connection: Lizard Webserver Developped by Nelen en Schuurmans ArtDiver groundwater data validation tool Developped by Artesia

35 FEWS Applications Water Quality New Import / Export data types Laboratory samples ibever New Database features Sample Time Series Type < or > Detection level data flags Integrated quality-quantity analysis Load balances New Model Adapters Delwaq model

36 New Features under Development Redesign Transformation Module Much easier to configure All current functions will be transfered Many new functions will be added Configuration Procedure Select type of transformation Include validity period (optional) Separate config file with coefficients (like ratingcurves)

37 New Features under Development Error model will be extended with MA component Full ARMA model will be available Import and Export of rating curves Facilitate automatic updating of FEWS Rating Curves Automatic updating of model Rating Curves through General Adapter Connecting to Master Controller through HTTPs Secure synchronisation of Operator Client without VPN/VNC connection Uses certificates at Operator Client and JBOSS side

38 New Features under Development Redesign of FEWS Explorer and other displays (Interactive forecast displays) Development is initiated by the NWS project Improve navigation access information when required Use of thumbnails and dockable window concepts Layout can be cutomized by the user

39 New Features under Development General layout of Interactive forecast displays

40 New Features under Development Example of Interactive forecast displays

41 New Features under Development Graph view navigation using thumbnails

42 New Features under Development Modifiers Concept of Modifiers has been introduced in 2008 Time series Modifiers Can be used to change individual time series for a period of time For example: do not use this gauge for two weeks because of maintenance New Modifiers will be added Parameter Modifiers > For example: use hydrodynamic models with summer and winter parameters State Modifiers > For example: edit a model state based on observed data

43 New Developments in Delft FEWS Demonstration of new features during User Meeting Questions?