WELCOME to the PRACTICAL EXERCISES

Transcription

1 WELCOME to the PRACTICAL EXERCISES COSMO/CLM Training Course

2 Overview For the practical exercises you have got a TUTORIAL, with which you can work most of the time on your own. There are 6 lessons, in which you will learn about Installation of the COSMO-CLM model package (Tutorial Chapter 1) Preparing External, Initial and Boundary Data (Tutorial Chapter 2) Running the COSMO-CLM in a step-by-step mode (Tutorial Chapter 3) Postprocessing and visualizing netcdf files (Tutorial Chapter 5) Running the COSMO-CLM in a chain mode (optional, Tutorial Chapter B.3) Trouble shooting CCLM Live And two optional sessions together with the NWP participants: 1. Idealized test cases / 2. COSMO-ART COSMO/CLM Training Course

3 Introduction COSMO/CLM Training Course

4 The Starter Package is the basis of the exercises in this trainings course contains everything that is necessary to perform a climate simulation on a UNIX system (except the netcdf Library) keeps everything under one main directory cclm-sp can be used to learn how all parts of a climate simulation work together can be used as template for your own simulation will be made available under COSMO/CLM Training Course

5 Support model development and coordination of activities in CLM community if you want to use the model get member support in the usage in different ways: (see homepage) Tutorial Forum+Wiki bug reporting system information on namelist parameters tool for preparing initial and boundary data further utilities COSMO/CLM Training Course

6 Namelist Tool for a new model simulation you need to think about namelist settings information on the namelist parameters: see User s Guide of model documentation (available at This information is also available in the Namelist Tool on the CLM community homepage possibility to list all parameters search for a parameter compare different default settings compare your own namelists with default settings COSMO/CLM Training Course

7 RedC Redmine for model development and dissemination in the CLM-Community Dissemination of latest model version Documentations Bug reporting Forums for posting questions COSMO/CLM Training Course

8 WebPEP WebPEP consists of two parts: Selection of appropriate simulation domain (View Domain) Creating external data sets (PEP, EXTPAR) PEP old version EXTPAR new version COSMO/CLM Training Course

9 COSMO/CLM Training Course

10 COSMO/CLM Training Course

11 Tutorial-Wiki Tutorial for how to install and run COSMO-CLM: You need to register first before using the page COSMO/CLM Training Course

12 Installation of the COSMO-CLM model package COSMO/CLM Training Course

13 Installation In this lesson you will learn how to login to and use DKRZ s supercomputer, the IBM blizzard what are the necessary components of the COSMO-CLM model package how these components can be installed on a computer COSMO/CLM Training Course

14 Logging in To the PC There is a plastic sheet on your desk with the Login name (Benutzername) Password (Kennwort) And the Domain (Domäne) Start Exceed /Cygwin Start a Putty session For setting up this session, see the paper sheet on your desk Log in to blizzard.dkrz.de Set the DISPLAY variable to the IP-Address of your PC COSMO/CLM Training Course

15 The IBM (DKRZ) Available Directories (this course) - /pf/k/username: for programs - /work/bb0721: for data, long-term - /scratch/k/username: for data, short-term - /hpss/bb0721:tape archive (via pftp) Batch commands: - llsubmit job_name : submit a job - llq u username : check the queue - llcancel job_id : cancel the job COSMO/CLM Training Course

16 Necessary data Files and Data for these exercises can be accessed via /hpss/arch/bb0721/training2013/cclm-sp.tgz Copy this file to your work directory and unpack it blizzard% pftp ftp> cd /hpss/arch/bb0721/training2013 ftp> get cclm-sp.tgz ftp> quit blizzard% cd $WORK blizzard% tar -xvf cclm-sp_tc2013.tgz COSMO/CLM Training Course

17 cclm-sp Main Directories cclm-sp src cclm cfu grib int2lm data ext gcm other_systems SX8-DWD cclm-sp step_by_step cclm_to_cclm gcm_to_cclm chain arch cclm_to_cclm gcm_to_cclm scratch work COSMO/CLM Training Course

18 Initialize cclm-sp Initialize the starter package by blizzard% init.sh It initializes several scripts with the basic directory. (Here: /work/bb0721/your user name) Set the help environment SPDIR with "export SPDIR=$PWD" COSMO/CLM Training Course

19 Compilations Do the necessary adaptations (see chapter 1.5 in the tutorial) and type make in the following directories: GRIB Library in cclm-sp/src/grib cfu Program in cclm-sp/src/cfu INT2LM in cclm-sp/src/int2lm CCLM in cclm-sp/src/cclm COSMO/CLM Training Course

20 Compilations done: when successful, you should have: GRIB Library: cclm-sp/src/grib/lib/libgrib1.a cfu Program: cclm-sp/src/cfu/bin/cfu INT2LM: cclm-sp/src/int2lm/bin/int2lm.exe CCLM: cclm-sp/src/cclm/bin/cclm.exe COSMO/CLM Training Course

21 Preparing External, Initial and Boundary Data COSMO/CLM Training Course

22 For cclm-sp For the test cases the external, initial and boundary data are already in the cclm-sp directory: external data: cclm-sp/data/ext initial & boundary data: cclm-sp/data/gcm/ncep COSMO/CLM Training Course

23 In General Initial and boundary data from GCM: Each GCM needs its own conversion program. For a few GCMs you can find programs on the CLM home page: Home > Model System > Model System Sources For ERA40, ERAInterim and NCEP1 reanalyses already converted data exist at DKRZ, for details visit: Home > Documentations > COSMO-CLM at DKRZ External data sets: These can be created with the WEB-PEP tool on the CLM home page Home > Model System > Initial and Boundary Condition > WEB_PEP COSMO/CLM Training Course

24 External Parameters preparing and using external parameters: use the domain which is given in the namelist LMGRID of the int2lm-script, but: 2 more grid points are needed at each lateral boundary for PEP-0.74, only grid spacings are possible The name of the file containing the external parameters ylmext_lfn and the path ylmext_cat have to be specified in the int2lm run script COSMO/CLM Training Course

25 Running the COSMO-CLM in a step-by-step mode COSMO/CLM Training Course

26 Scripts for step-by-step simulations are under cclm-sp/step_by_step/gcm_to_cclm for driving CCLM with global model data (NCEP Reanalysis in our test case) cclm-sp/step_by_step/cclm_to_cclm for driving CCLM with data from a coarse resolution CCLM INT2LM run script: run_int2lm CCLM run script: run_cclm COSMO/CLM Training Course

27 Script structure The general structure of the scripts is 1. batch settings node = 1 tasks_per_node = 64 output = sp_int2lm.o$(jobid) error = sp_int2lm.o$(jobid) 2. Namelist settings (cat INPUT*-Files) 3. Call of the binary &LMGRID ielm_tot=101, jelm_tot=111, kelm_tot=32, pollat = 39.25, pollon = , dlon=0.44, dlat=0.44, startlat_tot = , startlon_tot = ,.. /END poe ${SPDIR}/src/int2lm/int2lm.exe -procs COSMO/CLM Training Course

28 INT2LM namelist settings main switch to choose climate instead of NWP mode: lbdclim=.true. some settings are only interesting for climate mode: itype_w_so_rel: type of relative soil moisture input itype_t_cl: source for climatological temperature itype_rootdp: treatment of root depth itype_ndvi: treatment of plant cover and leaf area index itype_calendar: type of calendar (360 or 365/6 days) luse_t_skin: use skin temperature l_cressmann: use Cressman scheme for interpolation COSMO/CLM Training Course

29 For a description of the different namelist parameters, see chapter 2 and 3 in the Tutorial. Exercises: INT2LM: section CCLM: section (Part I) COSMO/CLM Training Course

30 Postprocessing and Visualizing NetCDF Files COSMO/CLM Training Course

31 Post-processing From the model output and/or observation data you may want to check the content of your output cut out/interpolate to a region of interest produce averages over a certain region or time frame calculate statistics. you need special tools designed for netcdf data and offering these commands COSMO/CLM Training Course

32 In this course: Tutorial chapter 5 Basic tool for inquiring netcdf files: ncdump command (comes with netcdf package) Simple viewer for netcdf files: ncview Collection of operators for postprocessing of climate data: CDO Collection of operators for manipulation of netcdf files: NCO Special tool for postprocessing of COSMO-CLM model output: ETOOL COSMO/CLM Training Course

33 ncdump Show information about netcdf files ncdump -h file.nc only header information (variables, dimensions...) ncdump -v var1 file.nc prints output of variable 'var1' COSMO/CLM Training Course

34 Quick look using ncview Go to the directory with the model output cd <path_to_model_output> Choose one file to display ncview <file.nc> In the dialog window - choose the variable to display (Var:) - change the colour palette (default is 3gauss) - change the range of values to display (Range) - change the type of data interpolating (Bi-lin Repl) - make a snap shot of the image using Print COSMO/CLM Training Course

35 Quick look using ncview Choose multiple files to display ncview <file*.nc> In the dialog window - choose the variable to display (Var:) - switch between data files using - click with the left mouse button on any location of the image (a time-series plot should appear) - change X Range and Y Range - make a snap shot of the image using Print COSMO/CLM Training Course

36 CDO: Climate Data Operators Collection of many command-line operators for standard processing of climate and NWP model output Free tool from Max Planck Institute Hamburg (Germany); homepage: Different file formats (GRIB, netcdf, ) and grid types Operators for e.g. file information, file operations, selection, comparison, arithmetics, statistics, interpolation,... Syntax: cdo <command>[,val1,val2] <options> <ifile> <ofile> Get information for operator: cdo -h <operator> COSMO/CLM Training Course

37 CDO: some commonly used commands selvar,<name> monmean / monsum mergetime fldmean output Select variable Monthly mean/sum Combine files with different times Area mean of fields Show information on output sellonlatbox,<lon1>,<lon2>,<lat1>,<lat2> Cut out subregion add / sub Add/substract data COSMO/CLM Training Course

38 NCO: netcdf Operators Collection of command-line programs to manipulate and analyze netcdf files Free tool (open source), homepage: Operators for e.g. arithmetics, manipulation of meta data, attribute editor, simple statistics, interpolation, Syntax: <command> <options> <ifiles> <ofile> Some commonly used commands: ncatted attribute editor ncks kitchen sink ncrcat record concatenator ncrename renamer COSMO/CLM Training Course

39 ETOOL Postprocessing tool for COSMO-CLM model output from the CLM- Community (Author: Peter Berg, KIT; available from community homepage) Shell script based on CDO commands 2m temperature and precipitation Producing monthly statistics Comparison to E-OBS dataset (gridded dataset for Europe with 0.25 resolution from ENSEMBLES project, see: Analysis for 'PRUDENCE' regions in Europe COSMO/CLM Training Course

40 Exercises See tutorial chapter 5.7 For this exercise, login to lizard.dkrz.de (not blizzard! Same login) Get package /work/bb0721/pp_visu/2013/pp_visu_2013.tar copy it to your work directory and unpack 3 draft shell scripts for you to fill in: ex_cdo.sh, ex_nco.sh, ex_etool.sh Observation data: E-OBS v.7.0 dataset./obs_data/ (precipitation, mean/min/max temp., msl pressure, orography) ETOOL script from CLM community web page./etool/ documentation for CDO and NCO./docs/ Use the output of your 2-month chain simulation (gcm_to_cclm experiment sp001). Later, if you want, you can also look at a 1-year simulation to be found in: /work/bb0721/pp_visu/2013/mod_data/ COSMO/CLM Training Course

41 Running the COSMO-CLM in a chain mode COSMO/CLM Training Course

42 The subchain scripts subchain control script prep prepare driving data int2lm interpolating data to CCLM grid cclm CCLM simulation post post processing (archiving and time series) monthly loop Simplified chain prep int2lm cclm post COSMO/CLM Training Course

43 The subchain Directory structure Experiment_name jobs subchain templates cclm.job.tmpl int2lm.job.tmpl post.job.tmpl prep.job.tmpl Experiment_name is a unique experiment name e.g. sp001 and sp002 in the starter package COSMO/CLM Training Course

44 The subchain Directory structure sp001 subchain jobs templates cclm.job.tmpl int2lm.job.tmpl post.job.tmpl prep.job.tmpl before start of chain COSMO/CLM Training Course

45 The subchain Directory structure sp001 chain_status check_files.log check_files1.log date.log subchain jobs cclmsp001.job int2lmsp001.job postsp job prepsp001.job templates cclm.job.tmpl int2lm.job.tmpl post.job.tmpl prep.job.tmpl after start of chain COSMO/CLM Training Course

46 Scripts for subchain simulations are under cclm-sp/chain/gcm_to_cclm/sp001 for driving CCLM with global model data (NCEP Reanalysis in our test case) cclm-sp/chain/cclm_to_cclm/sp002 for driving CCLM with data from a coarse resolution CCLM more info: Tutorial App. B COSMO/CLM Training Course

47 subchain Major General Settings ################################################# # START global settings ################################################# EXPID=sp001 # alphanummeric characters for job identification PFDIR=/yourpath/cclm-sp/chain/gcm_to_cclm WORKDIR=/yourpath/cclm-sp/chain/work SCRATCHDIR=/yourpath/cclm-sp/chain/scratch ARCHIVE_INPDIR=/yourpath/cclm-sp/data/gcm/ncep ARCHIVE_OUTDIR=/yourpath/cclm-sp/chain/arch YDATE_START= # start date of simulation YYYYMMDDHH YDATE_STOP= # end date of simulation YYYYMMDDHH _ADDRESS=john.smith@dummy.foo # your address PROJECT_ACCOUNT=$(cat $HOME/.acct) # this is your default one at DKRZ INC_DATE=01:00:00 # MM:DD:HH time increment for the CCLM job # (the other parts of the chain are always monthly) # valid values are 01:00:00, 00:01:00, 00:02:00,..., 00:27:00 UTILSBINDIR=/yourpath/cclm-sp/src/cfu # directory of utility binaries chain scripts in dir. $PFDIR/$EXPID! COSMO/CLM Training Course

48 subchain Major Model Settings STARTLAT_TOT= STARTLON_TOT= POLLAT=39.25 POLLON= DLAT=0.44 DLON=0.44 IE_TOT=101 JE_TOT=111 KE_TOT=40 KE_SOIL=9 CZML_SOIL="0.005,0.025,0.07,0.16,0.34,0.7,1.42,2.86,5.74,11.5" # do not use blanks HINCBOUND=6 # time increment of boundary data ITYPE_CALENDAR=0 # calendar, 0=standard, 1=climatological(360 d/y) LSSO=.TRUE. # sub-scale orography LFOREST=.TRUE. # account for forest LLAKE=.FALSE. # account for lakes set -A HOUT_INC # time increment for each GRIBOUT # first numeric is number of GRIBOUT namelists COSMO/CLM Training Course

49 Exercise same simulations as before (step-by-step exercise), but now in chain mode: 1) NCEP CCLM gcm_to_cclm/sp001 2) nesting CCLM CCLM_finegrid cclm_to_cclm/sp002 see Tutorial section Part II of the exercises COSMO/CLM Training Course

50 Trouble shooting COSMO/CLM Training Course

51 Well known problems (and their probable solutions ) - The model does not run, when there are YU* files in the current directory Delete the YU* files - Flags for cloud-ice from GCM data are set to TRUE but no data is available Set lprog_qi in INT2LM and lana_qi & lbb_qi in CCLM to FALSE - 12 monthly vegetation from the PEP file is not taken into account set itype_ndvi = 2 in INT2LM COSMO/CLM Training Course

52 Well known problems (and their probable solutions ) - Model crashes/reports problem with Runge-Kutta and nboundlines=2 You need to set nboundlines=3 when using the Runge-Kutta scheme. - INT2LM does not run with a too small external PEP file The external PEP file must be at least 2 grid points larger than the target region (at each side) COSMO/CLM Training Course

53 THE END Thank you for your Attention COSMO/CLM Training Course