Tutorial. 1CLIMSOFT vers 3.2

Transcription

1 1CLIMSOFT vers 3.2 Tutorial Written by Myles Kirk-Gushowaty, Incisive Services Group Samuel M. Machua, Kenya Meteorological Service & Cathy Garlick, Statistical Services Centre June CLIMSOFT is a Climate Data Management System written by Samuel Machua & Albert Mhanda with development supported by Kenya Meteorological Service, Zimbabwe Meteorological Service, ACMAD, UK Met Office and the World Meteorological Organisation.

2 Table of Contents Introduction... 3 Databases... 3 Setting the Station Information... 4 Importing Station Information... 7 Elements... 8 Entering Daily Rainfall Data... 9 Viewing the entered data Importing Daily Data for One Element Page 2

3 Introduction Welcome to the CLIMSOFT v3.2 Tutorial. The aim of this tutorial is to get you started on using CLIMSOFT for your Climatic Data Management. The tutorial assumes that you have installed CLIMSOFT and have set up usernames and passwords. The tutorial will take you through the process of setting up station details, choosing the elements you wish to work with and entering daily data for some standard elements. Databases CLIMSOFT works with three databases: 1. The temporary database this is called Temp_work_file_v3.mdb 2. The intermediate database intermediate_climsoft_database_v3.mdb 3. The main database main_climsoft_database_v3.mdb Data are generally entered into the temporary database. From there they are uploaded to the intermediate database which has a more 1 normalised structure. Once in the intermediate database, quality control checks are performed before transferring the data to the main database. Currently all three databases are stored in the folder dbase which is a sub-folder of the CLIMSOFT installation folder. This is generally C:\Program Files\Climsoft or C:\Program Files (x86)\climsoft if you are running a Windows 64-bit operating system. All three databases must be in this folder for CLIMSOFT to work correctly. This tutorial is provided with a set of databases and, in order to work through the tutorial, you will need to temporarily replace the current databases on your PC with the tutorial databases. This is to prevent tutorial data from being entered into your live databases. Go to the folder containing the CLIMSOFT databases. Select the three database files o Temp_work_file_v3.mdb o Intermediate_climsoft_database_v3.mdb o Main_climsoft_database_v3.mdb and send all three files to a compressed zip file by right-clicking on one of the selected files and choosing Send to -> Compressed (zipped) folder from the pop-up menu. This is shown in Figure 1. Note: in Windows the default setting is to hide file extensions for known file types, therefore, on your PC, you may not see the.mdb extensions in the list of files. Name the zip file appropriately you will need to put these databases back when you have finished with the tutorial. Now take the zip file TutorialDatabases.zip and unpack it into the database folder, effectively replacing your live data. 1 Normalisation is a database term that results in data being stored in such a way as to minimise duplication and thus preserve data integrity. Page 3

4 Figure 1 - Packing up the live databases Setting the Station Information Open CLIMSOFT and log in. For the tutorial data we have information on 14 stations in the fictitious country of Limmoccow. Most of the station information you will import from a text file but you will enter the first couple of stations manually. On the Welcome screen click on Metadata for the purposes of CLIMSOFT, station information is classed as metadata. The dialog shown in Figure 2 will be displayed. This shows how the different types of metadata are related and there are some rules as to the order of entering metadata: Schedule Class must be entered before Schedule and before Station element; Station, Element, and Instrument, must be entered before Station element. Page 4

5 Figure 2 - Add or modify metadata Click on Station the form shown in Figure 3 is displayed This form shows any existing stations together with their location; our example databases are blank so no data is shown at this stage. One thing to note about this form is that the Station Details section and the Station Location section are designed to work independently, i.e. almost as separate forms. As such it is possible to display the details for one station and the location for a separate station in the same form. To check whether the details and the location refer to the same station compare the Station ID in the details section to the Station ID in the location section these fields should match. Let s enter the details and location for the first station. In the Details section, click the AddNew button Click in the Station ID field and enter ARIN0001 Click in the Station Name field and enter Arin Enter Airport as the Qualifier Enter Limmoccow as the Country Enter Central as the District We don t have any data for the Authority so click the Update button CLIMSOFT should tell you that the operation was successful. Next we will add the location for this station: In the Location section of the form click the AddNew button Click in the Station ID field and this should automatically show the Station ID you entered in the detail section. Click in Begin Date and enter 1918 As the End Date, enter 9999 this indicates that this station location is still active. Enter a Latitude of 8.13 and a Longitude of Enter 134 for the Elevation. Click the Update button in the location section of the form once again CLIMSOFT should tell you that the operation was successful. Page 5

6 Figure 3 - Station Details and Location Note: latitude and longitude are expected in decimal degrees. If you have these values in degrees, minutes and seconds CLIMSOFT provides a conversion facility. This is illustrated in Figure 4. Figure 4 - Conversion to Decimal Degrees Page 6

7 Use the same method to enter the following information for the next station: Field Value Station ID CETA0004 Station Name Cetar Qualifier University Country Limmoccow District North Begin Date 1949 End Date 9999 Longitude 72.7 Latitude 9.2 Elevation 14 Importing Station Information The remaining stations are in the file called tutorial_stations.csv. Note that this is a text file in which the values are all enclosed within double-quotes and are separated by commas; the first row of the file contains the fieldnames and these much match the fieldnames in the database which are: id wmoid aviationid begin_datetime end_datetime station_name district country qualifier drainagebasin latitude longitude elevation All these columns must be present in the file and in this order. indicated by using two adjacent commas. For example: SIHO0011,,,1920,9999,Sihorty,North,Limmoccow, West,,9.2,71.25,14 If a particular value is missing, this must be The three commas after the station ID indicate that we don t have a value for wmoid or for aviationid, and the two commas between West and 9.2 indicate that we don t have a value for drainagebasin. wmoid and aviationid indicate other identifiers by which this station is known. Often the same station has different identifiers in different contexts so these values are there to reflect these differences and help ensure the stations are matched correctly. To import the remaining stations do the following: Page 7

8 In the Station Details and Location dialog click on Import; the Import Station dialog will appear as shown in Figure 5. Figure 5 - Import Station Dialog With the Source Type set as Text (csv) click on Ok Find and select the file tutorial_stations.csv and click Open CLIMSOFT should tell you the operation was successful. Click Close to close the Import Stations dialog On the Station Details and Location dialog click View All at the bottom of the window you should see the data for the two stations we entered manually plus 12 other stations. Choose File -> Close to close this view of the data. Click Close to close the Station Details and Location dialog. Elements CLIMSOFT is provided with a standard set of about 200 meteorological elements. It is possible to add custom elements but please check to make sure that the element you need is not already in the list. About a quarter of these elements are selected by default. This means they will appear in the list of elements for which you can enter data but it is possible to select any of the other elements by setting the Selected flag in the element list. Some elements have a Total flag which indicates that during data entry users will need to enter a total value which CLIMSOFT will check against a calculated value. Note that for many of the elements there is a scale factor which in most cases is 0.1. This means that the value should be divided by this scale factor before being entered. For example 5.5 hours of sunshine in a day would be entered as 55. For this tutorial exercise we have three years of data from a station called Kundrip. This is one of the stations we imported. We have data for four elements: Maximum daily temperature Minimum daily temperature Total daily precipitation Total daily hours of sunshine We have daily data from 1980, 1981 and the list and are selected. Our first task will be to check that these elements exist in From the Add or modify metadata dialog click on Element. This opens the Elements Update dialog as shown in Figure 6. Page 8

9 Figure 6 - Elements Update dialog Click the down arrow next to the Search Element box and select Temperature; daily maximum. This will be near the top of the list. The details of this element will be displayed in the form. Make sure the Selected check box is ticked if it isn t you should tick it and click Update to save this change. Let s confirm that the other elements we want are selected. Still with the Element Update dialog open select Temperature; daily minimum from the dropdown list by the Search Element box. Confirm that this element is selected. Repeat this for Precipitation; daily total. With precipitation you should notice that the Total Required box is ticked this means you will need to enter the total precipitation for the month when you enter the data. Now try and find the element for sunshine hours. This element is further down the list. The easiest way to find this element is to open the drop-down list, then start to type sunshine; when you get as far as typing su you should see the element you want in the list. You are looking for Sunshine; Daily Total at 09 BST. Is the Total Required box ticked for Sunshine: Daily total? Click OK to close the Elements Update dialog. Click Close to close the Add or modify metadata dialog. Entering Daily Rainfall Data For our next task we will enter 6 months of daily rainfall data for Kundrip. Table 1 shows daily rainfall data recorded for Kundrip between January and June Note that these values are in millimetres so, because of the scale factor of 0.1, when we enter these values we will need to multiply them by 10. Page 9

10 On the Welcome screen click on Key Entry. This brings up a list of key-entry forms as shown in Figure 7. Figure 7: Key-Entry forms We will be entering data for one element for a month at a time so double-click on Data for one element for the whole month this brings up the form shown in Figure 8. Page 10

11 Figure 8: Data for one element for the whole month Before starting to enter anything in this form CLIMSOFT insists that you select the element so we will do that first. For the Element open the drop-down list and start typing Precipitation. Select Precipitation; daily total from the list. In the Station name or identifier box open the drop-down list and select Kundrip For the Year enter 1980 and leave the Month as 1. The Hour indicates the time of day that the measurements were taken and can range from 0 to is assumed to be midnight. Set the hour to 6 to indicate that measurements were taken at 6am. From Table 1 you can see that there was only one rainy day in January. Therefore it would save us time if we were to set all values to zero and then change the value for day 8. Check that the default value is set to 0 and then click on Set all Values to Default. Now move into the space for day 8 and replace the 0 with the value of 6 remember we need to multiply the values in our table by 10 because of the scale factor. Now move into the Total box and enter 6 Page 11

12 Click on Add New to save the current set of data and move to a blank record. As you move onto the blank record check that the Element is still set to Precipitation; daily total. You should also notice that the month has moved on automatically to 2. Check that all this header information is correct before continuing. Table 1: Rainfall data in mms; Kundrip 1980 Day Jan Feb Mar Apr May Jun 1 Nil Nil 2.2 Nil Nil Nil 17.5 Nil Nil 5.7 Nil Nil Nil 2.4 Nil 2.5 Nil Nil Nil Nil Nil 7 Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil 13.3 Nil Nil Nil Nil Nil Nil Nil Nil 20.5 Nil Nil 25 Nil 18.9 Nil 9 Nil Nil Nil Nil Nil 27 Nil Nil Nil 17.5 Nil Nil Page 12

13 Day Jan Feb Mar Apr May Jun 28 Nil Nil Nil Nil Nil Nil Nil Nil Nil Nil 15.8 Total Now enter the data for February in the same way. Enter the data for February including the total remembering to multiply the values in the table above by 10 because of the scale factor. Repeat this process for March to June; when you come to entering the total for June try entering an incorrect value for example try entering 4000 what response does this get from CLLIMSOFT? Note: You can use <Tab> to move forward through the form and <Shift-Tab> to move backwards. Note: If you choose Add New after entering the final record, CLIMSOFT will include a blank record in the dataset. If you find you have inadvertently moved to a blank record you can delete this extra record by clicking on the Delete key. CLIMSOFT will warn you that the record will be permanently deleted and you have the chance to cancel the deletion. The buttons at the bottom of this form work as follows: Add New: save the current record and add a new record moving you to a blank record note the station name, element and date will automatically be completed on the new record. OK: save the current record and close the form. Close: cancel the current record and close the form. Thus, to avoid saving a blank record, you should use OK as you finish entering your final record. Viewing the entered data Now let s view the data we have entered in list format i.e. all records together. If you have closed the Data for one element for the whole month form then re-open it. At this point you will be able to use the navigation buttons at the bottom of the form to move between the records. These are shown in Figure 9. The leftmost button will take you to the first record; the next button takes you to the previous record, the rightmost button takes you to the last record and the one to the left of that takes you to the next record. Figure 9: Navigation buttons How many records do you have? Let s view the data in list format. Click the button View/Export/Import Page 13

14 This will take you to a view of all the data with each month on a separate row of the table. The first column shows the station_id which should be KUND0002. Then we have the element_code, then the year, month and hour, then one column for each day of the month. Part of this display is shown in Figure 10. Figure 10: Kundrip rainfall data Note the element code for total daily precipitation is 5 Choose File -> Close to close this view of the data and record to the data entry form. Make sure you have the 6 months of daily rainfall data entered successfully and that you have no extra records in your dataset before continuing. Importing Daily Data for One Element Our next task is to import the remaining rainfall data for Kundrip. As mentioned earlier we have 3 years of daily rainfall data 1980 to We have already entered data for the first 6 months of 1980 and now we will import the remaining 2½ years of data from the file Kundrip Daily Rainfall.csv. The data file must be in a specific format for CLIMSOFT to be able to import it correctly. Each row of the file should have 99 columns. The first 5 columns are as follows: 1. station_id this is a text value and is the unique identifier for the station. In our example this would be KUND Element_code this is a unique numeric code for the element. In Figure 6 you can see that each element has a unique code. The code for Precipitation is Yyyy the next column is the year number which should be 4 digits e.g Mm then we have the month. This is also numeric so for January this would be 1 and for December this would be Hh the 5 th column is for the hour. This is the time the observation was measured and must be a value between 0 (midnight) and 23 (11pm). The next 31 columns are headed 1, 2,, 31; in other words one column for each day of the month. For months that have fewer than 31 days you should leave the corresponding cell blank. The next 31 columns are headed flag1, flag2,, flag31; i.e. these columns would contain relevant flags for the daily data. In Figure 8 you will notice the Flag column in the form. A flag represents whether a value is missing, trace, estimated or generated and can take corresponding values of M, T, E or G. We then have 31 columns headed period1, period2,, period31. The period defines the number of days or period of time that an observation covers. For instance let s assume rainfall is normally measured daily at 09:00 but one day was missed for some reason. Then the day that was missed would be set to missing with the flag set as M and the rainfall measured on the following day would cover 2 days or 48 hours so the Period for the day following the missing value should be set to 48 to indicate 48 hours. The final column is for the Total. Remember that some elements need a total to be entered and this should also be in the imported file. Thus we have a total of 99 columns. Take a look at the data file in Excel to get a better idea of how this looks. Page 14

15 From the Data for one element for the whole month form click on View/Export/Import as you did earlier to see all the data records in datasheet view. You should see rainfall data for the first months of 1980 From the File menu choose Import the screen shown in Figure 11 appears. Figure 11: Updating Temporary Database Click on Open File and find and select the file Kundrip Daily Rainfall.csv (remember your file extensions might not be displayed). Click Open to open this file the screen will now give the source file, the database name and the target table. Click Update to complete the import how many records are added? Click the Close button on this dialog and you should now be able to see all the rainfall data for Kundrip. This will be displayed in datasheet format with a separate row for each month. Choose File -> Close to close this view of the data. How many records are you able to see in the form? (use the navigation buttons to move to the last record) You may notice that you can still only see the original 6 records you entered manually and not the 30 records you imported from the.csv file. If this is the case, the form needs to be refreshed before all the data become visible in the form. However, do NOT click the Reset button on this form as this will clear the displayed record without warning! Instead you should close the form and re-open it. Click on OK to close the form. Then double-click on Data for one element for the whole month. Can you now see all 36 records in the form? Use the navigation buttons on the form to locate and view the record for July What do you notice about the end of this month? You should notice that the rainfall data for 30 July is missing and a Flag of M has been inserted. Therefore the value of 2.9mms for 31 July effectively covers 2 days so here we have set the Period to be 48 to indicate this. These values were included in the appropriate columns in the imported file. Click on Close to close the Data for one element for the whole month form. Then Close again to close the Key entry dialog. Page 15