Getting started with SARscape for Windows

Transcription

1 Getting started with SARscape for Windows Version 1.1 April

2 Index Introduction... 3 SARscape Quick Start... 4 Install SARscape... 4 Install SARscape Patch... 5 Uninstall SARscape... 6 ENVI environment and preferences... 8 SARscape preferences OpenCL Platform and Devices SARscape environment and modules SARscape Panel (typical) SARscape Workflow Generate Quick Look SARscape Extensions and file browser filter SARscape primary functionalities Sentinel Download Sentinel Data Download Sentinel Download auxiliary files Data Import DEM Extraction Multilooking Sample Selection Sample Selection Geographic Data Sample Selection SAR Geometry Data Geocoding Batch Processing Create Batch File Store batch Batch Browser Batch Chain Parallel Batch Processing Log,.Trace and Error report Clean Working Directory About SARscape

3 Introduction This document walks the reader through an example application (the generation of a geocoded and filtered Sentinel-1A image) to illustrate SARscape s main functionalities. These are referred to SARscape version 5.4.0, running under ENVI 5.4 with a standard (GIS-like) interface installed on Windows 10, 64bit. The first chapter, SARscape Quick Start, illustrates the correct settings for the task at hand. The second chapter, SARscape primary functionalities, explains with the help of practical exercises, how to fill the processing panels with the parameters required for the basic SARscape functions. For other software functionalities, such as interferometry or interferometric stacking, the Reader is referred to dedicated tutorials. The tutorials and the datasets can be downloaded from Paragraphs like this one, showing a hand on the left side, indicate a practical step that the user should perform in order to proceed with the tutorial. This tutorial will use Sentinel data. It will be described how to download these data from Internet. If this is not possible, please use the data contained in the Getting Started folder on our FTP (ftp.sarmap.ch). Please contact us at support@sarmap.ch to get login credentials and provide the full name of the license owner, the name of your institution and the license number. This tutorial contains Copernicus Sentinel data [2015] and modified Copernicus Sentinel data [2015]. The Sentinel satellites are owned by the European Union, there are part of the Copernicus program. They have been developed and are operated by ESA (100% of the operations funding comes from the EU). 3

4 SARscape Quick Start Install SARscape Before installing SARscape, please make sure you are logged in as an Administrator, that you have enough free disk space on your C: drive (about 1.5 GB) and that all other applications are closed. Starting with SARscape 5.4 it is not possible to install multiple version of SARscape and only the 64 bit version of SARscape is installed. This version of SARscape is only compatible with ENVI 5.4 In the Select Additional Tasks tab, select Install Intel OpenCL CPU-only runtime if you don t have the OpenCL CPU driver (in order to run OpenCL code on CPU, this flag is selected by default) (Figure 1). In this case, during the installation an other installation wizard will appear and the user can customize the installation of the Intel OpenCL Runtime (Figure 2). For further information, please visit and Figure 1: Select Additional Tasks tab during SARscape installation. 4

5 Figure 2: Installation of OpenCL runtime. In order to use SARscape 5.1 and newer, a working OpenCL runtime must be already available on the target machine. Install SARscape Patch Starting from SARscape 5.4 it is possible to open an internet link where it is possible to download the latest available patch for current version. The button is located at the bottom of SARscape s menu (Figure 3). Before installing SARscape patch, please make sure you are logged in as an Administrator and check that ENVI is closed. Please no not uninstall older patch from your computer. Each patch is cumulative of all the previous patches for the same SARscape version. 5

6 Figure 3: Last patch available button will open an internet link where it is possible to download the latest available patch for current version. Uninstall SARscape Before uninstalling SARscape, please make sure you are logged in as an Administrator and that all other applications are closed. This procedure will uninstall SARscape from your computer. The steps to perform are the following: Open the Windows Control Panel Click on Uninstall a program (Figure 4) Right click on the SARscape version you want to uninstall and click on Uninstall (Figure 5) Note: SARscape patches will also be listed here, please also remove these programs if you want to remove SARscape. Important: it is NOT possible to remove only a patch and continue to use SARscape. 6

7 Figure 4: Uninstall a program in the Windows Control Panel Figure 5: List of all installed programs. Right click on SARscape and click on Uninstall. 7

8 Layer Manager View Toolbox ENVI environment and preferences The ENVI standard interface is divided into three parts (Figure 6): the Layer Manager (left), Workspace (center) and Toolbox (right), as detailed in the following. Layer Manager: Shows all the current layers. It is possible to check/uncheck each layer in order to make it visible/hidden. View: The layers checked in the layer manager are shown here. From here it is possible to pan and zoom into/out from the shown layers. Note: The view can be split into several views using ENVI s Views menu. Toolbox: The toolbox contains all ENVI s tools divided in folders Note: If SARscape is correctly installed it appear as a folder in the toolbox. Search the toolbox SARscape Figure 6: ENVI window, divided in Layer Manager (left), View (centre) and Toolbox (right) with SARscape and the search field. Tip: If the name of a module is known (SARscape or ENVI), it is possible to type the name (or part of it) in the Search the toolbox field at the top of the tool (Figure 6). Then only the modules containing the searched name are shown in the toolbox. Delete the search string to show all the modules again. 8

9 Before starting with the processing, the Default Input Directory, the Output directory as well as the Temporary Directory have to be set in the ENVI preferences. This is helpful in order to have immediately the right suggestion for the path in the dialog boxes once opened. ENVI preferences are located in File -> Preferences (Figure 7). ENVI temporary directory is used to keep intermediary files during SARscape s workflow processes. Tip: Setting an easy reachable folder as Temporary Directory allows you to quickly access to the intermediary results of SARscape s workflows. If delete temporary files is set to false, the content of the Workflow temporary directory is moved to the ENVI output directory. Figure 7. ENVI Preferences / Directories panel. Suggested I/O and temporary directories. In order to go further, please set ENVI s I/O and Temporary directories. Please note: These directories should be located on a local hard drive where you have read/write privileges. 9

10 SARscape preferences Before starting with the processing, it is important for the SARscape preferences to be correctly set according to the type of processing to be performed. Several Preference-sets are ready to be used in SARscape and can be loaded using the top-left button in SARscape preferences (Figure 8). Subsequently they can be modified, adapted and saved for future use. Note: Note: SENTINEL IW has a dedicated preference set called SENTINEL TOPSAR. This has to be used in case of processing with Sentinel IW data. If the preferences are changed, the changes are not applied to already open windows. These panels have to be closed and re-opened so that the changes take place. Once a Preference-set is chosen, it is important to modify the Directories and batch file name tab. First of all, Working directory and Batch File Name have to be chosen. This allows to know where the working files and the Batch file are stored on the computer. Please make sure you set directories where you have read/write privileges. The Working Directory is used to store some information about SARscape processes such as Log and Trace file (as described in the.log,.trace and Error report section). The use of the Batch file and the possibility to perform parallel processing using different working directories will be explained in the Batch Processing section. The other directories have to be set if you have created a local (or local network) copy of DEM files or Orbit files. Note: For Sentinel-1 data, in particular for interferometric processing, it is strongly recommended to use precise or restituted orbit files. These data can be downloaded from this link: Following steps show how to set working directory and batch file name, make sure the Cartographic System is set to 15m (should already be set like this) and change the Quick Look Format to PNG. PNG Quick Look allow to have geocoded results displayed in Google Earth with transparent background. Please select the Sentinel Topsar preferences (Figure 8). Click on Directories and batch file name on the Preference List on the left and set the working directory and batch file name in your local hard drive (Figure 8). On Directories and batch file name set a folder for Sentinel-1 Orbit directory (Figure 8). Note: this folder will become about 7-9 GB large. Click then on General parameters on the left check that the Cartographic Grid Size is set to 15 m (Figure 9). This value will be automatically used in order to generate the multilooking factor in one of the following exercises. Set the Quick Look Format to PNG (Figure 9). 10

11 Figure 8. SARscape Default panel. The Load Preferences button in the upper left part allows loading preferences set that can be chosen from a list. Figure 9: General parameters in SARscape preferences. Cartographic Grid Size set to 15 m and Quick Look Format to PNG. OpenCL Platform and Devices At the top of the General Parameters in SARscape preferences, two fields called OpenCL Platform Name and OpenCL Device name are present. An OpenCL platform is a (vendor specific) OpenCL implementation and an OpenCL device is the actual processor performing the calculations. Each OpenCL platform can see one or more OpenCL Devices. For some SARscape tools, GPU support is provided. To carry out the processing using your GPU, choose it from the OpenCL Device Name list. By selecting different devices in different working directories, it is possible to launch parallel processing on different devices at the same time. Please refer to the Parallel Batch Processing chapter. 11

12 SARscape environment and modules All the tools and modules of SARscape are found in an ENVI s toolbox folder, usually located on the right side of the ENVI window. Clicking on the plus symbol near the SARscape folder will show all the subfolders containing the different SARscape modules (Figure 10). Figure 10: SARscape folders containing SARscape tools in ENVI s Toolbox SARscape Panel (typical) A standard SARscape panel is composed by several tabs. Not all of these are always present. The panel of the Geocoding is used here as an example as it contains all the tabs. Input Files The files needed by the processing have to be insert here (Figure 11). Unless otherwise specified, these files are mandatory. Valid entries include a list of one or more file names or slc_list products. The right mouse button opens a contextual menu with the following entries: Add Adds one or more files to the list. Remove Removes one or more files from the list. Add Folder: Allows adding all the files in a folder (and subfolders) that match the default file extension filter. This option is available only in some import tools. 12

13 Note: in some tools, like interferometric refinement and re-flattening, when the first input is inserted, the following input files are automatically completed assuming that the filename was never changed during the processing and that the default extensions were used. Optional Files These files, which are not mandatory, can be used to refine or to help the processing (Figure 12). DEM/Cartographic System In this tab, a DEM has to be entered or a cartographic system has to be selected (Figure 13). If a DEM is provided, its cartographic system is automatically selected. Figure 11: Input Files tab in the Geocoding panel. It contains an input file list. Clicking on the right mouse button makes the context menu show up, containing the Add and Remove buttons. Note: Add folder is active only in selected import tools. 13

14 Figure 12: Optional Files tab of the Geocoding Panel. The Geometry GCP File can be used to correct orbital information (please refer to the GCP manual Figure 13: DEM/Cartographic System tab of the Geocoding panel. In most cases, it is mandatory to select a DEM File or an output Projection (in this case, a Reference Height has to be defined). 14

15 Parameters This tab contains the parameters used for the processing. For a simple processing, the parameters contained in Principal Parameters can be used (Figure 14, left). Advanced parameters can be set from the Other parameters tab (Figure 14, right). Output Files This tab contains the output files. In most cases, the output files appear automatically in the path string or in the list. A right click on the list opens a contextual menu with the following entries (Figure 15): Edit Edit the path and filename of a selected entry. Remove Remove one or more files from the list. Change Output Directory Changes the output directory of the whole list Change File Extensions Changes the extension of all the files in the list with a new one. Note: the new extension should begin with the underscore. The actual extension will be replaced. Figure 14: Parameters tab of the Geocoding panel. The parameters set to modify can be changed as shown in the image in order to have access to Advanced Parameters. 15

16 Figure 15: Output Files tab of the Geocoding panel. It contains an output file list. A click on the right mouse button shows the context menu containing the Edit, Remove, Change Output Directories and Change File Extensions buttons as shown in the figure. Inside the panel, mainly two buttons are used to fill the fields: This button opens a file browser window allowing the user to browse and select the file to be inserted. This button allows creating the file that has to be inserted calling the proper tool (a functionality available for GCP Creation and DEM Extraction). After the creation of the file, the path is automatically inserted in the correct field. Most of SARscape s panels display the following four buttons at the bottom (Figure 16): (Help) The help page of the current panel is opened in the default browser. Store Batch The processing step is stored in the batch list. The batch browser button allows to load the batch processing list. For further information, please check the Batch Processing chapter. Exec The processing step is executed. Close The window will be closed. 16

17 Figure 16: Buttons at the bottom of a typical SARscape panel. SARscape Workflow SARscape workflows are intended to simplify the procedure of filling the different processing panels with the appropriate information (i.e. files and parameters). This chapter provides a description applicable to most workflow processing panels, although some interfaces may require more detailed information about specific files, parameters or settings, which are not considered here. Note: Note: The Store Batch button is not available for workflows. SARscape workflows are not available in the ENVI Classic interface. A SARscape workflow is composed by 3 main steps: the input step, the parameter step(s) and the output stepas detailed further in the bullet list below. The name of the current step appears below the Workflow title and it is highlighted in the step list on the left (Figure 18). In some workflows, it is necessary to insert GCPs during the workflow (Figure 17 bottom-left). Input This part of the processing chain is dedicated to the input files and principal parameters required by the workflow. In the different tabs it is possible to enter all mandatory inputs. The following three tabs are available in this section (Figure 17 top-left): Input File: The name and location of the input files are entered either as single files or as file list. DEM/Cartographic System: This tab allows either defining the output cartographic reference system, entering the reference Digital Elevation Model or choose an external one to download through the Digital Elevation Model extraction tool. This information will be considered in processes such as the Geocoding, the Interferogram Generation, the Interferometric Digital Elevation Model Workflow and others. Parameters: The principal parameters of the processing chain to be entered. Parameters (Figure 17 top-right) The interface is structured in parts, showing the name of the steps that will be performed in the workflow. By selecting one of the sections (e.g. "Coregistration", "Filtering", "Flattening", 17

18 etc.), the appropriate parameters will show up in the dialog. In order to allow both an easy use (for beginners) and a full interaction with all processing parameters (for advanced users), two ways are provided to define the processing parameter of each workflow step: 1. The name and location of the output files are entered either as single files, as a file list or output root name. More than one output option might be required Selecting the "Principal Parameters" from the pull down menu, the most important (and easier to understand) values are visualized with the possibility to modify them. Once this has been done the processing step can be executed without changing any of the additional parameters, which are listed in the menu (see the following paragraph). Any parameter, which is not specifically set by the user, is automatically retrieved by the program from the currently active Preferences. This is the suggested approach for beginners. 2. Beneath the "Principal Parameters", in the pull down menu, there are several groups of advanced parameters, which can be loaded and modified (e.g. coregistration, filtering, flattening, others, etc.). The name of each group is based on the parameters, which it contains. Experienced users, who already have a good knowledge of SARscape, often prefer to check and possibly tune all available parameters; this can be useful to tailor the processing to the peculiarities of a specific dataset. It is worth to mention that the original parameters, which are shown within each interface when this is first opened, are the same as those written in the currently active Preferences. If one or more parameters are modified in any specific processing interface, these new values are adopted for the subsequent processing, while the values written in the currently active Preferences remain unchanged. In other words, the Preferences are not affected by changes applied to the processing interfaces. Output Files This is the part in the processing chain dedicated to the output files and options (Figure 17 bottom-right): Output File: The name and location of the output files are entered either as single files, as file list or output root name. More than one output option might be required. Delete Temporary Files: To erase all the intermediate temporary files generated during the processing steps. This information will be considered in processes such as the Digital Elevation Model extraction, Geocoding, Interferogram Generation, the Interferometric Digital Elevation Model Workflow and others. If Temporary Files are not deleted, they can be found in ENVI s output directory. 18

19 The following buttons can be found at the bottom of each SARscape workflow (Figure 18): Preview By setting this flag, at the end of each processing step the intermediate outputs are made available for visualisation/analysis. help The help page of the current panel is opened in the default browser. save Clicking this button allows to save and close the workflow at the current step. After saving the workflow window will be closed. open Clicking this button allows to open a previously saved workflow < Back The workflow is brought to the previous step in the chain. This action can also be performed by selecting the desired section in the processing window: if the parameters are changed, all the temporary files generated by the subsequent steps will be erased and the process restarted from the selected section. Next > The workflow is moved to the following step in the chain. Next >>> By clicking this button all the steps are performed in sequence and it is not necessary to use the "Next >" button. Make sure that all settings in all the steps are correctly set before starting with this processing. If a GCP file is required, the workflow will stop at this step. Close The window will be closed. 19

20 Figure 17: Workflow panel sections. Top-left: Input step. Top-right: parameter step. Bottom-left: GCP selection. Bottom-right: Output step. 20

21 Current step Current step parameters Preview Open/save buttons Navigation buttons Figure 18: Example of InSAR DEM workflow at the Interferogram Generation step. The most important sections of the panel are explained here. Generate Quick Look Activating Generate Quick Look will generate a Quick View as Tiff and/or Png file, which can be easily opened by most image viewers (for example Windows Photo Viewer). This can be done in three ways: In SARscape preferences>general Parameters. If Generate Quick Look is set to true here, this will be done in all SARscape processing steps. The format (TIFF, PNG or both) can be set in the Quick Look Format parameter Under Global in the Parameters Tab in SARscape s panels (Figure 19). Using the Generate Tiff tool found in SARscape>General Tools>Data Export>Generate Tiff in ENVI s toolbox (Figure 20). 21

22 Figure 19: Make Tiff flag in the Global Parameters of the Geocoding panel. Figure 20: Location of the Generate Tiff tool in ENVI s toolbox. SARscape Extensions and file browser filter Files in SARscape are always composed by three separates files. Binary data (usually float, complex and byte) containing the data matrix..sml SARscape ASCII header containing all information mandatory for the data processing..hdr corresponding to the ENVI header format. This enables the product compatibility within ENVI. 22

23 It is important to point out that the binary data have no Operating System (OS) extension (using the dot symbol). For the OS they are simply files without extension of file file type (Figure 21). SARscape adds extensions using the underscore symbol (e.g. _slc, _pwr, _geo). This nomenclature helps to rapidly find a file of a certain type when a filter in the file browser is active. However, the real file type is saved in the.sml file and the binary file can have any extension or no extension at all. A list of extensions can be found in SARscape s help selecting General Information>Data Format>Nomenclature. Figure 21: _slc file with the.sml and.hdr header. Note how the two header files are recognized as HDR and SML files by the OS (Type column) whereas _slc (having no dot for the extension) is recognized simply as a file. As stated before, SARscape uses filters in the file browser window in order to help selecting the correct files. The filter can be off (Figure 22), it can display a set of default extensions (Figure 23) or it can be customized by the User (Figure 24). In the latter case, the star symbol is used as a wildcard with the following interpretation: When the star is at the beginning of the filter text (*filtertext), only the files with the filename ending with the filter text are shown. When the star is at the end of the filter text (filtertext*), only the files with the filename beginning with the filter text are shown. When the star is at the beginning and at the end of the filter text (*filtertext*), only the files with the filter text inside the filename are shown. 23

24 Figure 22: Filter is off. When the filter tab shows *.* (bottom right corner), then all the files in the selected directory are shown. Figure 23: Filter with predefined extensions. Only the files in the selected directory that end with the extensions in the bottom-right corner (_pwr, _gr, _slc and _fil) are shown. 24

25 Figure 24: Customized filter. When star symbols are used, it is possible to create a custom filter writing the filter text in the File name: field. In the example shown in the figure the file names containing VH are shown. The filters on the bottom right side are ignored. 25

26 SARscape primary functionalities After setting the directories and preferences, as described in the previous chapters, it is finally time to start working with the data. In the following chapters, the basic SARscape functionalities will be explained, walking the Reader through the steps required to generate a filtered, geocoded Sentinel-1 SAR intensity image. These involve downloading the SLC data, importing it into SARscape, extracting a DEM for later use, Multilooking, cutting out an area of interest (sample selection) and finally geocoding. In the last chapters we will cover Batch Processing and the generation of.log,.trace and Error reports. Sentinel Download Sentinel Data Download Data acquired from ESA s Sentinel satellites can be downloaded from a rolling archive on the internet, which currently stores all the data acquired in the last year. These data can be downloaded in two ways: registering and following the instructions on the Sentinel Scientific Data Hub ( or registering on Scihub and using the Download tool provided in SARscape s Data Import module. The latter approach is detailed below. The Sentinel satellites are owned by the European Union, there are part of the Copernicus program. They have been developed and are operated by ESA (100% of the operations funding comes from the EU). Note: Note: According to the connection speed, the download of a single image can take up to several hours. If you are unable to download the files or you do not have an internet access during the performing of this tutorial, please download the data in advance from our FTP site where you will find the acquisition used in this tutorial. Please contact us at support@sarmap.ch to get login credentials. Input Files Optional input files. In this Tab, reference files can be entered. The download tool will look for data intersecting the footprint of the images in this input list. Optional Files Geographical Region Shapefile. A geocoded shapefile can be entered here. The download tool will look for data intersecting the footprint of the shapefile. Parameters In this tab, the parameters needed to refine the search can be entered Output Files Progress file name. The download tool creates a progress file in order to keep track of the downloaded data. Images are downloaded in the same directory. 26

27 To start with the download, please open the SENTINEL Data Download found in SARscape Import Data folder in ENVI s toolbox (Figure 25) and fill the parameter as shown in Figure 26. No input files or optional files are needed. Please note: You must obtain a username and password by registering on the Sentinels Scientific Data Hub Once the progress file in the output files tab is set, click Exec. The following window should appear (Figure 27). Please wait until the download is complete before continuing with the tutorial. During this time it is possible to use ENVI or SARscape. Locate the downloaded data in the folder where the progress file has been set and unzip the downloaded compressed folder. We suggest to use the Extract here instead of the extract in folder feature as the length of the path can become too long. The extracted files should be the following for an SLC product: annotation folder, measurement folder, preview folder, support folder, a manifest.safe file and a.pdf file. Figure 25: Sentinel Download Tool in ENVI s toolbox. 27

28 Figure 26: Principal Parameters for the download of one Sentinel IW SLC Data acquired over Eastern Greece on February 16 th, The relative orbit number (ground track) is 29. Figure 27: Download page for the files found by the Download Tool. Progress File When at least one full data is downloaded, a Progress File named as defined in the output field is created in the output directory. This file can be used to skip already downloaded files which match the query. This file contains a list of all the data which are completely downloaded and the MD5 match the one provided by ESA. When a second request is preformed using the Sentinel Data Download tool, it is possible to set an already existing Progress File in the Progress File field. The software makes the following steps: creates a list of needed files which fulfil the query created by the user using the provided parameters check if files in this this list are already present in the Progress File (if provided). If they are present, the files are not downloaded (again) and are skipped If a file is already downloaded, present in the output directory and the list of needed files but not in the Progress File, the software performs a MD5 check with the file present on ESA servers and if they match, the Progress file is actualized with this acquisition. 28

29 This functionality is helpful when an archive has to be updated with new files. Note: Note: Never use the same Progress File when using two concurrent downloads! Concurrent downloads: One account is allowed to download a maximum of two concurrent download. Two different download can be launched with this tool but it is imperative to use two different progress files. Preview Mode: Small previews will be downloaded in the output folder instead of the full size SAR data. Note: Preview will be downloaded only for SLC and GRD data (Sentinel-1). Each preview is composed by a.png file containing the quick view image and a.kml file, which contains the footprint polygon and the quick view.png draped. By clicking on the footprint polygon, following information are displayed: Satellite ID, Acquisition mode, Polarization, Orbit Direction, Absolute Orbit, Relative Orbit and filename. This is helpful in case only one track has to be downloaded but the relative orbit is not known a priori. Defining a region of interest and entering in the Preview Mode allows the user to have an overview of all the acquisition on the interested area. Afterwards, based on these new acquired information, the search parameters can be adapted in order to match the desired request and the preview mode can be disabled (Preview Only = FALSE) in order to download the SAR data. In the example below (Figure 28), the preview.kml displayed in Google Earth of two tracks on the same area of interest is shown. Clicking of the preview footprint polygon a balloon displaying acquisition information is shown. The following color code is used for the footprint polygons: RED: IW GREEN: EW BLACK: SM Figure 28: Preview kml displayed in Google Earth. 29

30 Sentinel Download auxiliary files For interferometry purposes the presence of precise orbit is crucial. Orbit files have to be inserted in the import tool in the proper file list. the order must be the same as the order of the input file list. If no orbit files are inserted in the proper list in the import tool, the software will automatically look for the correct files located in the repository, set in the preferences (Sentinel-1 orbit directory, Figure 8). This repository can be populated manually with data downloaded from the Sentinel-1 Quality Control website ( Otherwise, the SARscape s downloader for Sentinel auxiliary files downloads will perform a search for all the available orbit files on the above-mentioned web page and allows the user to keep the repository up to date. The repository is the Sentinel-1 Orbit Directory set in the SARscape preferences chapter at page 10. This tool is located in the Import module in ENVI s toolbox (Figure 29). This tool only has two options: Incremental and Full. There is no output as the files are automatically downloaded in the Sentinel-1 Orbit Directory set in the SARscape preferences. If Full is set, a search in all pages of the online repository is performed. Data already downloaded will be checked and, if the dimension matches, skipped. Missing or corrupted files will be downloaded and stored, updating the local repository. If Incremental is set, all the files between the latest file already present in the local repository and the latest present on the online repository are downloaded. No consistency check is performed for older files. Figure 29: Sentinel Download Auxiliary files Tool in ENVI s toolbox. Set the Download all the files parameter to Full and click Excec.. A new window will appear and the download starts. During the download it is possible to continue using ENVI. Tip: The downloaded orbit files can be kept for further processing with Sentinel-1 data. Just make sure to update the repository in order to cover the entire time span. We suggest to keep a local/local network repository of the Sentinel-1 Orbit Directory and to update regularly using the Sentinel Download Auxiliary Files too. 30

31 Data Import The purpose of the Data Import is to convert the data into SARscape s Data Format. It is important to point out that it is mandatory to use the SARscape s Import Data tool in order to use any data that was not created with SARscape. Once an image is imported in SARscape using the appropriate Import Data tool, it is possible to open it in ENVI s view using File -> Open in ENVI s menu bar. SARscape products consist of the following data types: Binary data (usually float, complex and byte) containing the data matrix. Two ASCII header files containing ancillary information: o.sml file, containing all relevant information for the data processing. o.hdr file, corresponding to the ENVI header format. This enables the product compatibility within ENVI. For some sensors, during the import, there is the possibility to insert orbit files. This allows updating the orbital information already present in the original data with other, more precise, orbital data. It is also possible to update the orbit after the import using the tools present in General tools>orbital Correction>Update to precise orbits. If the folder containing orbital data is already present on the computer, its path can be added in the SARscape preferences (Figure 8). In this way, it is not needed to insert the orbital file(s) in the import panel and these are automatically retrieved by the software from the specified folder. Note: Note: Note: For Sentinel-1 data, in particular for interferometric processing, it is strongly recommended to use precise or restituted orbit files. These can be downloaded from this link: Some sensors require the user to select manually the data product type in the parameters tab (Figure 30 shows an example of import ALOS PALSAR). If you are unable to download the data for the exercise, or you do not have an internet connection, please use the gettingstarted.zip dataset containing the sentinel file used in this exercise. This.zip file can be downloaded from our FTP page, please contact us at support@sarmap.ch to get login credentials. 31

32 Figure 30: Parameters tab of Import ALOS PALSAR panel. In this (and other) import panels, it is mandatory to select the datatype of the files that have to be imported. Precise orbit files can be applied for different sensors (Sentinel-1, ERS, ENVISAT and Radarsat-2). If no orbit directory is set in SARscape preferences, the orbit must be inserted in the Optional Input Orbit file list. Note that the order in this list must be the same as the order of the data in the Input File List. If the same orbit file is valid for more acquisition, this must be inserted one time for each acquisition (even if already present in the Optional Input Orbit file list. Otherwise, a more convenient solution is to keep local/network repository for each sensor of most/all orbit files available and set these repositories in SARscape preferences. SARscape s import routines automatically looks into the orbit repository set in the preferences and automatically retrieve the correct orbit data. In this case the Optional Input Orbit file list must be kept emty. As the previously downloaded data are SLC and not RAW, the Import module has to be chosen instead of the Import and Focusing. The panel is found in Import Data>SAR Spaceborne>SENTINEL 1. Unzip the compressed folder containing the SAR data (if not previously done). The manifest.safe file has to be used as input in the Input File List as shown in Figure 31. The path of an orbit file is optional. Optional Input Orbit file list must remain empty as the Import routine automatically looks for the correct orbit file in the proper repository. Select Make Power QL to False (Figure 32). The power image will be created later in the Multilooking chapter. Set Rename the File Using Parameters to TRUE. This will rename the output file name using the sensor name, the track number, the date and time of the acquisition and the polarization. Right clicking on the Output File List 32

33 allows to choose the directory where the imported file will be saved. Right click on the Output File List and change the output directory to a convenient one. Click Exec and wait the End message. Once the import has ended, in the output folder you will find two folders (one for each polarization) containing the burst. Outside the folders you will find two _slc_list file (one for each polarization, each one with its.hdr and.sml files) containing information on all of the bursts. Figure 31: Import Sentinel-1 panel showing the Input Files tab. The manifest.safe file is used as Input File for Sentinel Data whereas the Orbit Files are optional and not required in this example. Tip: Tip: Tip: Tip: If more acquisition have to be imported at the same time, please use the Add Folder option by right clicking in the Input File List and set a root directory containing all the (unzipped) acquisition. This will avoid to manually insert each acquisition. In sentinel-1 data, if in the Input File List there are consecutive tracks, the software will automatically mosaic these data if Make Mosaic Same Track is set to True. In sentinel-1 SLC data, set Make Power QL to False if you are planning to import a large stack. Multilooking will be skipped and the import speed increase considerably. In sentinel-1 data, if the area of interest convers only a small part of the whole IW SLC acquisition, it is possible to ingest a shapefile in geographic coordinates in the optional files. Import routine will import only the bursts covering this area, decreasing the import time considerably. 33

34 Tip: In For sentinel-1 stacking process, we suggest to import only cross-polarizated data as these are more suitable for interferometry. This can be selected in the parameters. With this option activate, the import time will be halved. Figure 32: Parameters, Other Parameters Tab of the Import Sentinel-1 panel. Please set Make power QL to False as it will be created in the Multilooking chapter, set. Once the import processing has ended, the following files should have been created in the selected output folder for each polarization (Figure 33 shows the example of VH polarization). Please note that, in case of Sentinel TOPSAR slc images, the data of each polarization is stored in a folder. Outside the folder, an _slc_list file (together with ancillary files) keeps track of the information inside the folder. Note: The structure of the imported file has to be kept when moving the files. In particular, the _slc_list (together with all ancillary files) has to be in the same directory as the split_bursts folder (Figure 33). 34

35 Figure 33: Imported files for VH polarization. In case of sensors other than Sentinel IW SLC, Palsar 2 ScanSAR and TSX ScanSAR, no subfolders are created. The _slc files with the associated.sml and.hdr files are present in the selected output directory (Figure 21). DEM Extraction An accurate reference Digital Elevation Model (DEM), containing heights above a reference ellipsoid, will improve the quality of several processing steps, such as geocoding, coregistration and interferometric phase flattening. If a high resolution DEM is not available, SARscape allows to extract a DEM from a local folder (GLAS-ICESat and RAMP) or download and extract a DEM from a FTP location or local folder (ACE, GTOPO30 and SRTM). All of these tools are located in the General Tools, under the Digital Elevation Model Extraction folder (Figure 34). Note: Currently, the only DEM that can be downloaded from the Internet is the SRTM3v4. Other DEMs have to be downloaded manually and the proper folder linked in the SARscape preferences. Figure 34: Location of the Digital Elevation Model Extraction tools in ENVI s toolbox. In addition to these supported DEMs, other DEMs can be imported in SARscape using generic import tools such as 35

36 Import TIFF (in case of TIFF files) Import ENVI original tool (importing the DEM into ENVI first and saving it in ENVI format). Import Geocoded Binary paying attention to set the parameters correctly. In the parameters of the ACE, GTOPO30 and SRTM DEM extraction, it is possible, besides generate slope which is available for all the DEM extractions, to select coordinate box boundaries, set X and Y grid size, Replace Dummy With Min and Subtract Geoid. Replace Dummy With Min replaces all the Dummy values of the resulting DEM with the minimum height value present. This is helpful when working on coastal areas where the DEM contains Dummy value on water and the DEM boundaries on water are serrated. For our exercise, it is possible to download the freely available SRTM-3 C-band DEM. If the web server is online and no firewall blocks the connection, SARscape will allow the User to automatically download and mosaic the relevant tiles. The spatial extension of the DEM to be downloaded can be chosen either by giving one or more reference images or by giving box coordinates. Tip: Some tools, like the interferometric or the geocoding ones, have a binocular button which allows to call the DEM extraction tool directly, and automatically inserts the path of the downloaded DEM in the panel. Tip: SARscape s WorkFlows can also directly download, import and use a DEM as shown in Figure 35. The Reference Type has to be changed into Dem Download and then select the desired DEM. This will be downloaded and imported when clicking Next > or Next >>>. Tip: Starting with SARscape 5.4, it is now possible to import SRTM1v3 DEM. There is no automatic download feature as with the SRTM3v4. The SRTM-1 tiles can be downloaded from the USGS Earth Explorer (select the "SRTM 1 Arc Second Global" product from the Digital Elevation->SRTM category and download the geotiff format). Place the unzipped tiles in the "SRTM-1 DEM directory" specified in the Directories Preferences. If no directory is specified in the preferences, the files will be searched for in sub-folder "SRTM1_DEM_DIR" in SARscape's working directory. Note: Registration is required to download products through the USGS Earth Explorer. If several tiles need to be downloaded, we suggest you follow the USGS bulk order instructions. 36

37 Figure 35: DEM extraction tool inside of a WorkFlow panel. Tip: Tip: Note: Download a common reference DEM that covers all geometries and all sensors to be used in the processing. The tool will automatically download a DEM with an extension covering all input reference images. If a local repository of SRTM DEM is available, the path can be inserted in the SARscape preferences as previously described. The software will then automatically look for the data in this directory instead of downloading in via FTP. SRTM DEM is available only on land and between 60 N and 56 S of latitude and heights are above the EGM96 geoid. By default, the geoid component is subtracted during the DEM extraction, resulting in heights above the reference WGS-84 ellipsoid. Using the General Tools>Cartographic Transformation>Geoid component it is possible to add/subtract the geoid component, which can be the EGM96, EGM2008 or a used-defined one. Open the DEM Extraction SRTM3 Version 4 panel found in General tools>digital Elevation Model Extraction>SRTM-3 Version 4 and insert the previously imported _slc_list file in the OPTIONAL Reference SR image list in the Input Files Tab. It is possible use either both polarization. Select the GEO-GLOBAL cartographic system as shown in Figure 36. Leave all the parameters as default and set the path of the output DEM file (We use Eastern_Greece_SrtmV4_dem as filename, as shown in Figure 37) Click Exec. Depending on your connection speed, the download can take up to several minutes. At the end of the processing the DEM will be loaded in ENVI s view (Figure 38). 37

38 Figure 36: DEM/Cartographic System tab in the DEM Extraction panel. Please select GEO-GLOBAL as output projection. Figure 37: Output Files tab in the DEM Extraction panel. Insert Eastern_Greece_SrtmV4_dem as Output DEM File. 38

39 Figure 38: Downloaded SRTM DEM at the end of the DEM extraction process in ENVI view. The white area in the lower part of the image is the Sea. The SRTM3v4 DEM contains no data (NaN values) over the sea. Multilooking A Single Look Complex (SLC) SAR image product provides the highest possible spatial resolution, but its intensity is affected by speckle, due to the coherent superposition of radar returns from the resolution cell. Multilook Intensity images may be generated by averaging SLC pixels in the range and/or azimuth dimension, improving radiometric resolution at the expense of spatial resolution. The number of looks is a function of pixel spacing in azimuth, pixel spacing in slant range, and incidence angle. The goal is to obtain a multi-looked image with approximately squared pixels considering the ground range resolution (and not the pixel spacing in slant range) and the pixel spacing in azimuth. In order to avoid overor under-sampling effects in the geocoded image, it is recommended to generate a multi-looked image corresponding to approximately the same spatial resolution foreseen for the geocoded image product. The ground resolution in range is defined as: ground range resolution = Pixel spacing slant range sin (incidence angle) Example Sentinel 1 Single Look Complex data are processed with the following parameters: pixel spacing azimuth = m pixel spacing slant range = 2.33 m incidence angle scene centre =

40 This information is available in the _slc.sml file (_slc_list.sml for Sentinel-1 TOPSAR data) in the following fields: [Processing section]pixelspacingaz [Processing section]pixelspacingrg [ChannelInfo section]incidenceangle The multi-looking factors in range and azimuth will be: ground resolution = 2.33 m / sin(38.92 ) = 3.70 m, a multilooking factor of 4 has to be applied and a range resolution of m is reached. A similar resolution in azimuth is obtained by applying a multilooking factor of 1 (pixel spacing azimuth multi-looked = m). Open the Multilooking panel, found in Basic>Intensity Processing>Multilooking and insert the previously imported _slc_list data in the Input File List. The looks in the parameters should automatically adapt according to the gridsize decided previously in the SARscape preferences chapter (15m). A pop-up window should appear (Figure 39). Right click on the Output File List and change the output directory to a convenient one. We suggest to use the same directory as the one used for data import, a suffix _pwr will automatically be added. Click Exec. Once the processing has ended, the two multilooked images (one for each polarization), will show up in ENVI view (Figure 40) using the default Linear 2% stretch. Change the stretch to Square root using the proper drop-down menu and then click on the Histogram Stretch button. Change the Min: and Max: parameter in order to enhance the visualization of the data (Figure 41). Click on the other acquisition in the layer manager in order to change the histogram on the other data (use the check buttons to visualize the correct data. Note: changing these parameters are for visualization only and have no effect on the data. Figure 39: Pop-up appearing after inserting input files in the Multilooking Panel 40

41 Figure 40: Result of multilooking opened in ENVI view (_pwr file). See the drop-down menu for stretch and the Histogram Stretch button above the image. Figure 41: Result of multilooking opened in ENVI view (_pwr file) after applying the Square root stretch and adjusting the histogram. 41

42 Sample Selection The Sample Selection is a SARscape tool that allows creating a subset of an image (or a stack of images) in order to reduce the extent to the area of interest and so reduce the file size and processing time. The interested region can be selected by giving coordinates (geographic or SAR) or by selecting a Shapefile. To create a Shapefile go to File New Vector file in ENVI menu and then give a name to the shape and click OK. When the polygon is drawn, right click and accept. To modify a created vector use Edit Vertex in ENVI s vector tools found in the toolbar (Figure 42). Please refer to ENVI s guide for further information about this tool. Figure 42: Edit Vertex in ENVI s vector tools. Depending on the source file types, two Sample Selection tools are available in SARscape s General Tools (Figure 43): Sample Selection SAR Geometry Data This tool has to be used if the selection has to be performed on data in SAR geometry (_slc, _slc_list, _pwr, _gr) Sample Selection Geographic Data: This tool has to be used if the selection is to be performed on geocoded data (_dem, _disp, ) Note: When using Sample Selection on a Sentinel _slc_list file, the vector has to be created on the multilooked _pwr image and this _pwr image has to be used as reference file. 42

43 Figure 43: Sample Selections tools in ENVI s toolbox. Sample Selection Geographic Data After inserting the Input Files in the list, the subset can be created either using a geocoded vector file (.shp) or giving box geographic coordinates. Make Max Common Area will create a subset considering only the maximum common area between all input files. This can be useful to compare ascending and descending acquisitions or different sensors. Use Min and Max Coordinates will create a subset using box coordinates taken from min and max from the shapefile. Sample Selection SAR Geometry Data After inserting the Input Files in the list, the subset can be created using either a vector file (.shp) or giving box coordinates. If the vector file is geocoded or if the box coordinates are in geographical coordinates, the Geographical Region check has to be set to TRUE. If the vector file or the box coordinates are in slant coordinates, the Geographical Region check has to be set to FALSE. Use Min and Max Coordinates will create a subset using box coordinates taken from min and max from the shapefile. Note: Because of the particular nature of IW SLC Sentinel-1 data, the sample selection of this data has to be performed in a specified way, described here. Using geographic box coordinates or shapefile in geographic coordinates: o Simply add all the *_slc_list files in the input file list o Insert the vector file in the optional files tab or insert the box geographic coordinates in the parameters tab o Insert the DEM in the optional files o Set Make coregistration to FALSE in the parameters tab o Set Geographical Region to TRUE in the parameters tab Using slant range box coordinates or creating a shapefile in slant range coordinates: 43

44 o o o o o Open one multilooked _slc_list_pwr file in envi (please note the filename, this will be your reference image) Retrieve box coordinates on this reference image and report them in the parameters tab or create a shapefile on this reference and insert the.shp file in the Vector File field in the optional files Insert the reference _slc_list_pwr image used to retrieve coordinates or create the shapefile in the Input reference file in the Optional Files tab (no need to insert the DEM in this tab) Set Make coregistration to TRUE in the parameters tab Set Geographical Region to FALSE in the parameters tab In this tutorial, the sample selection process will be executed on _pwr images and not on _slc list. It is so not necessary to provide a reference image. Open the sentinel1_29_ _ _iw_siw1_a_vv_slc_pwr image created in the previous step in the ENVI View. In the ENVI menu click on File New Vector file and then give a name to the shape and click OK. At this point it is possible to draw a shapefile, we suggest to use the same region as the one shown in this example as it is interesting for flood events and the shapefile can be used for the Basic Tutorial. Right click and accept to finish drawing (Figure 44). The shape will not be perfectly rectangular. This can be solved using the Use Min and Max coordinates flag in the parameters (Figure 47). Right click on the shapefile in the layer manager and click on Save As (Figure 45). Once the shapefile has been correctly created, the Sample Selection for SAR geometry data can be opened. It is located in General Tools>Sample selections>sample Selection SAR Geometry data. Fill in the input file list field with the two _pwr images (one for each polarization) created in the Multilooking step. In the parameters Tab, make sure that Geographical Region is set to False (as the shape was acquired in slant geometry) and set the Use Min and Max coordinates flag to True. The sample selection will then use a perfect rectangular shape that exploits the min and max coordinates of the previously draw shapefile. Set the output file list. Note: the suffix _cut will automatically be added before the last extension name. Click Exec. Once the processing has ended, the two input files are shown in ENVI view (Figure 48). Note: The DEM in the Optional Files Tab is mandatory if the Shapefile is created in geographic coordinates in order to avoid geolocation errors. 44

45 Figure 44: Polygon draw on sentinel1_29_ _ _iw_siw1_a_vv_slc_pwr image. Right mouse click and Accept to accept your changes to the polygon. Figure 45: Right click on the Shapefile in ENVI s Layer manager in order to save it to a convenient folder. 45

46 Figure 46: Vector file and DEM file in the Optional Files tab of Sample Selection panel. Figure 47: Parameters tab of the Sample Selection Tool. 46

47 Figure 48: Cut area opened in ENVI view after the Sample Selection processing has ended. Now the output image only contains our area of interest. The size is smaller in coverage and therefore disk size, compared to that of the full frame, which also reduces subsequent processing time. Note: If this tool is used to create a cut area over an area of interest containing a movement, please make sure also enough surface containing stable terrain is inside the area. This will be needed as stable reference. Geocoding SAR systems measure the intensity and phase of the transmitted radar pulses following their reflection (backscatter) from the Earth s surface. The data is recorded in a 2D coordinate system (slant-range geometry), onto which 3D objects on the Earth s surface are projected. For several applications, geocoding of the SAR image is required, i.e. 2D SAR coordinates must be associated to 3D coordinates in a given horizontal and vertical datum. Furthermore, if the backscattered intensity of different acquisitions needs to be compared, a radiometric calibration of each image is required, to make the radar intensity independent of the acquisition geometry and of the SAR processor. Geocoding and radiometric calibration of the example Sentinel data is carried out as follows. Open the Geocoding panel, found in Basic>Intensity Processing>Geocoding>Geocoding and Radiometric Calibration and insert the 47

48 previously resampled _cut_pwr data in the Input File List. Insert the DEM downloaded in the DEM Extraction section and check the Radiometric Calibration is correctly set to True in the preferences (Figure 49). Set the output file list. Note: the suffix _geo will automatically be added after the last extension name. Click Exec. Once the process has ended, ENVI will automatically load a meta file containing all the files of the output file list. You can close this file and load the resulting _geo files manually. When the files are loaded, please change the stretch to SARscape stretch (Figure 50). To contextualize this image, it is possible to load ENVI s coastlines found in the menu File Open World Data Coastlines (Figure 51). Now the image is shown together with the loaded coastlines (Figure 52). It is also possible to open the created.kml files to project the resulting _geo image on Google Earth (Figure 54) Figure 49: Principal Parameters of the Geocoding panel. Please set Radiometric Calibration to True. 48

49 Figure 50: One of the two geocoded images opened in ENVI view. Please change the stretch as described in Figure 40 and Figure 41. Figure 51: How to open Coastlines in ENVI 49

50 Figure 52: Geocoded image and ENVI s coastlines. The following files are created in the output directory containing calibrated and geocoded SAR data (Figure 53). If a DEM in GEO-GLOBAL (lat-lon grid) has been chosen to perform the geocoding, a _geo_ql.kml and a _geo_ql.tif files are created for each output of the geocoding in the output directory. This allows to have a Google Earth quick look of the outputs. If no Google Earth.kml file is present, it is possible to create one using the Generate Google Earth KML File tool found in ENVI s toolbox under SARscape>General Tools>Data Export>Generate Google Earth KML File. Figure 53: Results of geocoding processing showing the two geocoded (_geo) images together with the ancillary files. Note the two.kml files that are automatically created if the DEM used to geocode is in geographic coordinates (lat-lon). A _meta file (with a _meta.hdr) is also created when a geocoding of more of one file is performed. If the _meta file is opened in ENVI it is possible to browse and display all the geocoded acquisition as if these were different bands. 50

51 Figure 54:.kml file of the VH Geocoded image opened in Google Earth. If you see black border around your image you probably have the Generate Quick Look set to TIFF. Please change it to PNG (see proper instructions at page 21) and perform the process again. Batch Processing Batch processing allows performing several checks and editing actions in a previously stored processing sequence. A "Store Batch" function is available in each processing panel. In addition, if the user has more than 1 licenses available, this function allows two or more processing runs to be carried out at the same time as each run creates a different working directory. Create Batch File A Batch File Name has to be entered in the SARscape preferences (see SARscape preferences section). Store batch All the SARscape processing panels show a store batch button. By pressing it, SARscape stores all the input/output files, variables and panel parameters to a Batch Step. A popup will display the step numbers. Batch Browser Clicking on the Batch Browser, SARscape will open the batch file located in the batch path (see SARscape preferences) and the Batch browser Window is shown. Once the Batch Processing is started, the steps are performed top to bottom. The Ignore Errors and Continue Batch flag allows the process to skip possible errors 51

52 and continue with the execution of subsequent steps. In case of error, no error message will be shown. If this flag is not selected, the process will stop at the first error and an error message will be shown. Batch Steps [1] and [2] Parameters of the selected topic (Coregistration in step [1] in this case) Control buttons Figure 55: Batch browser window with the list of the steps on the left, the parameters on the right and control buttons on the bottom-right corner. Control buttons for the batch browser are located in the bottom right corner of the batch browser window: : Saves the current batch processing chain : Opens a batch file (.sav) : Runs the current batch processing chain : Resets the current Batch Session : Opens the batch processing Help Run batch Before runing a batch processing, check that only the steps that are intended to be processed are activated. Active steps are shown by a white square with green border, whereas inactive steps are shown by a red square. To switch from active to inactive (and vice versa): right mouse click on the step and then select on/off (Figure 56). By selecting delete the step will be deleted and will not be loaded again. 52

53 Figure 56: Context menu after right click on a Batch step. Once all the needed steps are selected, click the button to run the batch process (third control button from the left). This will create a new working directory inside the actual working directory. If the different steps are dependent one to another, then it is suggested to uncheck the Ignore Errors and Continue Batch flag. If, instead, the steps are independent, then it is suggested to check this flag, so that if an error occurs, the other steps can be executed anyway. Note Note it is not possible to store a batch step while the batch browser window is open. It is also not possible to open more than one batch browser window at time. When a batch processing chain is started, a folder in the SARscape working directory is created. This folder contains the Process.log and Process.trace files. Modify a step To modify a step, click on the plus symbol near the step name: all the parameters set will be shown with a symbol. Clicking on each parameter set will show all the parameters that can be modified. Note Press enter on the keyboard after each change to the batch parameters in order to ensure that the changes take place. Batch Chain If the filename of each output is known, it is possible provide these as inputs to subsequent steps. This allows creating a chain where each output is the input of the following step. In this way, it is possible to build a long processing chain and let it run over night or weekends. This is useful in case of very large datasets or heavy processing, as well as when the same needs to be rerun using different parameters. In Figure 57 and Figure 58, is an example of processing chain that connects together the processing performed in the exercises above. Note: It is important that the filename of the output is correctly known. If not, the subsequent step will not find the input files and the whole chain will crash. Please also note that if the Sentinel Import (or any other import) has the Rename The File Using Parameters check set to true, the input file of the subsequent step has to be exactly the name that SARscape will give when automatically renaming the output. If this cannot be foreseen, the import step can be separated from the other steps. 53

54 The _cut_pwr_geo Tip: For a processing chain containing several steps, it is possible to create a batch file where you simply have to change the input of the first step and the output of the last step. The filenames of the internal steps can be always the same and used only to connect the different process (such as output_1 and so on). An improved version, using IDL scripting, can be found in SARscape IDL scripting>examples>interferometry using sav where an example is shown and described. DEM Extraction [2] _dem _cut_pwr.shp manifest.safe Import [1] _slc_list Multilooking [3] _pwr Sample Selection [4] Geocoding [5] Figure 57: Workflow of the processing chain. The number in the square brackets is the one assigned to the batch step as shown in Figure 58. Figure 58: Batch Browser Window showing the five steps leading from import to geocoding. Note: in this example, the Ignore Errors and Continue Batch check is unchecked. Each process is dependent of the previous one, so in this case it makes no sense to continue the batch in case of errors. Please also note that the DEM extraction step is set to OFF as once the DEM is downloaded it is not needed to download each time. If the processed data covers another region then this step has to be activated again. Parallel Batch Processing After a batch processing is started, it is possible to change the working directory and the batch name in the SARscape preferences/directories, create another batch processing chain and run it in parallel. It is also possible to set a different OpenCL device for each working directory by selecting it in the SARscape preferences General Parameters and thus run different processes on different OpenCL devices at the same time. 54

55 Tip Note Note This functionality is useful in order to prepare several parallel processes that can be run for instance over night or over weekends without the need of operator intervention. Before starting a new batch processing, make sure to close the batch browser window. It is not recommended to launch several parallel batch processing on low performance computers, since parallel processes will anyhow use shared resources (CPUs, GPUs and RAM)..Log,.Trace and Error report In the SARscape Administration Folder it is possible to view a Log (Process.log) and a Trace (Process.trace) file. The Log file shows all the processing related information. Since the information is continuously appended the Log file, and not deleted after every processing run, this file can become very large unless its content is removed from time to time using the delete button. The Trace file instead shows detailed information about the latest process executed. This file is overwritten any time a new process is launched. The Process.log file and the Process.trace file are located in the working directory set in SARscape preferences (page 10). It is also possible to save an error report by clicking on save error report. The output.txt file store all the error relevant information. Once an error is reported, the program automatically initiates a procedure to save the "Error Report". This functionality can also be used to store the processing information (Log + Trace files), which are relevant to the last step executed. Note Note When saving the "Error Report" be sure that other SARscape processes have not been executed. The problem giving the problem has to be the last process run before creating the error report. The "Error Report" has to be sent to your distributor for a further investigation and solution of the problem. If the process is launched from the Batch Browser, the Process.log file and the Process.trace file are located inside a folder created in the working directory. The name of the folder contains the date and the time when the batch process was launched. When a new batch is launched, a new folder is created and the Process.log and the Process.trace files are not overwritten. Clean Working Directory The Clean Working Directory tool, found in the Administrator folder (Figure 59) will delete the current working directory. A pop-up will appear asking if you want to delete the forking directory located at the given address. In case folders were stored in the working directory (e.g. SRTM_DEM_DIR, GTOPO30_DIR, etc.), they are not removed. Note This action is irreversible. 55

56 Figure 59 Clean Working Directory tool in ENVI s toolbox. About SARscape By clicking on the About SARscape (Figure 60) a pop-up will appear (Figure 61) showing information about the current SARscape version as well as the version ID (and eventually the date of the installed patch if present). If a problem occurs, please provide the full version ID to the sarmap team. In addition, make sure with your SARscape distributor that you are using the latest version with the latest patch available. Figure 60: About SARscape in ENVI s toolbox. 56

57 7 Figure 61: About SARscape pop up showing SARscape s version ID and other information. 57