Overview of Major Steps 1. Subse ng one to a few plots. 2. Subse ng many plots using Fusion command line executables

Transcription

1 E 3: E P S Exercise Objec ves There are two parts to this exercise. Part 1 describes the manual process to extract fixed radius subsets of LIDAR data; Part 2 explains how to efficiently extract large numbers of subsets. Prerequisites Successful comple on of Exercises 1 2. Overview of Major Steps 1. Subse ng one to a few plots. 2. Subse ng many plots using Fusion command line executables and batch files. Exercise 3 page 1 Fusion Exercise 2

2 1. Subse ng one to a few plots E 3: E P S Document Updated: August 2012 FUSION v3.01 Background/ Ini al State: You should have FUSION up and running with the Orthophoto_4800k.jpg image file displayed and the lda_4800k_data.lda raw data file loaded (but not displayed). We have coordinates of the center points of three plots these have been converted to a shapefile (going through an event theme in ArcGIS). This point shapefile (three_plots.shp) is not part of the original example dataset so you will have to download it from the online tutorial. a. Let s begin by loading this shapefile as a POI (Point of Interest) in Fusion: 1. Unzip the POI file. 2. Click the POI bu on. 3. Navigate to the loca on of the three_plots.shp shape file. 4. Select the file and click Open. 5. Change the a ributes (color and size) of the POI if desired (see top right graphic) and click OK. The three plot loca ons will display over the orthophoto. If you ve already loaded the bare earth surface for this project area, skip to step Click the Bare earth bu on. 7. Navigate to and select 4800K_ground_surface.dtm. 8. Click Open. 9. Accept all of the surface model default op ons and click OK. Topo lines represen ng the ground surface eleva ons will display over the orthophoto image. b. Now, we only want to select the lidar data within our plots rather than the en re lidar data set. Click the Sample op ons bu on (see right graphic) and select the following op ons: 1. Sample shape: Fixed circle. 2. Sample Size: 120 (diameter in feet) Note: in future projects make sure the units of the data and the plot are the same, if the data are in UTM meters, convert the plot diameter to meters as well. 3. Op ons: Snap sample points to nearest POI point. 4. Op ons: Subtract ground eleva on from each return. 5. Click OK at the bo om le to accept the sample se ngs. Change the a ributes (color and size) of the POI if required and click OK. Sample op ons for extrac ng fixed radius subsets. Exercise 3 page 2

3 E 3: E P S c. Next, within the Fusion display window, click on one of the plot loca ons (note which one you select). The POI changes color and an LDV window pops up showing the lidar points within the 120 meter diameter circle around the plot center. These lidar data points are simultaneously wri en to three temporary files named tempdat with three different extensions (.lda,.lgd,.xyz) in the user s temporary folder (e.g. C:\documents and se ngs\user name\local se ngs\temp) as in the figure below. Poten ally you could locate and rename the 3 temporary files with a corresponding plot iden fier: ex Plot1.* and move them into a working directory. You would then have a subset (for each plot) of lidar data. It is good to be aware that FUSION writes these temp files and deletes them when FUSION closes (if you want the temp files make sure you move and rename them!) In the next sec on we will work through a process that will allow you to automate the subse ng of many plots and subsequently calculate sta s cs for each plot. 2. Dealing with many plots Subse ng the LIDAR points for a substan al amount of plots can best be done from the DOS command line, using FUSION s command line executable (clipdata.exe) either one plot at a me or preferably within a batch process. Alterna vely, you could use MS Excel to create large batch files. The advantage of crea ng such a file in a spreadsheet is the capability to generate a series of incremented field entries and to be able to concatenate several fields into a single text string (this technique can save you a lot of me if you are trying to analyze 200 plots!). Please refer to Appendix 1 (at the end of this chapter) if you are interested in learning more about crea ng batch files in a spreadsheet environment. Before you go on to run the clipdata command, it s cri cal that you have a sound understanding of why and how to use the DOS command prompt and batch files to run Fusion u li es. If you aren t proficient with the basic skills needed to work in the DOS environment, you won t be able to efficiently handle Fusion projects. Exercise 3 page 3

4 E 3: E P S The following are some important facts and ps for using the FUSION commands: The FUSION command line u li es and processing programs are collec vely referred to as the FUSION LIDAR Toolkit or FUSION LTK. First of all, you must know which Fusion u li es will give you the most useful informa on for your project. To study Fusion u li es, click the Fusion Manual shortcut. Page 16 provides an introduc on to using command line u li es and pages give an overview of all Fusion u li es and processing programs. The more you understand the capabili es of the FUSION commands, the more efficient you will be at extrac ng useful informa on from lidar data. You will need to understand each command line u lity enough to customize it for your data by manipula ng the parameters and switches. The defaults will usually produce poor results! The FUSION LTK programs are designed to run from a command prompt or using batch files. There is no friendly GUI available! Remember to follow these three guidelines as you work in DOS: Good file organiza on make sure your folders are organized and named in a simple and intui ve manner. Correct Syntax take your me and check before you run. Incorrect syntax can overwrite and delete your input file!!! Directory naviga on call the correct directory. A good file structure and proper syntax will make this much easier. Most of FUSION s command line *.exe files can be batched to facilitate/automate repeve data processing steps from the DOS prompt. A batch file (see graphic below) is simply a text file containing a separate line for each DOS command or each me the command should be executed. These files can be created with a text editor or any other program that can save the output as a text file (i.e. Notepad or Excel). They are easy to edit and improve efficiency for large projects. The extension of the file has to be.bat to let DOS know it has to process every line consecu vely. Running the batch file is easy simply navigate to the directory containing the batch file in the command prompt and type the name of the batch file. a. Now that you have some background info on DOS and batch files, let s explore the Clipdata command. 1. Let s start by ini ally exploring the Clipdata command. 2. For the complete syntax, click the DOS prompt shortcut and type in clipdata. 3. Refer to the ClipData sec on of the Fusion manual for more info. b. Now that you are familar with the clipdata command, let s dissect an example of the syntax below: where: DOS p: You can use the up and down arrows to recall previous commands executed in the same command prompt window. This is very useful when you mess up the syntax and only need to change a character or two. You can edit the commands by moving the cursor with le and right arrows and using the insert key to control insert/overstrike clipdata /shape:1 /dtm:c:\lidar\sampledata\4800k_ground_surface.dtm /height c:\lidar\sampledata\lda_4800k_data.lda c:\lidar\sampledata\clipplot1.lda Exercise 3 page 4

5 E 3: E P S clipdata is the FUSION executable command /shape:1 denotes a circular shape. /dtm:c:\lidar\sampledata\4800k_ground_surface.dtm denotes the bare earth surface model used to normalize the LIDAR. data (substract the bare earth surface eleva on from each lidar point eleva on). REMEMBER!: make sure that you use /height is used in conjunc on with the specified dtm to convert all eleva on the proper slashes. Forward slashes values to height above ground. ( / ) for switches and back slashes ( \ ) c:\lidar\sampledata\lda_4800k_data.lda specifies the input data file. for file paths. Bad things can happen if you use the wrong slash! Also remember to place c:\lidar\sampledata\clipplot1.lda defines the output (sample) data file. a single space between all commands, The last four numbers are geo coordinates that define the bounding box of the switches, and file paths. circular shape. c. Click the Notepad shortcut and start your clipplots batch file. 1. The syntax should look similar to: 2. In the C:\Fusion folder create a new folder called batch. 3. Save the batch file as clipplots.bat (the.bat extension tells DOS to process each line consecu vely) in c:\fusion\batch. 4. Navigate to your batch folder in DOS by typing: cd c:\fusion\batch (cd tells DOS to change directory) 5. Type in clipplots to run the command. An easy way to avoid typos when entering file paths is to navigate to the file in windows explorer and then copy and paste the path into your batch file from the address line. 6. Navigate to the output folder directory (c:\lidar\sampledata) and verify that the files clipplot1.lda, clipplot2.lda and clipplot3.lda were created. d. Let s look at the plot data in Fusion. 1. Ensure that the Image File (Orthophoto_4800k.jpg) and that the three POI s from Part 1 of this exercise are loaded and visible. 2. Click the Raw data bu on in the Fusion window. 3. If the file lda_4800k_data.lda is s ll loaded, click the Delete bu on to remove it. 4. Click the Add File bu on. Exercise 3 page 5

6 E 3: E P S 5. Navigate to and select clipplot1.lda. 6. Hold the shi key down and select the last file, clipplot3.lda, to select all three lidar plot subset files. 7. Click the Open bu on. 8. Give each data file a different color and change the Symbology. Select one of the rows (each row is a data file) in the Data Files dialog and for each selected row: 9. Click the Proper es bu on (or double click the item). 10. Change the Symbol to Single Pixel. 11. Change the line color to a dis nct color. 12. Click OK. 13. Click the check box next to the Raw data bu on to display the three lidar subsets. Your results should be similar to the figure on right. 14. In your Sample op ons dialog ensure that you have selected a Stroked box sample shape and click OK. 15. Now, drag a sample over one of the plots and the lidar subset will display in the LDV, as in the bo om right graphic. Plot subsets clipped using the clipdata command. Red = Plot1, Blue = Plot2, Green = Plot 3 Plot 3 displayed in the LDV. End of Exercise 3 Exercise 3 page 6

7 A 1: U MS E C B F 1. Create an Excel spreadsheet a. We will use Excel to create the batch file for this exercise. The advantage of crea ng such a file in a spreadsheet is the facility to generate series of incremented field entries and to be able to concatenate several fields into a single text string. We re only extrac ng LIDAR subsets for three plots in order to keep this exercise rela vely quick and manageable. However, the real value of this batching process will only become obvious when you want to extract a large number of LIDAR subsets. The three plot centers (made up for the sake of this exercise) have the following loca ons (Xc, Yc in the same units and coordinate system as the lidar data) and they have a diameter (D) of 120 meters shown below in the table: Xc Yc D Click Start Programs Microso Office Microso Excel 2. Name the first Worksheet tab boxcalc (see graphic below). 3. Create column headings labeled: PlotID, Xc, Yc, D, r, xmin, ymin, xmax, and ymax. 4. PlotID Column: Enter a plot iden fier (e.g. plot1, plot2 plotn) for each plot, 5. Xc and Yc Columns: Enter the three plot center loca ons (from the above table), 6. D Column: Enter the plot diameter, 7. R column: calculate r = D/2, 8. Calculate the x min, y min, x max and y max by either subtrac ng or adding the radius to the x,y of the plot center: Xmin = Xc r Ymin = Yc r Xmax = Xc + r Do Not use ID as the first column heading If you save the spreadsheet as a CSV file, Excel sees the label ID and assumes a specific format (SYLK file) and will tell you it can t load the file. Using something like PlotID works be er. Worksheet name Ymax = Yc + r b. A er calcula ng these numbers the spreadsheet will resemble the above graphic. These numbers create the bounding box of the subset of the data. For this small number of plots, it would likely be most convenient to con nue working within this worksheet, however, for large datasets you should generate the full syntax on the next worksheet let s do that for this exercise. 1. Name the second worksheet batcomp. 2. Create column headings labeled: Command, Input File, and Output File. 3. Command Column: this contains the path to and name of the fusion command line executable in this case clipdata. 4. Input File Column: contains the path and name of the lidar data set. This example contains only one file from which data will be subset Appendix 1 page 7

8 A 1: U MS E C B F (lda_4800k_data.lda) but more can be used as required. 5. Output File Column: contains the path and filename of the output file (the plot subsets). They were built by concatena ng the path, the plot id listed in the boxcalc worksheet and the extension of the file: =CONCATENATE("c:\lidar\SampleData\clip",boxcalc!A2,".lda") thus the output files will be named clipplot1.lda, clipplot2.lda and clipplot3.lda. 6. The values in the next four columns are the column headings and min and max values for the bounding box copied from the boxcalc worksheet. 7. Referencing a cell from another worksheet in the same spreadsheet is done by adding the name of the worksheet followed by an exclama on mark: ex: =boxcalc!f2 8. The final column will be labeled Full Syntax which will be a concatena on of all of the previous columns and the inser on of the / shape:1 switch =CONCATENATE(A2," /shape:1 ",B2," ",C2," ",D2," ",E2," ",F2," ",G2) Thus the results for the first row of the Full Syntax Column should look like:..\clipdata /shape:1 c:\lidar\sampledata\lda_4800k_data.lda c:\lidar\sampledata\clipplot1.lda And the batcomp worksheet should look like: 9. Next, copy Column H (the Full Syntax Column) and paste its values (Paste Special Values) in another worksheet named bat: Note: The spreadsheets shown in this document have different path names than the ones we recommend. 10. Save your Excel spreadsheet (any name and loca on that makes sense to you) but don t close the spreadsheet. 11. Save the bat worksheet as a text file named clipplots1.bat in your batch file directory. 12. Type clipplots1 in the command prompt and hit enter to let it run. Appendix 1 page 8

9 A 1: U MS E C B F 13. Using Windows Explorer, navigate to the output folder directory (c:\lidar\sampledata) and verify that the files clipplot1.lda, clipplot2.lda and clipplot3.lda were created. c. Let s look at the plot data in Fusion. 1. Ensure that the Image File (Orthophoto_4800k.jpg) and that the three POI s from Part 1 of this exercise are loaded and visible. 2. Click the Raw data bu on 3. If the file lda_4800k_data.lda is s ll loaded click the Delete bu on to remove it. 4. Select clipplot1.lda. 5. Hold the shi key down and select the last file (clipplot3.lda) to select all three lidar plot subset files. 6. Click the Open bu on. 7. Give each data file a different color and change the Symbology. Select one of the rows (each row is a data file) in the Data Files dialog and for each selected row: Click the Proper es bu on (or double click the item) Change the Symbol to Single Pixel. Change the line color to a dis nct color. Click OK. 8. Click the check box next to the Raw data bu on to display the three lidar subsets. Your results should be similar to the graphic below: Appendix 1 page 9