MARS v Release Notes Revised: May 23, 2018 (Builds and )

Transcription

1 MARS v Release Notes Revised: May 23, 2018 (Builds and ) Contents New Features:... 2 Enhancements:... 6 List of Bug Fixes

2 New Features: LAS Up-Conversion prompts for non-compliant data Beginning with this version of MARS, LAS files to be loaded in the Table of Contents or pathed out in any of the tools that can process non-loaded data must be in a compatible LAS 1.4 version. The minimum requirements are: LAS v1.4 with a Point Data Record Format (PDRF) of 6, 7, or 8; 16-bit (native or normalized) Intensity values; 16-bit (native or normalized) RGB(N) values, if the PDRF is 7 or 8 and values are present; Coordinate Reference System information written as WKT (Well-Known Text) if present; and all variable length records stored as EVLRs (Extended Variable Length Records). The only exception to these requirements is when running the USGS 1.0 QC Module, which can test older version (LAS v1.0 through LAS v1.3) data. When loading non-compliant data, or when running a tool with non-compliant data pathed out, one of three prompts will appear depending on the status of the LAS files: 2

3 More details on LAS file requirements and the up-conversion process are in the Help Topic Tab and Ribbon Layout Project/Data Preparation Add LAS Files. LAS Up-Conversion tool If LAS data is known to be non-compliant, it can be up-converted before attempting to load it or run a tool that does not require the data to be loaded. The LAS Up-Conversion tool (on the Tools tab) can convert the data in its original folder (overwrite) or write the up-converted files to a user-specified folder, leaving the original files unmodified. As part of the up-conversion process, existing bit flags for Synthetic points, Model Key-points, and/or Withheld points can be carried over, or discrete classes holding any of these types of points (plus an Overlap class) can be converted to bit flags with an option to then re-class the points. Also, Coordinate Reference System (CRS) information can be written to the up-converted LAS files as WKT tags. 3

4 LAS Version Converter tool This tool, found on the Tools tab, allows back-conversion to older LAS versions or LAS v1.4 with legacy PDRFs of 1 or 3. These older versions of LAS files may be required for certain software packages. Note that the back-converted files will no longer be MARS -compliant. The tool is a modified version of LAS Export, with options for converting bit flags into discrete classes and reverting from Adjusted GPS Time to GPS Seconds of the Week. Quick Classifications batch filtering A new method for batch filtering ground (and, optionally, buildings and high vegetation) called Quick Classifications is now available. It uses part of the LAStools suite from rapidlasso GmbH and requires a separate license file to use in any kind of commercial or production environment. Merrick & Company does not sell the license it must be purchased directly from rapidlasso GmbH. 4

5 More details on Quick Classifications are in the Help Topic Data Classification (Manual & Batch) Quick Classifications. One-step Ground Filter implemented A new one-step Ground Filter has been added to the list of discrete filters. The filter uses algorithms from the LAStools suite (rapidlasso GmbH) and requires the same license needed for the Quick Classifications tool (above). It is designed to work exclusively with the Filter Region interactive tool to make real-time changes to loaded LAS data. Google Earth following tool added A new tool on the Navigation tab Link to Google Earth will open Google Earth or Google Earth Pro (if installed) in a separate window and follow along with zooming and panning operations that are being done in the LAS Map View window in MARS. Optional Custom Tab can be added to the ribbon 5

6 An optional Custom tab, containing a user-specified set of tools, can now be added to the main ribbon, and can optionally be made permanent. Nearly every tool from all tabs except File and Help can be placed on the Custom tab in any order, and the tab itself can be hidden from view if necessary. This option can reduce tab-switching significantly in all workflows. Auto-pan edge markers implemented for breakline New auto-pan edge markers can be toggled on/off to indicate the area around the edges of the LAS Map View Window where auto-panning (when enabled) will occur when the cursor is moved into it. The Show Auto Pan Edge Markers button Production license. is found on the Breaklines tab; therefore, the markers are available to turn on only with a Convert Check Points CSV to 3D Shapefile tool In addition to CSV-format check points files, a 3D point shapefile can now be used to run the Check Point Report or as input to tests DPH-11.2 and DPH-11.3 of the USGS NGP Version 1.2 QC Module. The Convert Check Points CSV to 3D Shapefile tool, found on the Vector Creation tab, will convert a properly-formatted CSV file to a 3D point shapefile of check points (with Coordinate Reference System information included) that is easier to view and analyze in GIS software. Enhancements: Improved loading and navigation speed due to new spatial indexing algorithms Spatial Indexing has been improved, resulting in a significantly faster LAS loading and navigation (pan/zoom) experience. File size has also been reduced, due to a decrease in the number of spatial index records needed. For best stability and faster performance, LAS files that have been spatially indexed in an older version (v or earlier) should be re-indexed using this version of MARS. This can be done quickly in a batch mode with two steps using the multi-threaded 'Add Spatial Index' tool process the files with the 'Fast Remove Index' option immediately followed by the 'Add Spatial Index' option. See the MARS Tools Data Utilities Add Spatial Index topic in the help file for more information. If there is any doubt about the spatial indexing status of LAS files, this procedure is recommended. Also note that issues may occur with LAS files if they are spatially indexed in a newer version of MARS and then have their index records removed in an older version. MARS Explorer QC can use all threads for all multi-threaded functions The MARS Explorer QC license can now use all available threads (as determined by the computer s hardware) for any multi-threaded functions, compared with a previous limit of four threads for all non-qc Module functions. 6

7 MARS Explorer Evaluation allows up to 1 GB of LAS data to be loaded The 30-day Evaluation version of MARS Explorer now allows up to 1 GB of LAS data to be loaded at any one time, up from the previous 300 MB limit. LAS file extents stored in an EVLR to improve performance If not already present, a file boundary (extent) record will be created and stored as an EVLR when an LAS file is indexed either manually with the Add Spatial Index tool or as part of another file operation such as Export. This record can be exported as a polygon shapefile when the file is loaded in the Table of Contents, if needed for analysis. Several changes and a new name for RGB Component Filter The RGB Component Filter has been renamed to RGBNI Value Filter. In addition to using Red, Green, and Blue point or pixel values for determining points for reclassification, the filter now allows Near Infrared ( N ) and Intensity ( I ) values to also be used in the filtering process. The filter options interface has been simplified for a better user experience. Please see the Help Topic Data Classification (Manual & Batch) Filter Action RGBNI Value Filter for complete details. Additional column added to Check Point Report table A column labeled Comments has been added to the Check Point Report table that can hold free-form information about any or all check points. This column will display any comments added to a check points shapefile used for the report, after it has been generated from a check points CSV file. These comments are informational only, and have no effect on running the Check Point Report or in using the check points as an input to the USGS NGP Version 1.2 drop-down of the QC Module. Check Point Report auto-detects Lat/Long data and makes appropriate modifications When running the Check Point Report, Lat/Long (Geographic) LAS data is automatically detected and modifications are made to the tool options and the reporting. Closest Point is disabled as an Elevation Calculation Method when starting the tool, and Grid is disabled as an Elevation Calculation Method option when the reporting interface opens. In addition, no calculations are performed or reported on for DEM in the Standards section of the reporting interface. Grid-based exports use new boundary detection algorithm Export types that display the Grid tab (e.g., Grid Float Grid or Grid TIFF ) now use a new boundary detection algorithm based on the input LAS data type. The detection method varies depending on whether the input data is in 'Swath' or 'Tile' (the default) format. Swath data is assumed to have only one Point Source ID (PSID), also called collection scan number, per file, and adjacent swaths will overlap each other. Tile data may have one or more PSIDs per file, and adjacent tiles will not have any overlap. 7

8 Change to USGS 1.2 QC Module test DPH-11.2 In the USGS NGP Version 1.2 drop-down of the QC Module, test DPH-11.2 (Check Points), the screen capture of CSV-based check points will be limited to only those points that fall within the Defined Project Boundary (DPA). Check Point Report auto-calculates GSD to set the Search Radius value When running a Check Point Report, the Ground Sample Distance (GSD) of the loaded LAS data is automatically calculated and the Search Radius used to build a TIN surrounding each check point is set to 3x that GSD value by default. New manual panning option during breakline compilation During breakline compilation, an alternative method of manual panning is to press and hold the scroll wheel button (on most mice) while moving the mouse. This pauses the creation of line vertices until the button is released. Wording and default changes for LiDAR Calibration Checks tool The LiDAR Workflow QC 1 LiDAR Data Checks drop-down of the QC Module now defaults to test CC3 being enabled, and the test description has been modified. Multi-channel LAS data is now auto-detected if not present, test CC3 is ignored. Change LAS Date tool interface simplified On the interface for the Change LAS Date tool, the unnecessary checkbox labeled Change File Year and Julian Day has been removed. The tool s specific purpose is to make those changes based on an entered File Creation Date. Status bar indicator implemented for Auto Pan function When compiling breaklines, an indicator appears in the Status Bar area to show whether the Auto Pan function is enabled. Class 0 used for all points exported using the Grid LAS export type 8

9 To more properly describe the exported points when using the Grid LAS export type, they will be assigned Class 0 with their Synthetic bit flag set to On. Additional information tabulated for USGS 1.2 QC Module test DPH-14 A column reporting on Withheld point counts ( WH ) for all classes has been added to the table in the USGS NGP Version 1.2 drop-down of the QC Module, test DPH-14 (Point Classification). Table legend enhanced for USGS 1.2 QC Module test DPH-14 In the USGS NGP Version 1.2 drop-down of the QC Module, test DPH-14 (Point Classification), the legend below the point count table has been enhanced as shown below: Bit Flag counts added to the results of Statistics by Area tool The counts for points with the following bit flags set Synthetic, Model Key-point, Withheld, Overlap, and Edge of Collection Scan -will now be shown at the bottom of the results window for the Statistics by Area tool. 9

10 LiDAR Data Checks and LiDAR Calibration Checks tools default to Meter for Horizontal and Vertical Data Units The Input tabs of both the LiDAR Workflow QC 1 LiDAR Data Checks and LiDAR Workflow QC 2 LiDAR Calibration Checks tools in the QC Module drop-down list now default to Meter for the Horizontal and Vertical Data Units. Bit Flag Display Settings tool allows settings to be saved The Bit Flag Display Settings tool (found on the View tab) has a new button labeled Make Defaults that saves the bit flag viewing status for future MARS sessions. Three new error codes added to statistics reporting for the QC Module In the USGS NGP Version 1.2 drop-down of the QC Module, test DPH-1.1 has three new WKT error codes for when vertical CRS information is present: 11 for missing Vertical Datum and/or EPSG code; 12 for missing Vertical Units and/or EPSG code; and 13 for missing Vertical Coordinate System name and/or EPSG code. 10

11 Individual channel data can be reused when running subsequent instances of LiDAR Calibration Checks tool with multi-channel data If re-running the LiDAR Workflow QC 2 LiDAR Calibration Checks tool in the QC Module on multi-channel data and using the Skip mode, previously created LAS files for individual channels can be reused to save time. Inspect and Measure tools added to Cross-Section/Profile toolbar To help cut down on tab-switching, the Inspect and Measure tools have been added to the optional Cross- Section/Profile Window toolbar. List of available Text File Format fields in Convert tool expanded Near Infrared and Scan Angle have been added to the list of available fields when converting a text-based XYZ file to an LAS file. The older Scan Angle Rank is maintained for clarity, and the conversion process will accept either Scan Angle or Scan Angle Rank and calculate the other as long as the input values are in the correct format for the field being used. In addition, the AGC field has been renamed to User Data. Record Format section of Layout tab in Export includes new fields When exporting to the PLS-CADD Code ASCII, Shapefile, or Text ASCII types, there are now two additional fields that may be selected Near Infrared and Scan Angle. In addition, the AGC field has been renamed to User Data. Inspect RGB tool renamed to Inspect RGB(N) to accommodate 4-band imagery The Inspect RGB tool has been enhanced and given a new name Inspect RGB(N) report on 4-band, as well as 3-band, imagery. to accommodate and Set Overlap Bit Flag tool interface simplified The Group Multi Channel control has been removed from the Set Overlap Bit Flag tool interface. Individual channel LAS files must be merged into a single swath containing all points from all channels before this tool is used (see the LAS Merging tool on the Tools tab). Collection Scan Polygon Generator tool creates a PRJ file when Coordinate Reference System info is known A PRJ file will be created for the shapefile produced by the Collection Scan Polygon Generator tool when the CRS information is known for the input LAS files. 11

12 Filters tab options changed for FSR export type For the Flightline Separation JPEG 2000 export type, the Overlap bit flag box is checked on and disabled from modification on the Filters tab of export. Status of TIN checkboxes saved when using Make Default or Save Settings buttons for Breakline Properties The status of the TIN checkboxes on the Breakline Properties interface is now stored when using the Make Defaults or Save Settings to File buttons. Color legend added to test DC4 of the Data Checks tool in the QC Module For the LiDAR Workflow QC 1 LiDAR Data Checks drop-down option of the QC Module, test DC4 LiDAR Point Density Float Grid creation now includes a color legend below the graphic to aid in interpreting the results. An example for projects in feet is shown below. Wording change for Flightline Separation Raster (FSR) table in the QC Module For the USGS NGP Version 1.2, test DPH , and the LiDAR Workflow QC 2 LiDAR Calibration Checks, test CC1, the tables of RMSDz values that are created in the final PDF reports now use the more correct label Aggregate for the overall project values rather than Total. Multiple shortcut key enhancements implemented There are several shortcut key changes and additions: In the LAS Map View window - V toggles on/off the auto-pan edge markers (see Auto-pan edge markers implemented for breakline in the New Features section, above); W activates the Place Adjustable Cross-Section Line tool; E activates the Filter Region tool. In both the LAS Map View and Cross-Section/Profile windows Q activates the Pan tool; Ctrl-K to display only Model Key-points (Class 2 with MKP bit flag set to On ); Ctrl-J to color points or TIN by RGB values. 12

13 Elevation rendering color ramp changed When using the Rendering Option Color by Elevation with either the Rescale (default) or Throughout options, the color ramp has been modified so that magenta represents the lowest elevations and white represents the highest. Text file generated in output folder when KMLs cannot be produced in the QC Module For the USGS NGP Version 1.2 and the LiDAR Workflow QC 1 LiDAR Data Checks drop-down options of the QC Module, when any tests that offer a KML file creation option cannot produce one due to the data straddling two or more projection zone boundaries, an explanatory text file will be created in the output folder of each affected test. This text file will be accessible from a link in the final PDF reports. List of Bug Fixes: Bug fixed causing preventing the Cancel button from working for the LAS Merging tool. Bug fixed causing the Virtual Contours Toggle On/Off button to fail when placed on the Quick Access Toolbar. Bug fixed preventing a Target Class value of 26 or higher to fail for the Plane Analysis Filter when it is part of a macro script XML. Bug fixed in Change Bit Flag Options tool causing incorrect checkbox status when the interface is closed and reopened. Bug fixed causing a crash when running the LiDAR Workflow QC 2 LiDAR Calibration Checks tool test CC1 with a project boundary shapefile that has more than one polygon. Bug fixed preventing some LAS files in Geographic (Lat/Long) coordinates from loading. Bug fixed causing project files (MPD) to fail to open if last saved with TIN rendering active. Bug fixed causing Edit Selected Set changes to override the From class settings on the Edit/Filter and Cross- Section/Profile tabs. Bug fixed causing one LAS file to still be visible when all LAS layer entry boxes are unchecked. Bug fixed in Export causing Grid Float Grid type to create Auto Virtual Tile artifacts in the rasters when the Layout is set to Selected Tile(s). Bug fixed causing Remove Duplicates tool to not remove some of the duplicate points. Bug fixed causing I (Inspect) shortcut key to fail in a Cross-Section/Profile window. Bug fixed causing some tools to fail when used in a floated (undocked) Cross-Section/Profile Window. Bug fixed in multiple tests of USGS NGP Version 1.2 tool causing Withheld flagged points to be incorrectly included in testing and reported results. Bug fixed in multiple tests of LiDAR Workflow QC 2 LiDAR Calibration Checks tool causing Withheld flagged points to be incorrectly included in testing and reported results. Bug fixed in Export causing the Flightline Separation JPEG 2000 raster type to produce Regular FSRs when the Measurable RMSDz option is checked and the Layout is set to Selected Tile(s). Bug fixed in Check Point Report tool causing Withheld flagged points to be incorrectly included. Bug fixed in multiple tests of LiDAR Workflow QC 1 LiDAR Data Checks tool causing Withheld flagged points to be incorrectly included in testing and reported results. Bug fixed causing the Reassign to new class option to not be honored when using the Clear Bit Flags tool. Bug fixed when trying to run USGS NGP Version 1.2 tests DPH-11.3 without a project boundary shapefile. Bug fixed when trying to run USGS NGP Version 1.2 tests C-7 with only tiled data. 13

14 Bug fixed when trying to run USGS NGP Version 1.2 tests C-5, DPH-7, DPH-8, DPH , or DPH-12 without input swath data. Bug fixed when trying to run USGS NGP Version 1.2 test DPH-11.2 without an input check points file. 14