NetVault : SmartDisk. Administrator s Guide. version 1.2 NSD EN-01 08/19/10

Transcription

1 NetVault : SmartDisk version 1.2 Administrator s Guide NSD EN-01 08/19/10

2 Copyrights NetVault: SmartDisk Administrator s Guide Software Copyright 2010 BakBone Software Documentation Copyright 2010 BakBone Software This software product is copyrighted and all rights are reserved. The distribution and sale of this product are intended for the use of the original purchaser only per the terms of the License Agreement. All other product trademarks are the property of their respective owners. The NetVault: SmartDisk Administrator s Guide is copyrighted and all rights are reserved. This document may not, in whole or part, be copied, photocopied, reproduced, translated, reduced or transferred to any electronic medium or machine-readable form without prior consent in writing from BakBone Software. THIS PUBLICATION IS PROVIDED AS IS WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON- INFRINGEMENT. THIS PUBLICATION COULD INCLUDE TECHNICAL INACCURACIES OR TYPOGRAPHICAL ERRORS. CHANGES ARE PERIODICALLY ADDED TO THE INFORMATION HEREIN; THESE CHANGES WILL BE INCORPORATED INTO NEW EDITIONS OF THE PUBLICATION. BAKBONE SOFTWARE MAY MAKE IMPROVEMENTS AND/OR CHANGES IN THE PRODUCT(S) AND/OR THE PROGRAM(S) DESCRIBED IN THIS PUBLICATION AT ANY TIME BakBone, BakBone Software, NetVault, Application Plugin Module, BakBone logo, Integrated Data Protection, SmartDisk, Asempra, and FASTRecover are all trademarks or registered trademarks of BakBone Software, Inc., in the United States and/or in other countries. All other brands, products or service names are or may be trademarks, registered trademarks or service marks of, and used to identify, products or services of their respective owners. BakBone Software 9540 Towne Centre Drive, Suite 100 San Diego, California

3 Table of Contents Chapter 1: Introducing NetVault: SmartDisk 5 NetVault: SmartDisk At a Glance... 5 Key Benefits... 6 Feature List... 7 Target Audience... 7 Recommended Additional Reading... 8 Technical Support...8 Documentation Updates... 8 Chapter 2: Integrating NVSD with NVBU 9 NVBU Integration An Overview... 9 Configuring NVSD Ports for Communication with NVBU Modifying the Messaging Port Modifying the Data Port Enabling or Updating Authentication for WebDAV Access Verifying that the NVBU Client Ports are Open Adding Devices to NVBU Chapter 3: Using the Command Line Interface (CLI) 17 NVSD CLI An Overview Accessing Command Help Processing Basic Shell Commands Determining the Status of NVSD Services Starting NVSD Services Stopping NVSD Services Restarting NVSD Services Viewing NVSD Log Files... 22

4 4 Table of Contents - Dumping NVSD Logs to a File Chapter 4: Configuring NVSD 23 NVSD Configuration An Overview...23 Using the Config Command Options...23 Extending NVSD Storage Pools...26 Examples...28 Chapter 5: Monitoring Performance 31 NVSD Performance Monitoring An Overview...31 Viewing NVSD Statistics Viewing NVSD Statistics in a Terminal Session or Command Prompt Viewing NVSD Statistics in a Browser Reviewing the List of NVSD Statistics Calculating the Deduplication Ratio...37 Calculating the Reduction in the Storage Footprint...37 Chapter 6: Troubleshooting NVSD 39 Windows Installation Succeeds but the Percolator Fails to Connect...39 Backup Stalls While Writing to Media...40

5 NetVault: SmartDisk Administrator s Guide 5 Chapter 1: INTRODUCING NETVAULT: SMARTDISK NetVault: SmartDisk At a Glance Key Benefits Feature List Target Audience Recommended Additional Reading Technical Support Documentation Updates NetVault: SmartDisk At a Glance NetVault: SmartDisk s (NVSD s) disk-based backup and data-deduplication option reduces storage costs with its powerful byte-level, variable-block-based software deduplication, which packs up to 12 times more protected data into the same storage area for a 92% reduction in storage footprint. Hardware costs are reduced by using existing storage infrastructure instead of requiring specific drives or appliances. Seamless integration with NetVault : Backup (NVBU) speeds deployment while simplified ease-of-use reduces the level of storage expertise required to perform deduplicated disk-based backups. To shrink backup windows with no additional impact on protected-server resources, you can schedule NVSD s post-process deduplication option outside the backup window. Integration with NVBU s job-level deduplication and encryption enables users to separate deduplicated data from nondeduplicated data while enabling primary copies to be deduplicated; encryption can be performed only on the secondary copy that is stored off site. With NVSD, administrators have increased choices, including the ability to deploy multiple NVSD Instances to improve load balancing and performance; copy or move data between NVSD Instances, to VTL, or to tape-based devices to place redundant backups in offsite locations for failover and disaster-recovery purposes.

6 6 Chapter 1 Introducing NetVault: SmartDisk Key Benefits Reduces Storage Costs NVSD reduces storage costs with its byte-level, variable-block-based deduplication option. This option packs up to 12 times more protected data into the same storage area with the ability. It accomplishes this by analyzing smaller amounts of data, thereby avoiding the problem that occurs when fixed blocks mask changes and store duplicate data as unique. NVSD is hardware-agnostic and works on most file systems, so hardware costs are reduced by using the existing storage infrastructure instead of requiring you to acquire specific drives or appliances. The ability to add additional file-system paths easily to NVSD Storage Pools reduces costs by deferring storage expenditures into new budget periods when costs are lower or budget restraints may be eased and also ensures that storage does not sit unused. Data stored in NVSD can have individual retention policies, which gives administrators the flexibility to store the most recent copies on disk and move older data to an offsite location or to less expensive storage. This provides a foundation for Lifecycle Management, which further reduces costs with tiered-storage deployments. Seamless integration with NVBU speeds deployment while simplified ease-of-use reduces the level of storage expertise required to perform deduplicated, disk-based backups. Shrinks Backup Windows To shrink backup windows with no additional impact on protected-server resources, you can schedule NVSD s postprocess deduplication option outside the backup window. NVSD s integration with NVBU s job-level deduplication enables users to separate deduplicated data from nondeduplicated data to ensure the best deduplication ratios and performance. When combined with NVBU s job-level encryption, the primary copy can be deduplicated while encryption is performed only on the secondary copy that is stored off site. Secondary copies can also be performed outside the backup window while still maintaining strict security standards. Even if you do not use the optional NVSD deduplication feature, you will still receive all the advantages of disk-based backup. For example, you can perform more simultaneous backups with disk than you can by writing backups to tape in a serial process. Completing your backups faster ensures that the performance of the application, database, and files servers is not impacted during business hours by overrunning backup windows.

7 NetVault: SmartDisk Administrator s Guide 7 Maximizes Flexibility Administrators are able to deploy multiple NVSD Instances to distribute network, disk, and deduplication resources, which improves load balancing and performance. Shared-storage support provides the ability to share disk-based backup storage across heterogeneous platforms, which provides a single data-protection solution. Data-movement support improves business continuity by letting you copy or move data between NVSD Instances, to VTL, or to tape-based devices to place redundant backups in offsite locations for failover and disaster-recovery purposes. Speeds Restores NVSD improves restore times because the data is coming from random-access storage without having to find and mount tapes, and then search for the correct tape position. The majority of restore requests come in the first 14 to 30 days after backup. With disk-based backup, you can minimize downtime with shorter Recovery Time Objectives, and you can focus on other critical tasks Feature List Simplified disk-based backup Byte-level, variable-block software-based deduplication 12-to-1 deduplication ratio Hardware agnostic Post-process deduplication Rapid deployment with existing infrastructure Seamless integration with NVBU Job-level deduplication Shared-storage support Easily extendible Retention-policy support Heterogeneous-platform support Web-based Distributed Authoring and Versioning (WebDAV)-authenticated access Target Audience This guide is intended for backup administrators and other technical personnel who are responsible for designing and implementing a backup strategy for the organization. A good understanding of the operating system (OS) on which NVSD is running is assumed.

8 8 Chapter 1 Introducing NetVault: SmartDisk Recommended Additional Reading The following documentation is also available: NetVault: Backup Administrator s Guide This guide provides details on administering NVBU. It also provides detailed information on integrating NVSD with NVBU. NetVault: SmartDisk Installation/Upgrade Guide This guide describes how to install NVSD Technical Support BakBone Software is dedicated to providing friendly, expert advice to its customers. BakBone s highly trained professionals are available to answer questions, offer solutions to problems, and generally help make the most of any BakBone software purchase. Log on to the web site for more information Documentation Updates For late-breaking documentation updates, refer to the BakBone Software Knowledge Base. BakBone s Knowledge Base article for NVSD can be found at the following link:

9 NetVault: SmartDisk Administrator s Guide 9 Chapter 2: INTEGRATING NVSD WITH NVBU NVBU Integration An Overview Configuring NVSD Ports for Communication with NVBU Modifying the Messaging Port Modifying the Data Port Enabling or Updating Authentication for WebDAV Access Verifying that the NVBU Client Ports are Open Adding Devices to NVBU NVBU Integration An Overview NVSD seamlessly integrates with NVBU by adding an NVSD Instance to NVBU as a backup device (an NVSD Device) that you can target for backups and restores. NVSD uses the transmission control protocol (TCP) to communicate with the NVBU Media Manager and any NVBU Client. Note: Throughout this document, the path to where you installed NVSD is represented by an ellipsis ( ). Replace the ellipsis with the applicable information Configuring NVSD Ports for Communication with NVBU By default, NVSD uses port to communicate with the NVBU Media Manager and to communicate with the NVBU Clients that are streaming data to the NVSD Device. It also uses port for Inter Process Communication (IPC) on the loopback interface (but not for remote connections). Note: If you intend to use different ports, BakBone strongly recommends that you make the applicable change to the port that communicates with the Media Manager before you add the NVSD Device to NVBU; otherwise, you will have to remove the NVSD Device from NVBU and add it back in again. You can update the port that communicates with NVBU Clients at any time.

10 10 Chapter 2 Integrating NVSD with NVBU Modifying the Messaging Port If you want to use a different port for communication from the NVBU Media Manager, you must stop the NVSD Services, manually update the percolator.cfg file, and restart the NVSD Services. 1. Stop the NVSD Services. For instructions, see Stopping NVSD Services on page Using a text editor, open the percolator.cfg file. On Linux, UNIX, and Mac OS X, the file is located at: /foundation/etc/percolator.cfg On Windows, the file is located at: \foundation\etc\percolator.cfg By default, the file displays the following port-related information: [Network Settings:Listen Port] Value = [Network Settings:Remote Listen Port] Value = Change the value of the Network Settings:Remote Listen Port to the applicable port number, and save the file. 4. Restart the NVSD Services. For instructions, see Restarting NVSD Services on page Modifying the Data Port If you want to use a different port to communicate with the NVBU Clients that stream data to the NVSD Device, complete the following steps. 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: As the root user or using sudo, on Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config As an administrator on Windows: \foundation\bin\smartdisk.bat config

11 NetVault: SmartDisk Administrator s Guide 11 NVSD displays the list of options and parameters that you can use, including the section for configuring the ports: config --add --update --webdav <port> [--block-size <bytes>] [--preferred-address <address>] [--credentials] You can use --block-size to define the block size used to read and write blocks when streaming data to the Staging Store. You can use --preferredaddress to define the primary IP address that NVBU Clients should use when communicating with the NVSD Device. You can use --credentials to enable authentication and define the authorized user and password. 3. To add the new port, type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --add --webdav <port#> On Windows: \foundation\bin\smartdisk.bat config --add --webdav <port#> Replace <port#> with the port that you want to use. 4. To remove the original port (the following uses the default), type: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --delete --webdav On Windows: \foundation\bin\smartdisk.bat config --delete --webdav To verify that the new port has been added and the original has been removed, type: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --show On Windows: \foundation\bin\smartdisk.bat config --show

12 12 Chapter 2 Integrating NVSD with NVBU NVSD displays results similar to the following example: [Interface:Data] Block Size = <blocksize> Credentials = <Name:MaskedPassword> Port = <NewPort#> Type = WebDAV Enabling or Updating Authentication for WebDAV Access If you want to enable authentication for WebDAV access of NVSD for the data port, complete the following steps to specify the credentials. (NVSD uses digestaccess authentication, specifically RFC 2069.) You can also use this same procedure to update existing credentials. 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: As the root user or using sudo, on Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config As an administrator on Windows: \foundation\bin\smartdisk.bat config NVSD displays the list of options and parameters that you can use, including the section for configuring authentication: config --add --update --webdav <port> [--block-size <bytes>] [--preferred-address <address>] [--credentials] 3. To define the credentials, type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --update --webdav <port#> --credentials On Windows: \foundation\bin\smartdisk.bat config --update --webdav <port#> --credentials Replace <port#> with the port that you are using. 4. When the Username prompt appears, enter the user name that should be used for access, and press Enter.

13 NetVault: SmartDisk Administrator s Guide When the Password prompt appears, enter the password associated with the specified user name, press Enter, enter the password again when the Confirm Password prompt appears, and press Enter again. NVSD displays results similar to the following example:./smartdisk.sh config --update --webdav credentials Username: NVSDuser Password: Confirm Password: Configuration applied 6. On NVBU, configure the same credentials for backups and restores to the NVSD Instance. Authentication is not required to add NVSD to NVBU, but it is required for performing backups and restores that use NVSD as the target. For more information on configuring credentials in NVBU, refer to the NetVault: Backup Administrator s Guide a Disabling Authentication To disable WebDAV authentication, you must remove the applicable port and then reinstate it. To do so, complete the following steps. 1. Make sure that no backup or restore jobs are currently active. 2. Initiate a terminal session, or open a command prompt. 3. To remove the WebDAV port, type one of the following: As the root user or using sudo, on Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --delete --webdav <port> As an administrator on Windows: \foundation\bin\smartdisk.bat config --delete --webdav <port> 4. To reinstate the WebDAV port without credentials, type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --add --webdav <port#> --block-size <bytes> On Windows: \foundation\bin\smartdisk.bat config --add --webdav <port#> --block-size <bytes>

14 14 Chapter 2 Integrating NVSD with NVBU Replace <port#> with the port that you are using, and replace <bytes> with the block size that you use to read and write blocks when streaming data to the Staging Store. 5. To verify that the port has been defined correctly, type: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh config --show On Windows: \foundation\bin\smartdisk.bat config --show NVSD displays results similar to the following example: [Interface:Data] Block Size = 32768, B Port = Type = WebDAV Verifying that the NVBU Client Ports are Open BakBone recommends that you verify that the ports are open between the NVBU Clients and the system on which NVSD is installed. To verify that the ports are open, you can use a wget command, a web browser, or another method of your choice. If the port is open, the command returns the current status information. In the following examples, replace <port#> with the applicable port number, and replace <hostname> with the IP address of the machine on which NVSD is installed. To use the wget command: 1. On the system on which NVSD is installed, type: wget 2. On each NVBU Client that will target backups to the NVSD Device, type: wget To use a web browser: 1. On the system on which NVSD is installed, type:

15 NetVault: SmartDisk Administrator s Guide On the system on which the NVBU Server or Client software is installed, type: Adding Devices to NVBU After you have installed NVSD, you must add it as a backup device in NVBU before you can target it for backups and restores. For more information on adding, configuring, scanning, viewing statistics, and removing NVSD Devices from NVBU, refer to the NetVault: Backup Administrator s Guide.

16 16 Chapter 2 Integrating NVSD with NVBU

17 NetVault: SmartDisk Administrator s Guide 17 Chapter 3: USING THE COMMAND LINE INTERFACE (CLI) NVSD CLI An Overview Accessing Command Help Processing Basic Shell Commands Determining the Status of NVSD Services Starting NVSD Services Stopping NVSD Services Restarting NVSD Services Viewing NVSD Log Files Dumping NVSD Logs to a File NVSD CLI An Overview Configuration and administration of NVSD is handled primarily through the NVSD CLI. Using the smartdisk.sh shell on Linux, UNIX, and Mac OS X, or the smartdisk.bat shell on Windows, you can perform basic functions such as configuring, monitoring, starting and stopping NVSD. The basic structure on Linux, UNIX, and Mac OS X is: /foundation/bin/smartdisk.sh <command> The basic structure on Windows is: \foundation\bin\smartdisk.bat <command> Important: If you are using NVSD on Windows 2008, Windows Vista, or Windows 7, be aware that you must use a Run as Administrator command prompt instead of a standard command prompt to execute any of the CLI commands. Otherwise, you might receive an Access Denied message, even if you have administrator privileges.

18 18 Chapter 3 Using the Command Line Interface (CLI) To use a Run as Administrator command prompt: 1. Click Start, and select Run. 2. On the Run dialog, type cmd, and press Ctrl+Shift+Enter. 3. If you receive a confirmation prompt, click Continue. The Administrator Command Prompt appears Accessing Command Help 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh help On Windows: \foundation\bin\smartdisk.bat help NVSD displays a list of the available options and an explanation of how to use them.

19 3.3.0 Processing Basic Shell Commands NetVault: SmartDisk Administrator s Guide 19 The following table lists the basic commands in alphabetical order. Unless specified otherwise, the command is available on all systems. Command Description Available on config dump help license Displays and modifies the NVSD configuration. For more information, see Using the Config Command Options on page 23. Places a copy of all log files into a gzipped tarball file (must be executed by a Root-Level or Administrator User). Displays a complete list of the NVSD commands supported on the NVSD platform. Installs a license key. For more information, refer to the NetVault: SmartDisk Installation/Upgrade Guide. All All except Windows logs Displays the NVSD logs, which are used for diagnosis. All password Lets you change the name or password (or both) of the Windows only non-privileged user that was stored when you originally installed NVSD. If you change the non-privileged user name or password after installation, you must use this command to change it in NVSD as well. Note that this password is case-sensitive. restart Stops and restarts the NVSD Services. Must be All executed by a Root-Level or Administrator User. start Starts the NVSD Services. Must be executed by a Root- All Level or Administrator User. stats Displays NVSD statistics that you can use to monitor All NVSD performance. For more information, see Viewing NVSD Statistics on page 31. status Indicates whether the NVSD Services are running. All stop Stops the NVSD Services. All uninstall Removes the NVSD software binaries. Must be executed by a Root-Level or Administrator User. For more information, refer to the NetVault: SmartDisk All except Solaris and Windows Installation/Upgrade Guide. version Displays the current version of NVSD that is installed. All All All

20 20 Chapter 3 Using the Command Line Interface (CLI) Determining the Status of NVSD Services 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh status On Windows: \foundation\bin\smartdisk.bat status If NVSD services are running, NVSD displays: Percolator slave is listening If NVSD Services are not running, NVSD displays: Failed to connect to percolator slave Starting NVSD Services 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: As the root user or using sudo, on Linux, UNIX, or Mac OS X: /usr/smartdisk/foundation/bin/smartdisk.sh start As an administrator on Windows: \foundation\bin\smartdisk.bat start NVSD starts the NVSD Services. Services started ok. Note: On Windows, you can also start the NVSD Services by clicking Start > Settings > Control Panel > Administrative Tools > Services and starting Foundation Services ID <NVSDInstanceID>.

21 3.3.3 Stopping NVSD Services 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh stop On Windows: \foundation\bin\smartdisk.bat stop NVSD stops the NVSD Services. Services stopped ok. NetVault: SmartDisk Administrator s Guide 21 Note: On Windows, you can also stop the NVSD Services by clicking Start > Settings > Control Panel > Administrative Tools > Services and stopping Foundation Services ID <NVSDInstanceID> Restarting NVSD Services To stop and start the NVSD Services automatically, complete the following steps: 1. Log on as root or sudo to root. 2. Initiate a terminal session, or open a command prompt. 3. Type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh restart On Windows: \foundation\bin\smartdisk.bat restart NVSD stops and restarts the NVSD Services. Services stopped ok.. Services started ok.

22 22 Chapter 3 Using the Command Line Interface (CLI) Viewing NVSD Log Files 1. Initiate a terminal session, or open a command prompt. On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh logs On Windows: \foundation\bin\smartdisk.bat logs NVSD displays the NVSD Logs and all relevant information. When you run logs without any options, it displays all NVSD log entries. 2. To display specific information, use one of the following options: Logs Option --file <pathtofile> --help --last-hours <x> --time-interval <yyyymm-dd-hhmmss yyyy-mmdd-hhmmss> Description Displays the contents of the specified file. Displays a list of the available options and an explanation of how to use them. Displays the records for the specified number of hours. Displays the records for the specified timeframe Dumping NVSD Logs to a File Note: Dumping the NVSD Logs to a file is only available for non-windows platforms. 1. Log on as root or sudo to root. 2. Initiate a terminal session. 3. Type one of the following: /foundation/bin/smartdisk.sh dump <PathAndFileName>.tar.gz NVSD processes the dump command, copies the applicable files to the specified location, and compacts them into one compressed file.

23 NetVault: SmartDisk Administrator s Guide 23 Chapter 4: CONFIGURING NVSD NVSD Configuration An Overview Using the Config Command Options Extending NVSD Storage Pools Examples NVSD Configuration An Overview You can use the NVSD CLI config command to perform tasks such as enabling deduplication, enabling deduplication compression, configuring the deduplication window, configuring Garbage Collection, and extending NVSD Storage Pools by adding additional volumes Using the Config Command Options Before using the NVSD CLI config command, note the following: All times are displayed in the local time for the machine where the NVSD Instance is installed. With the --volume and --pool options, be aware that the <path> and <label> strings are case-sensitive because they identify a specific NVSD Storage Pool or Volume. If a configuration-related command fails and displays a message similar to Failed to apply configuration, BakBone recommends that you use the config command with the --show option to display the current configuration, and double-check the case of the specified NVSD Storage Pool or Volume to ensure that the strings reflect the case-sensitivity. The NVSD CLI config command supports the following options: Config Option --help --show Description Displays a list of the config command options and their syntax. Displays the current values for the NVSD configuration.

24 24 Chapter 4 Configuring NVSD Config Option --dedupe-enable <TRUE FALSE> --dedupe-compression <TRUE FALSE> --dedupe-window <[Sun Mon Tue Wed Thu Fri Sat-]HH:MM- HH:MM> <Never Anytime> Description Enables or disables NVSD Deduplication. Deduplication is disabled for all NVBU backup jobs even if deduplication is enabled for the NVBU backup job and the NVSD Instance is licensed for the NVSD Deduplication Option. Enables or disables compression of NVSD-unique chunks. Disabled by default, compressing unique chunks can reduce their storage footprint up to 50%. Compression is performed on the unique chunks that result from the deduplication process. Compressing the initial Full Backup for a data set might take longer than not compressing the unique data because a large majority of the data is considered unique. Subsequent Full Backups will have significantly fewer unique chunks and will not experience an increase in the amount of time it takes to complete the deduplication and compression process. Sets the NVSD Deduplication Window by specifying the times that deduplication can be performed. By default, the default deduplication window is set to Anytime. Available parameters include: Days of Week Specifies the days of the week on which the deduplication process runs. HH:MM-HH:MM Using a 24-hour clock, specifies the times of day at which the deduplication process runs. Never Disables the deduplication window. Backups enabled for deduplication will remain in the Staging Store in a non-deduplicated state until the deduplication window is enabled. Anytime Enables the deduplication process to be run at any time. Deduplication for a backup data stream begins after the initial 400GB has been written to the Staging Store, which can provide nearly inline deduplication performance.

25 NetVault: SmartDisk Administrator s Guide 25 Config Option --gc-window <[Sun Mon Tue Wed Thu Fri Sat-]HH:MM- HH:MM> <Never Anytime> --dedupe-active-limit <Unlimited limit> --network-capacity <Mbps> --stream-limit <limit> --add --update --volume <path> [Parameters] --add --update --webdav <port> [--block-size <bytes>] [--preferred-address <address>] [--credentials] --delete --webdav <port> Description Sets the Garbage Collection window by specifying the times that NVSD Garbage Collection can be performed. By default, Garbage Collection is performed on Tuesdays from 09:00 to 17:00. Available parameters include: Days of Week Specifies the days of the week on which the Garbage Collection process runs. HH:MM-HH:MM Using a 24-hour clock, specifies the times of day at which the Garbage Collection process runs. Never Disables the Garbage Collection window. Anytime Enables the Garbage Collection process to be run at any time. Specifies the maximum number of NVBU segments that can be deduplicated simultaneously. Specifies the capacity, in megabytes per second (MBps), of the network between the NVSD Device and the NVBU Clients. The NVSD Remote Access Service (RAS) Controller uses this figure when it calculates the NVSD Device availability score. The availability score is calculated by comparing the current throughput and comparing it to maximum capacity. The availability score is reported by the RAS Controller to the NVBU Media Manager, which uses it when deciding whether an NVSD Device should be targeted for a backup. Specifies the number of data streams that can be processed simultaneously. Extends NVSD Storage Pools by adding or updating existing volumes in the NVSD Storage Pools. For more information, see Extending NVSD Storage Pools on page 26. Modifies the port that the NVSD Device uses to communicate with the NVBU Clients. For more information, see Modifying the Data Port on page 10. Used in conjunction with --add, modifies the port that the NVSD Device uses to communicate with the NVBU Clients. For more information, see Modifying the Data Port on page 10

26 26 Chapter 4 Configuring NVSD Extending NVSD Storage Pools You can extend NVSD physical capacity by adding or updating the volumes specified for the NVSD Storage Pools. Use the config --add --update --volume <path> command to extend the NVSD physical capacity. You can also use the following additional parameters: Note: The NVSD Non-privileged User must have access to any volumes that are added to ensure that configuration changes are successfully applied. Config Volume Parameters --volume <path> [--volume-size <X>] [--dedupe-cap <Unlimited cap>] [--pool <label>] Description Specifies the path for the file-system path of the volume to be used as an NVSD Storage Pool. You can specify local drives or Universal Naming Convention (UNC) paths for Common Internet File System (CIFS), Network File System (NFS), and Storage Area Network (SAN). If the volume is on a mounted file system, make sure that the specified path is a valid subdirectory on the mounted file system (and not the mounted directory itself). This ensures that data is not written to the local directory if the mounted location is unavailable. Specifies a percentage of the volume that cannot be used by NVSD. The value of ((100 - X) / 100) * (total volume size) is added to the Last Resort Threshold (LRT). In addition, a small amount of storage is reserved to complete Garbage Collection. These three components of reserved storage determine the total amount of storage set aside that cannot be directly used by NVSD. For example, if volume-size is set to 30 and the volume s size is 100GB, 70GB is set aside (in addition to the LRT and Garbage Collection reserve space) and cannot be used by NVSD. Specifies the maximum number of NVBU segments for the specific volume that can be deduplicated simultaneously. Defaults to 4. Specifies the Label assigned to the Storage Pool. Defaults to a system-generated numeric label. Specify an existing Storage Pool label to add the volume to an existing Storage Pool, or specify a new name to create a new Storage Pool.

27 NetVault: SmartDisk Administrator s Guide 27 Config Volume Parameters [--reservation-size <bytes>] [--favour <Staging Storage "Chunk Index" "Disk Index" All None>] [--deny <Staging Storage "Chunk Index" "Disk Index" All None>] Description Specifies the number of bytes reserved by the processes streaming data into NVSD. A smaller size results in NVSD having to reserve space more frequently; a larger size renders more disk space temporarily unavailable. If the Space.Available (reported via the show option) is less than the reservation-size, the volume is considered FULL. Specifies which Storage Pool Roles the volume is available to perform. To specify multiple roles, list the --favour parameter multiple times. For example: --favour Staging --favour "Disk Index" Use in conjunction with --deny to dedicate a volume to one or more roles. Specifies which Storage Pool Roles the volume is not available to perform. To specify multiple roles, list the --deny parameter multiple times. For example: --deny Storage --favour "Chunk Index" Use in conjunction with --favour to dedicate a volume to one or more roles. Note: After a volume has been used by NVSD as a Chunk Index or Content Index (that is, data has been staged or stored), NVSD continues to use the volume for this purpose, even if this parameter is used to deny it. [--balancing <Space Activity None>] [--account <UNC-pathaccount>] [--password <UNC-pathpassword>] Instructs NVSD to use the volume with either the most space available or the least activity occurring. If used with --favour and --deny, --balancing is applied last. Required for Windows platform when specifying UNC paths. Specifies the user account with read and write permissions to the UNC path. Required for Windows platform when specifying UNC paths. Specifies the password for the user account with read and write permissions to the UNC path. Note that this password is case-sensitive.

28 28 Chapter 4 Configuring NVSD Examples To add a new volume that will be used for all roles, enter the following command: \foundation\bin\smartdisk.sh config --add --volume \mnt \<newnvsdvolume> The NVSD configuration is updated. Configuration applied To add a volume dedicated to the Chunk Store, enter the following command: \foundation\bin\smartdisk.bat config --add --volume c:\sdstoragepools2\store --favour Storage --deny Staging --deny "Chunk Index" --deny "Disk Index" The NVSD configuration is updated. Configuration applied To add a CIFS share, enter the following command: \foundation\bin\smartdisk.sh config --add --volume \\<IPaddress>\<NVSDvolume> --account <nonpriviledgeduser> --password <nonprivilegeduserpassword> The NVSD configuration is updated.

29 NetVault: SmartDisk Administrator s Guide 29 To review the NVSD configuration, enter the following command: \foundation\bin\smartdisk.bat config --show The NVSD configuration is displayed, including the following details on the Storage Pool volumes: [SmartDisk:Volume] Storage Pool = Store Location = c:\sdstoragepools2\store Disk Manager Index = TRUE Space.Limit = 100, % Space.Reservation Size = , B Favour = Storage, Chunk Index, Disk Index Deny = Staging Balancing = Activity Space.OS.Available = , B Space.Available = , B Space.Staging.Status = Not Configured Space.Staging.Available = 0, B Space.Staging.Reserved = 0, B Space.Last Resort = , B Data.Staged = 0, B Deduplication Activity Cap = 4 Active Operations = 0 [SmartDisk:Volume] Storage Pool = Staging Pool Location = c:\sdstoragepools2\stage Disk Manager Index = FALSE Space.Limit = 100, % Space.Reservation Size = , B Favour = Staging Deny = Storage, Chunk Index, Disk Index Balancing = Activity Space.OS.Available = , B Space.Available = , B Space.Staging.Status = Available Space.Staging.Available = , B Space.Staging.Reserved = 0, B Space.Last Resort = , B Data.Staged = 0, B Deduplication Activity Cap = 4 Active Operations = 0

30 30 Chapter 4 Configuring NVSD

31 NetVault: SmartDisk Administrator s Guide 31 Chapter 5: MONITORING PERFORMANCE NVSD Performance Monitoring An Overview Viewing NVSD Statistics Viewing NVSD Statistics in a Terminal Session or Command Prompt Viewing NVSD Statistics in a Browser Reviewing the List of NVSD Statistics Calculating the Deduplication Ratio Calculating the Reduction in the Storage Footprint NVSD Performance Monitoring An Overview NVSD provides the ability to monitor its performance and to calculate the following statistics: Deduplication Ratio Disk Space Savings Viewing NVSD Statistics You can view NVSD statistics from a terminal session, command prompt, or browser Viewing NVSD Statistics in a Terminal Session or Command Prompt 1. Initiate a terminal session, or open a command prompt. 2. Type one of the following: On Linux, UNIX, or Mac OS X: /foundation/bin/smartdisk.sh stats On Windows: \foundation\bin\smartdisk.bat stats NVSD displays the statistics described under Reviewing the List of NVSD Statistics on page 32.

32 32 Chapter 5 Monitoring Performance Viewing NVSD Statistics in a Browser Note: BakBone recommends that you use one of the following browsers when viewing NVSD statistics: Mozilla, Safari, or Konqueror. Truncation might occur with Internet Explorer because it ignores line feeds. In a browser, enter the following URL: For example: http: // :37453/proc/stats.stnz NVSD displays the statistics in XML format in the browser. For a description of the statistics, see Reviewing the List of NVSD Statistics on page Reviewing the List of NVSD Statistics When reviewing the following list of statistics, be aware that an NVBU backup job is divided into a minimum of two segments: Segments contain either data or metadata and are smaller than 400GB. For example, if the NVBU backup data stream is 1200GB, the NVBU backup job will have three data segments. One NVSD element is equivalent to one NVBU segment. Note: The list of statistics displayed for the Dedupe:StatusSubsys segment is affected by the current status of the Chunk Store Daemon (CSD). Stat Entry [SmartDisk:Deduplication Scheduler] Elements.Queued = <No.> Data.Queued = <No.>, B Elements.Deduplicating = <No.> Data.Deduplicating = <No.>, B GC Active = FALSE Description Statistics for the process that schedules deduplication activity. Number of segments awaiting deduplication. Number of bytes awaiting deduplication. Number of elements or NVBU segments currently deduplicating. Total size of elements or NVBU segments currently deduplicating. After all current deduplication completes, the equivalent amount of data is removed from the Staging Store. Indicates whether Garbage Collection is active.

33 NetVault: SmartDisk Administrator s Guide 33 Stat Entry Deduplication Available = TRUE Deduplication Enabled = TRUE [SmartDisk:RAS Controller] Availability Score = <No.> Sent MBps = <No.> Received MBps = <No.> Machine ID = <3-XXXX-XXX> Soft stream limit = <No.> Version = <NVSDversion> Description Displays TRUE or FALSE depending on whether the CSD is available for deduplication tasks. Displays TRUE or FALSE depending on whether the data-deduplication option is licensed and enabled. Statistics for the process that interacts with NVBU. Indicates how available an NVBU Server should consider this NVSD Device to be. The lower the number, the less available the NVSD Device is. Given a choice of two NVSD Devices to target an NVBU job to, NVBU will choose the one with the higher Availability Score. The score takes the following into account: Number of data streams NVSD is receiving in or retrieving from the Staging Store. Percentage of available network bandwidth that these data streams are using. Total megabytes per second (MBps) across all streams being sent out from NVSD to NVBU; that is, when an NVBU restore job is being performed. Total MBps across all streams being sent to NVSD; that is, when an NVBU backup job is targeted to an NVSD Device. Machine ID of the NVSD Instance that is used to obtain a permanent license key. Current maximum number of data streams or backups that NVBU can target to this NVSD Device simultaneously. NVSD version Build Level = <NVSDbuild> NVSD build

34 34 Chapter 5 Monitoring Performance Stat Entry [SmartDisk:Service Manager] Active = 0 Active.Write = <No.> Active.Read = <No.> Active.MkDir = <No.> Active.Delete = <No.> [Dedupe:StatSubsys] pages = <No.> chunks = <No.> index_bytes = <No.> num.pages = <No.> num.lcp = <No.> num.chunks = <No.> num.pages_max = <No.> num.lcp_max = <No.> num.chunks_max = <No.> num.hits = <No.> num.misses = <No.> num.store_misses = <No.> num.added_pages = <No.> num.added_lcp = <No.> num.evicted_pages = <No.> num.evicted_lcp = <No.> num.cache_memory = <No.> streams = <No.> Description Statistics for the NVSD Task Manager. Total number of active backup or restore operations. Current number of NVBU segments being written. Current number of NVBU segments being read. Not currently used. Current number of NVBU segments being deleted. Statistics for the NVSD Deduplication Processes. Current number of chunk pages stored on disk. A chunk page is a storage object or file that contains a number of chunks. Chunk pages are typically 64MB. Total number of unique chunks stored in the Chunk Store of this NVSD Device. Total number of bytes on disk used by the Chunk Index. For use by BakBone Technical Support, if necessary. Total number of elements or NVBU segments that have been deduplicated.

35 NetVault: SmartDisk Administrator s Guide 35 Stat Entry catalog_bytes = <No.> ondisk_bytes = <No.> gc_reserve_bytes = <No.> stream_bytes = <No.> csd.stream_bytes = <No.> csd.chunk_bytes = <No.> in_gc = <No.> csd.gc_state = Not in GC csd.last_successful_gc = <No.> status = <currentstatus> available_bytes = <No.> [SmartDisk:Disk Storage] Index.Location = < /store> Description Total number of bytes used by a volume s catalog. Total number of bytes on disk used by deduplicated data. Includes the bytes consumed by the Chunk Store, Chunk Index, and Manifests. Number of bytes that NVSD must keep available on a file system to guarantee that Garbage Collection can take place. Increases as the size of the Chunk Store increases. Total number of bytes submitted for deduplication. Total number of bytes submitted for deduplication since the NVSD Services were started. When a backup is retired, the size of the backups is not deleted from csd.stream_bytes. Total number of bytes of unique chunks stored since the NVSD Services were started. Indicates whether Garbage Collection is currently happening. The phase of Garbage Collection that is currently occurring. Time stamp that indicates when Garbage Collection was last completed successfully. Status reported by the CSD; includes Available, Unavailable, and NotConfigured. Used to determine whether the CSD is available for deduplication tasks and whether space is available. Total number of bytes available for storage of deduplicated data. Statistics for NVSD Disk Storage. Location of the Staging Store volume used for the Content Index.

36 36 Chapter 5 Monitoring Performance Stat Entry Index.Fixed = TRUE Elements = <No.> Data = <No.>, B Data.Committed = <No.>, B Space.Licensed = Unlimited Space.OS.Available = <No.>, B Space.Available = <No.>, B Space.Staging.Status = <CurrentStatus> Space.Staging.Available = <No.>, B Elements.Staged = <No.> Data.Staged = <No.>, B Elements.Accumulative = <No.> Description Displays TRUE or FALSE depending on whether the location is fixed (TRUE) or can be moved to another location (FALSE) by using the --favour and --deny options. For more information on the favour and deny options, see Extending NVSD Storage Pools on page 26. Number of elements or NVBU segments currently residing in the Storage Pools. Amount of data, in bytes, currently residing in the Storage Pools. Amount of data, in bytes, that has completed the write-to-disk process. Number of GB that NVSD is licensed to protect. Number of bytes available across all configured NVSD Storage Pools; reported by the OS. Number of bytes available across all configured NVSD Storage Pools. For more information on space allocation, refer to the applicable topic in the NetVault: SmartDisk Installation/ Upgrade Guide. Status of NVSD Staging Store; includes Available, Full, Unlicensed, and License Exceeded. Number of bytes available for Staging Store across all configured NVSD Storage Pools. Number of elements or NVBU segments currently residing in the Staging Store. Amount of data, in bytes, currently residing in the Staging Store. Number of elements or NVBU segments processed by NVSD since its implementation.

37 NetVault: SmartDisk Administrator s Guide 37 Stat Entry Data.Accumulative = <No.>, B Data.Committed.Accumulative = <No.>, B Description Total amount of data, in bytes, processed by NVSD since NVSD was installed. Total amount of data, in bytes, that has completed the NVSD write-to-disk process since NVSD was installed Calculating the Deduplication Ratio Use the following calculation to determine the NVSD Deduplication Ratio for the data that has been protected by NVSD: stream_bytes / ondisk_bytes = NVSD Deduplication Ratio Use the following calculation to determine the NVSD Deduplication Ratio for the data that has been protected by NVSD since the NVSD Services were started: csd.stream_bytes / csd.chunk_bytes = NVSD Deduplication Ratio since NVSD were started The NVSD Deduplication Ratio for an NVSD Device is also displayed in the NVBU Console. For more information on viewing NVSD statistics in NVBU, refer to the NetVault: Backup Administrator s Guide Calculating the Reduction in the Storage Footprint The NVSD Deduplication Option reduces the storage footprint required to store the protected data. To calculate the reduction in the storage footprint that NVSD is currently providing for protected data, use the following calculation: (ondisk.bytes / stream.bytes) * 100 = NVSD Reduction in Storage Footprint

38 38 Chapter 5 Monitoring Performance

39 NetVault: SmartDisk Administrator s Guide 39 Chapter 6: TROUBLESHOOTING NVSD Windows Installation Succeeds but the Percolator Fails to Connect Backup Stalls While Writing to Media Windows Installation Succeeds but the Percolator Fails to Connect If you install NVSD and the utility indicates that installation completed successfully, but invoking the smartdisk.bat status command, results in a message that indicates that it failed to connect to the percolator slave, it might be because you created a non-privileged user whose password needed to be changed before the installation was attempted. When you create a non-privileged user, the User must change password at next login check box is selected by default in some instances (it depends on what method you use to access the feature that lets you create a user). If you forget to clear the check box or if you forget to change the password before installing NVSD, installation appears to succeed. When this occurs, you must remove NVSD and then reinstall it after completing either of the following options: Create a different non-privileged user. Delete and add the original non-privileged user again. Note: Logging on as the non-privileged user and changing its password after you have installed NVSD does not clear this issue. Another reason that this might occur is because you entered the wrong user name or password. To update the user name or password after installation, use the smartdisk.bat password command.

40 40 Chapter 6 Troubleshooting NVSD Backup Stalls While Writing to Media When the Status of the backup job appears as Running: (Stalled) Writing to media on the Status tab of the NVBU Jobs window, and the Staging status for the applicable NVSD Instance appears as FULL on the Storage tab located on the Status tab of the NVBU Device Management window, it usually indicates that NVSD has run out of Licensed Capacity. At the start of a write, the NVSD Disk Manager verifies that there is still a sufficient amount of NVSD Licensed Capacity to proceed (that is, that the Licensed Capacity exceeds the current amount of protected data). If there is Licensed Capacity available, the write continues to completion. Writes to NVSD are performed in X-sized units, where X is equal to the reservation-size parameter described in Extending NVSD Storage Pools on page 26. During the write, the Disk Manager performs a verify after each X bytes is written to determine whether there is enough usable space available to reserve an additional X bytes. A write will stall if there is no Licensed Capacity at the beginning of the write, or if at any point during the write there is not enough available space to reserve X bytes. For information on increasing the amount of NVSD Licensed Capacity, refer to the NetVault: SmartDisk Installation/Upgrade Guide.