Getting Started and System Guide. Version

Transcription

1 Version

2 2016 Waterford Technologies. All Rights Reserved. Information in this document is subject to change without notice. No part of this document may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without the express written permission of Waterford Technologies. Any errors, corrections, suggestions, or omissions should be sent to Disclaimer: The information contained within this document is provided as-is, as available, and all warranties, express or implied, are disclaimed (including but not limited to the disclaimer of any implied warranties of merchantability and fitness for a particular purpose). While every reasonable effort has been made to provide accurate information, the information may contain errors, problems or other limitations. Our sole and entire maximum liability for any inaccurate information, for any reason, and user s sole and exclusive remedy for any cause whatsoever, shall be limited to the amount paid by the customer for the information received (if any). We are not liable for any indirect, special, incidental, or consequential damages (including damages for loss of business, loss of profits, litigation, or the like). Whether based on breach of contract, breach of warranty, tort (including negligence), and product liability or otherwise, even if advised of the possibility of such damage. The limitations of damages set forth above are fundamental elements of the basis of the bargain between you and us. No representations, warranties or guarantees whatsoever are made as to the accuracy, adequacy, reliability, completeness, suitability or applicability of the information to a particular situation. All information contained within this document is subject to change without notice. Waterford Technologies 2016 All Rights Reserved 2

3 Document Contents SISCIN - Map Move Manage... 6 Three Steps to the Cloud... 6 Map... 6 Move... 6 Manage... 6 The SISCIN Advantage... 7 System Requirements... 9 Important Windows TCP Port Information... 9 SISCIN Keystore Important SISCIN Agent Permission Information Data transfers between the Agent and the SISCIN Cloud Services All communication between the Agent and the SISCIN cloud services is made via SSL links Snapshot Data Archiving Data Restoring Data Keystore How SISCIN accesses files stored in Windows Shares Getting Started SISCIN Implementation Workflow Downloading your SISCIN Agent Software and License Installing the SISCIN Agent Software and License Creating WatchPoints Creating Policies Job Status Reports Creating your SISCIN Keystore Important information regarding SISCIN Keystore Creating Archives - Connecting SISCIN to your Microsoft Azure General Storage account Important information regarding SISCIN Keystore Creating Archives - Connecting SISCIN to Amazon Web Services (AWS) S3 Buckets Create your Azure Account for the SISCIN Keystore Important information regarding SISCIN Keystore Create your AWS Account for Archive Storage Creating Policies to Archive your files to your cloud storage Policy Types Waterford Technologies 2016 All Rights Reserved 3

4 Archive Policy Archive & Delete Policy Archive & Enhanced Stub Policy Archive & OnDemand Stub Policy Delete Policy Creating an Archive & OnDemand Policy Filter Options File Name Filter File Path Filter File Extension Filter File Owner Filter File Size Filter Age Filter Date Filter Archived Filter Simple Filter Example Multi-Criteria Filter Example Complex Filter Example Complex Filter using Groups Example Confirming or Rejecting a Job Execution Setting Up SISCIN System Notifications Manage your files with SISCIN Explorer How to Archive files manually to your SISCIN Cloud Archive How to Restore Files from your SISCIN Cloud Archive Restore by Folder Restore by File How to use SISCIN Explorer to Delete Files Troubleshooting Information Before contacting Waterford Technologies Support Important Windows TCP Port Information Important SISCIN Agent Permission Information How to enable SISCIN Agent Logging How to enable SISCIN Storage Management Logging How to contact Waterford Technologies Customer Support Waterford Technologies 2016 All Rights Reserved 4

5 Waterford Technologies 2016 All Rights Reserved 5

6 SISCIN - Map Move Manage Congratulations on choosing SISCIN - the most advanced and cost effective method for quickly and securely moving critical or seldom used data directly to Microsoft Azure and Amazon S3 cloud storage. Three Steps to the Cloud Map SISCIN provides you with the tools for gathering more insight into your disk storage usage. Using this information, you can more effectively map out your strategy for moving your critical information to cloud storage. Move SISCIN safely and securely moves targeted data directly to Microsoft Azure or Amazon S3 Cloud Storage. Manage SISCIN will assist you in managing your files stored in the cloud and how users will access them. Waterford Technologies 2016 All Rights Reserved 6

7 The SISCIN Advantage Fast and easy Agent installation o The only software to install is a small agent that will run on your Windows File Servers accessing local or SAN storage. It takes minutes to download and install. The agent will run as a Windows Service and can access both local and network accessed storage. Safe, Secure and Direct path for moving your critical files to Microsoft Azure and Amazon S3 Cloud storage o Secure because your files go directly from your servers encrypted and compressed to your Microsoft Azure and Amazon S3 Cloud Archive o Your files or their contents are never stored in the SISCIN Cloud - they are stored in your own Microsoft Azure and Amazon S3 Cloud Storage o During Archiving, none of your data passes through SISCIN o All information Encrypted every step of the way o Protect Archived files using different archive types Single Copy, Double Copy or Split files across providers. Maximize Storage space using Stubbing o With stubbing, files are first archived and then replaced with a small (1k) stub link that allows users to quickly access or restore files stored in your cloud archive. Because these files reside in the Cloud, stubbed files can be accessed anywhere at any time. Waterford Technologies 2016 All Rights Reserved 7

8 All files are Compressed and Encrypted before transmission to the cloud - saving both bandwidth and storage Files are de-duplicated across all servers before archiving No hardware to purchase High Performance Infinitely Scalable Unlimited Capacity No User Interface to install or distribute Small Server Agent Footprint Waterford Technologies 2016 All Rights Reserved 8

9 System Requirements SISCIN Windows Server Agents support the following operating systems: o Windows 2003 both 32bit and 64bit o Windows 2008 both 32bit and 64bit o Windows 2012 Minimum of 4gb of Memory. Two or more processors are recommended Minimum of 500mb of free disc storage Communication between SISCIN and SINCIN Server Agents is done over the Internet. This will require some Windows Ports to be opened on your network to the Internet. SISCIN requires the.net Framework 4.0 be installed on each server running the SISCIN Windows Server Agent. Performance between SISCIN and SISCIN Server Agents are directly related to the speed of your internet connection. Archive performance is directly related to the speed of the Internet connection between the server running the SISCIN Windows Server Agent and the Azure or Amazon (AWS) infrastructure. SISCIN Access to File Shares stored on non-windows platforms will require an SISCIN Agent running on a Windows Proxy Server. There is no Database software to purchase or support There is no Client Software to install or support There is no Storage Hardware to purchase or support Important Windows TCP Port Information Communication between SISCIN Server Agents and SISCIN in the cloud runs across the internet. All information gathered by SISCIN Server Agents is encrypted and compressed on your File Server before it is sent to SISCIN in the Cloud. To do this securely specific TCP Windows Ports need to be open OUTBOUND to allow the SISCIN Server Agents to communicate with SISCIN. The following ports must be open OUTBOUND from the SISCIN Server Agents in Windows Firewall, Routers and any other device that controls access to the internet. Contact your Network Administrator if you are unsure how to open these ports in your organization. Ports 80 and 443 must be unblocked OUTBOUND to *.blob.core.windows.net Ports 5671, 5672, must be unblocked OUTBOUND to *.servicebus.windows.net Waterford Technologies 2016 All Rights Reserved 9

10 SISCIN Keystore The SISCIN Keystore is one of the more critical pieces of the system with regards to Archiving. When a file is encrypted the content is encrypted, the decryption key for this file must be stored somewhere for later use. It is stored in the SISCIN Keystore. The SISCIN Keystore is also used to track the single instance information within an archive volume. One file in the archive could for instance represent 2 original user files, which may even have different names. The SISCIN Keystore also tracks this name mapping between the archive and source file(s). The SISCIN Keystore uses Microsoft Azure storage tables. It is fully redundant and has excellent scalability. It does not have a single point of failure and can scale infinitely. The SISCIN Keystore are Microsoft Azure Tables that are placed in the first Azure Storage Account that is defined in SISCIN. Do not use a test account or any other account that you plan on deleting at a later time for the first account defined to SISCIN. Use an account that you plan on keeping forever as the first account. You could use a different storage account for test archives if necessary. Important: If this Azure Storage Account is deleted at any time ALL access to ALL Archived data regardless of Storage Account is lost. Important: Because the Keystore resides in your Microsoft Azure storage Waterford Technologies will not be backing up any customer s SISCIN Keystore. Important: Please refer to Microsoft Azure online documentation for the AZCOPY utility for the information required to backup your SISCIN Keystore. You will use the AZCOPY Table: Export feature to make backup copies of your SISCIN Keystore. The currently location for information regarding this utility can be found at: Important SISCIN Agent Permission Information The SISCIN Agent service must have Full Control Access to all the Folders and Files that you want to Map, Move and Manage with SISCIN. By default, this service will run as a Local System. We strongly recommend that this account be change to either a special service account created for SISCIN or an administrative service account used by your Backup Software or like program. See the chapter titled: Installing the SISCIN Agent Software and License in this document for more information. Waterford Technologies 2016 All Rights Reserved 10

11 Data transfers between the Agent and the SISCIN Cloud Services All communication between the Agent and the SISCIN cloud services is made via SSL links. Snapshot Data Independently of SSL all snapshot data is encrypted by the premises based SISCIN agent prior to transmission to the cloud. This is encrypted using a unique key per customer. Once the data arrives at our data centers, it is decrypted and stored in a Customer Specific Silo, credentials to this silo are unique per customer. AES 256 encryption is used. Archiving Data All archived data is stored with public cloud storage providers such as Azure or Amazon. Independently of any security and encryption that these services offer SISCIN adds additional layers of security to the data before it leaves the customer premises. o Data is encrypted by the premises based SISCIN agent prior to transmission. o Archive Data routes directly to the cloud provider and does not pass through our Data center o Encryption key is assigned per file; no two files have the same key. o It is always encrypted at rest with the cloud provider. o AES 256 encryption is used. Restoring Data Keystore When a restore is initiated through either the UI or enhanced stubs then the file is retrieved as an encrypted bit stream by the premises based SISCIN agent, the unique file key is retrieved form the keystore and all decryption is done by the agent before the file is presented to the user. If the file is restored via an on-demand stub, then the decryption is carried out in our datacenter. The keystore is used to hold the encryption keys for each file in the archive. o The keystore is created in customer managed and provisioned Azure storage. o This can be in a separate account \ location to any archive volumes if desired by the customer. o Customer data is never mixed in the keystore. o Each key is encrypted with a key that is unique to the customer. How SISCIN accesses files stored in Windows Shares SISCIN Agents must run on Microsoft Windows Servers. If you have Storage Appliances that do not run the Windows Server operating system you will need to run a SISCIN Agent on a Windows Server and use it as a Proxy. The SISIN Agent would run on a Window Server that has access to Shares hosted on your Storage Appliance. The SISCIN Agent Service Account would need to have Full Control Access to the Shares hosted on the Storage Appliance. Waterford Technologies 2016 All Rights Reserved 11

12 Getting Started Once you are registered and setup with your SISCIN Account and have selected your Subscription you are ready to get started. Using this document, you will quickly learn how to do the following: Download your SISCIN Agents and Licenses Install aa SISCIN Agent Create SISCIN WatchPoints and Schedule Jobs Review SISCIN Job Status Reports Connecting SISCIN to your Microsoft Azure General-purpose storage account Connecting SISCIN to your Amazon S3 storage Create your SISCIN Archive Volumes Create SISCIN Policies and Schedule Jobs to archive your files to your cloud storage Maintain and Manage your SISCIN Cloud Archive Waterford Technologies 2016 All Rights Reserved 12

13 SISCIN Implementation Workflow Taking a methodical and measured approach to moving your critical files to cloud storage is important. Failure to develop a comprehensive plan is the leading cause of problems that will impact the long term success of your archiving. Here is what we recommend: Setup SISCIN WatchPoints Create SISCIN Snapshot Jobs Analyze SISCIN Storage Reports Create your Storage Management Roadmap Create SISCIN Archive Jobs Analyze SISCIN Storage Report Revise or tune your Roadmap Manage SISCIN Policies Waterford Technologies 2016 All Rights Reserved 13

14 Downloading your SISCIN Agent Software and License The SISCIN Agent is software that runs on your file server. It runs as a Windows Service. The SISCIN Agent service must have Full Control Access to all of the Folders and Files that you want to Map, Move and Manage with SISCIN. By default, this service will run as a Local System. We strongly recommend that this account be changed to either a special service account created for SISCIN or an account used by your backup software. 1. Open your Edge, Internet Explorer or Chrome browser and go to Click button for your geographic location. If you are located in the Americas, select the use the US Portal button. All other location should use the Use EU Portal button. 2. Login to My.SISCIN.com using your address and SISCIN password. Waterford Technologies 2016 All Rights Reserved 14

15 3. You will be logged onto your SISCIN Dashboard 4. Select the Agents Tab Waterford Technologies 2016 All Rights Reserved 15

16 5. Select Activate an Agent 6. Enter in the Agent Name you want. We recommend using the actual name of the server. 7. Click the Add button. You will be prompted to download and save the License file for this server. If you are on the file server save it in the Downloads folder. If you are not, you will need to copy this file to the server where you will be installing the agent. Waterford Technologies 2016 All Rights Reserved 16

17 8. Now download the agent software by clicking on the Download Agent Installer link. 9. You will be prompted either to run the Agent installer or to save it. If you are on the Agent server, you can run it. If you are on another computer, you should save it and then copy it to the Agent server. Waterford Technologies 2016 All Rights Reserved 17

18 Installing the SISCIN Agent Software and License Important: The SISCIN Agent service must have Full Control rights to all of the Folders and Files that you want to Map, Move and Manage with SISCIN. By default, this service will run as a Local System. We strongly recommend that this account be changed to either a special service account created for SISCIN or an account used by your Backup Software. 1. Log on to the Server that you are going to be installing the SISCIN Agent. We recommend using a Domain Administrator account. 2. Using the Windows Explorer go to your Downloads folder or to the location that you placed the Agent Software and License generated in Step 1 Download the Agent Software and License. 3. Now right click the SISCIN.WinAgent.Setup file and select Run as Administrator. Waterford Technologies 2016 All Rights Reserved 18

19 4. The SISCIN Agent software requires the.net Framework 4.0. The Prerequisites Wizard will verify that the.net Framework 4.0 has been installed. If.Net Framework 4.0 has not been installed the Wizard will assist you with installing it on the Agent Server. Click Next. 5. Accept the End User License Agreement. Click Next. Waterford Technologies 2016 All Rights Reserved 19

20 6. In this case, the.net Framework 4.0 is missing. The Wizard will now install it. Click Next. 7. The software will then be downloaded. Waterford Technologies 2016 All Rights Reserved 20

21 8. The Microsoft.NET installation wizard will start automatically. After this wizard has completed click Finish and the File Analyzer Agent installation will continue. 9. The SISCIN.WinAgent installation will now start. Specify the installation path and then agree to the License Terms and Conditions. Verify that you have sufficient drive space for the installation and click Install. Waterford Technologies 2016 All Rights Reserved 21

22 10. The installation process will begin. Waterford Technologies 2016 All Rights Reserved 22

23 11. You will be prompted to select the License file that you downloaded from your My.SISCIN.com portal. Click the Load Agent License File button. 12. Select the License file and click Open. Click OK Waterford Technologies 2016 All Rights Reserved 23

24 13. The Installation is completed. Click Finish. 14. Open the Microsoft Services (services.msc) control panel. Locate the Siscin Windows File Agent service. The SISCIN Agent service must have Full Control rights to all the Folders and Files that you want to Map, Move and Manage with SISCIN. By default, this service will run as a Local System. We strongly recommend that this account be changed to either a special service account created for SISCIN or an account used by your Backup Software. Waterford Technologies 2016 All Rights Reserved 24

25 15. Right click the service and open Properties. Select the Log On tab. Enter the Service Account and Password and click OK. You must Restart the SISCIN Windows File Agent Service after making this change. Waterford Technologies 2016 All Rights Reserved 25

26 Creating WatchPoints SISCIN references data on your servers or storage devices using WatchPoints. A WatchPoint is a storage location that would be the root for running policies for Analysis, Archiving, Stubbing or Deletion. A WatchPoint can only be a single path like D:\ or D:\UserShares\ or a UNC path like \\CorpServer\UserShares. Policies and Jobs can be created under the WatchPoint to target multiple folders. 1. From the SISCIN Dashboard click the Agents menu. Select the Agent Server from the dropdown list. In this example, we will be selecting Support-DC1. 2. Select the WatchPoints tab. Waterford Technologies 2016 All Rights Reserved 26

27 3. Click the +Add a Watch Point button. Create a name for the Watch Point. Make it as descriptive as possible. Then enter in the Root Path to that folder. The Root Path can be a local drive or UNC Path. Then click Add. 4. The new WatchPoint will now be available for this Agent. The next step is to create a Policy to Snapshot inventory the contents of this Watch Point. Waterford Technologies 2016 All Rights Reserved 27

28 Creating Policies WatchPoint reporting information is generated by SISCIN through a Snapshot by creating a Policy and running a Job. Policy Jobs can be run once or can be scheduled to run at a variety of frequencies. 1. From the Agents menu, select your agent from the dropdown list. 2. Select the Policies tab. Select the +Add a Policy button. Waterford Technologies 2016 All Rights Reserved 28

29 3. Using Add Policy you will specify the Action Type at this time. Select Snapshot (you will be able to run other job types after the Snapshot completes) and which WatchPoint this job will be associated. In the following example, we have selected the Snapshot Action Type for the End User Folder Shares WatchPoint. Click Next. 4. Now select the frequency that this policy will run. When you create a schedule a Job will be created. You can see these jobs using the Jobs tab. If you select None, a Job will not be created. In this example we are going schedule this Policy to run Weekly. The Job for this Policy will run on Fridays at 1:00AM. 5. The Policies tab will show the details and when it will run. Waterford Technologies 2016 All Rights Reserved 29

30 6. The Jobs tab will show when this policy will run next. Waterford Technologies 2016 All Rights Reserved 30

31 Job Status Reports SISCIN Job Status Reports allows you to see which jobs are running and which ones have already completed. The Dashboard will also allow you to see currently executing Jobs. 1. From the tool bar, select Reports and then Job Status Reports. These reports will allow you report on Jobs that are currently running or see the history of Jobs that have run in the past. 2. From the Job Status Report menu, you can select reports for All Job Types or a specific type. You can also select by Agent from these menus or see all of the Agents from one report. 3. Selecting the Current For All Agents tab will show all jobs running for all agents. Waterford Technologies 2016 All Rights Reserved 31

32 4. Using the History For All Agents tab you can see the complete history of the jobs for all Agents. Waterford Technologies 2016 All Rights Reserved 32

33 Creating your SISCIN Keystore Important information regarding SISCIN Keystore The SISCIN Keystore is one of the more critical pieces of the system with regards to Archiving. When a file is encrypted the content is encrypted, the decryption key for this file must be stored somewhere for later use. It is stored in the SISCIN Keystore. The SISCIN Keystore is also used to track the single instance information within an archive volume. One file in the archive could for instance represent 2 original customer files, which may even have different names. The SISCIN Keystore also tracks this name mapping between the archive and source file(s). The SISCIN Keystore uses Microsoft Azure storage tables. It is fully redundant and has excellent scalability. It does not have a single point of failure and can scale infinitely. The SISCIN Keystore are Microsoft Azure Tables that are placed in the first Azure Storage Account that is defined in SISCIN. Do not use a test account or any other account that you plan on deleting later for the first account defined to SISCIN. Use an account that you plan on keeping forever as the first account. You could use a different storage account for test archives if necessary. Important: If this Azure Storage Account is deleted at any time ALL access to ALL Archived data regardless of Storage Account is lost. 1. Log onto your SISCIN account. Under your username click the dropdown menu and select Configuration > Archives. 2. If this is this is the first SISCIN Archive you are creating, you will be prompted to create your SISCIN Archive Keystore. Waterford Technologies 2016 All Rights Reserved 33

34 3. You can provide 2 different authentication methods to enable SISCIN to connect to Azure to create the Keystore. You can use either a Connection String or General Storage Account. Be careful as this information cannot be changed later. After you enter in your account information click Create. For more information regarding the SISCIN Keystore please refer to page 9. In the example below a General Storage Account is used for access to Azure Storage. Waterford Technologies 2016 All Rights Reserved 34

35 In the following example an Azure Connection String is used to access Azure Storage Waterford Technologies 2016 All Rights Reserved 35

36 Creating Archives - Connecting SISCIN to your Microsoft Azure General Storage account SISCIN can Archive your critical files from Servers and SAN Storage to the Microsoft Azure Cloud. In order for SISCIN to archive your files to the Microsoft Azure cloud you will need to have a Microsoft Azure General-purpose Storage Account. Once you have this storage account setup you can begin creating SISCIN Archives. You can have multiple SISCIN Archives and each SISCIN Archive can be configured with different redundancy options. An Archive can also be configured to span storage providers. Information on how to create a Microsoft Azure General-purpose Storage Account can be found at the following location: Information on Microsoft Azure Storage Pricing can be found at the following location: Important information regarding SISCIN Keystore The SISCIN Keystore is one of the more critical pieces of the system with regards to Archiving. When a file is encrypted the content is encrypted, the decryption key for this file must be stored somewhere for later use. It is stored in the SISCIN Keystore. The SISCIN Keystore is also used to track the single instance information within an archive volume. One file in the archive could for instance represent 2 original customer files, which may even have different names. The SISCIN Keystore also tracks this name mapping between the archive and source file(s). The SISCIN Keystore uses Microsoft Azure storage tables. It is fully redundant and has excellent scalability. It does not have a single point of failure and can scale infinitely. The SISCIN Keystore are Microsoft Azure Tables that are placed in the first Azure Storage Account that is defined in SISCIN. Do not use a test account or any other account that you plan on deleting later for the first account defined to SISCIN. Use an account that you plan on keeping forever as the first account. You could use a different storage account for test archives if necessary. Important: If this Azure Storage Account is deleted at any time ALL access to ALL Archived data regardless of Storage Account is lost. 1. Log onto your SISCIN account. Under your username click the dropdown menu and select Configuration > Archives. Waterford Technologies 2016 All Rights Reserved 36

37 2. If this is this is the first SISCIN Archive you are creating, you will be prompted to create your SISCIN Archive Keystore. If you have already created your SISCIN Keystore go to step 4.. Waterford Technologies 2016 All Rights Reserved 37

38 3. You can provide 2 different authentication methods to enable SISCIN to connect to Azure to create the Keystore. You can use either a Connection String or General Storage Account. Be careful as this information cannot be changed at a later date. After you enter in your account information click Create. For more information regarding the SISCIN Keystore please refer to page 9. In the example below a General Storage Account is used for access to Azure Storage. Waterford Technologies 2016 All Rights Reserved 38

39 In the following example an Azure Connection String is used to access Azure Storage. 4. Your SISCIN Keystore has been created. If your Keystore had already been created, you will be presented with a list of all your Archives. Click the +Create an Archive button to create a new Archive. Waterford Technologies 2016 All Rights Reserved 39

40 5. From the Create an Archive Wizard you will need to define your storage provider and the type of Archive you want. 6. First select your Archive Type. The types can be Single, Double, Split or Split R. Your storage provider can provide you with various redundancy options included with their storage offering. o o o o Single A Single Copy of each file is sent to one provider. A file can be in different Archives. Your storage provider can provide you with various redundancy options. Double Two separate copies of each file will be stored. Each file will be duplicated with a different storage provider. For example, one copy of the file could be sent to Microsoft Azure and the second copy is sent to Amazon. This is a high redundancy option. Split Two separate storage providers would be used and each file would be split between them. For example, one part of the file would go to Microsoft Azure and the other part to Amazon S3. This is a high security option. Split R Two separate storage providers would be used and each file would be split between them. One additional storage provider would be selected to provide additional redundancy. The most common Archive Type would be the Single unless the data requires additional redundancy or must have additional security. Waterford Technologies 2016 All Rights Reserved 40

41 7. Now you will need to configure your SISCIN Storage Pool provider. To archive files, SISCIN will need to have access to your Microsoft Azure or Amazon S3 Storage Account(s). From the Choose storage pools option use the drop-down menu and select Microsoft Azure. Click Next. 8. For SISCIN to Create an Archive using Microsoft Azure Storage, SISCIN must know your Microsoft Azure General-purpose Storage Account and its Key. Note: Information on how to create a Microsoft Azure General-purpose Storage Account can be found at the following location: Note: Information on Azure Storage Pricing can be found at the following location: Enter in your Azure General-purpose Storage Account and its Key. Waterford Technologies 2016 All Rights Reserved 41

42 Scroll down and enter the name of your archive in the Archive Name field. We recommend using something that is very descriptive as this information will be presented later when creating Archive Polices. For example: Completed Projects Archive. Then click Create Archive. Waterford Technologies 2016 All Rights Reserved 42

43 Creating Archives - Connecting SISCIN to Amazon Web Services (AWS) S3 Buckets SISCIN can Archive your critical files from Servers and SAN Storage to Amazon S3 Buckets. For SISCIN to archive your files to the Amazon S3 cloud you will need to have a Microsoft Azure General-purpose storage account for the SISCIN keystore, an AWS Account, create an Amazon S3 Bucket and setup your AWS Access Keys (Access Key ID and Secret Access Key). Once you have these storage accounts setup you can begin creating Amazon S3 SISCIN Archives. You can have multiple SISCIN Archives and each SISCIN Archive can be configured with different redundancy options. An Archive can also be configured to span storage providers. Create your Azure Account for the SISCIN Keystore Information on how to create a Microsoft Azure General-purpose Storage Account can be found at the following location: Information on Microsoft Azure Storage Pricing can be found at the following location: Important information regarding SISCIN Keystore The SISCIN Keystore is one of the more critical pieces of the system with regards to Archiving. When a file is encrypted the content is encrypted, the decryption key for this file must be stored somewhere for later use. It is stored in the SISCIN Keystore. The SISCIN Keystore is also used to track the single instance information within an archive volume. One file in the archive could for instance represent 2 original customer files, which may even have different names. The SISCIN Keystore also tracks this name mapping between the archive and source file(s). The SISCIN Keystore uses Microsoft Azure storage tables. It is fully redundant and has excellent scalability. It does not have a single point of failure and can scale infinitely. The SISCIN Keystore are Microsoft Azure Tables that are placed in the first Azure Storage Account that is defined in SISCIN. Do not use a test account or any other account that you plan on deleting later for the first account defined to SISCIN. Use an account that you plan on keeping forever as the first account. You could use a different storage account for test archives if necessary. Important: If this Azure Storage Account is deleted at any time ALL access to ALL Archived data regardless of Storage Account is lost. Waterford Technologies 2016 All Rights Reserved 43

44 Create your AWS Account for Archive Storage Information on how to create an Amazon Web Service Account can be found at the following location: Account.html Information on how to create an Amazon S3 Bucket can be found at the following location: Information on how to create an AWS IAM User Information on Amazon S3 Pricing can be found at the following location: 1. Log onto your SISCIN account. Under your username click the dropdown menu and select Configuration > Archives. 2. If this is this is the first SISCIN Archive you are creating, you will be prompted to create your SISCIN Archive Keystore in Microsoft Azure. If you have already created your SISCIN Keystore you can go to step 4. Waterford Technologies 2016 All Rights Reserved 44

45 . Waterford Technologies 2016 All Rights Reserved 45

46 3. You can provide 2 different authentication methods to enable SISCIN to connect to Azure to create the Keystore. You can use either a Connection String or General Storage Account. Be careful as this information cannot be changed at a later date. After you enter in your account information click Create. For more information regarding the SISCIN Keystore please refer to page 9. In the example below a General Storage Account is used for access to Azure Storage. 4. Your SISCIN Keystore has been created. If your Keystore had already been created, you will be presented with a list of all your Archives. Click the +Create an Archive button to create a new Archive. Waterford Technologies 2016 All Rights Reserved 46

47 5. From the Create an Archive Wizard you will need to define your storage provider and the type of Archive you want. 6. First select your Archive Type. The types can be Single, Double, Split or Split R. Your storage provider can provide you with various redundancy options included with their storage offering. o o o o Single A Single Copy of each file is sent to one provider. A file can be in different Archives. Your storage provider can provide you with various redundancy options. Double Two separate copies of each file will be stored. Each file will be duplicated with a different storage provider. For example, one copy of the file could be sent to Microsoft Azure and the second copy is sent to Amazon. This is a high redundancy option. Split Two separate storage providers would be used and each file would be split between them. For example, one part of the file would go to Microsoft Azure and the other part to Amazon S3. This is a high security option. Split R Two separate storage providers would be used and each file would be split between them. One additional storage provider would be selected to provide additional redundancy. The most common Archive Type would be the Single unless the data requires additional redundancy or must have additional security. Waterford Technologies 2016 All Rights Reserved 47

48 7. Now you will need to configure your storage provider. To archive files, SISCIN will need to have access to your Microsoft Azure or Amazon S3 Storage Account(s). Select the Use Your Storage option and select Amazon S3 Account 1. Click Next. 8. For SISCIN to Create an Archive using Amazon S3 Storage, SISCIN must know the following: The S3 Bucket Name An IAM User Key ID The IAM User Secret Key The Amazon Storage Region for the Bucket Waterford Technologies 2016 All Rights Reserved 48

49 Scroll down and enter the name of your archive in the Archive Name field. We recommend using something that is very descriptive as this information will be presented later when creating Archive Polices. For example: Completed Projects Archive. Then click Create Archive. Waterford Technologies 2016 All Rights Reserved 49

50 Creating Policies to Archive your files to your cloud storage SISCIN allows you create and run a wide variety of policies against your Windows server and SAN storage. Policies can only be applied to files within a WatchPoint. Once a Snapshot policy has completed for a WatchPoint you can create additional policies that can copy or move files to your Microsoft Azure Blob Storage or delete old files that no longer have any use in your organization. These policies can be very simple or be quite sophisticated with very complex criteria depending on the needs of your organization. Policy Types SISCIN offers five different policy types. They are Archive, Archive & Delete, Archive & Enhanced Stub, Archive & OnDemand Stub, Delete and Snapshot. The Snapshot policy type has already been cover in a previous section. Archive Policy The SISCIN Archive Policy Type will copy files that meet your selection criteria to your Microsoft Azure Blob storage. When the job runs for this policy type, files are encrypted, compressed and then copied to the specific SISCIN Archive that you define in the policy, but not stubbed or deleted from storage. Files that have been archived can be restored using the SISCIN Explorer in the event that they are deleted from Server or SAN storage. Archive & Delete Policy The Archive & Delete Policy Type will copy files that meet your selection criteria to your Microsoft Azure Blob storage. Once they are safety stored in your SISCIN Archive they will be deleted from Server or SAN storage. When the job runs for this policy type, files are encrypted, compressed and then copied to the specific SISCIN Archive that you define in the policy, but not stubbed. Files are only deleted from storage after the file has been archived. Files that have been archived can be restored using the SISCIN Explorer. Waterford Technologies 2016 All Rights Reserved 50

51 Archive & Enhanced Stub Policy The Archive & Enhanced Stub Policy type will copy files that meet your selection criteria to your Microsoft Azure Blob Storage or Amazon S3 Storage based on the Archive type. Once they are safety stored in your SISCIN Archive the files will be replaced with a SISCIN Enhanced Stub Link. When the User opens an Enhanced Stub, they will be presented a SISCIN web page with information related to the file, all the generations of that file in their archive(s) and the ability to save the file in the current location, overwriting the stub link or place it in a new location, along with other features as specified by the business. By Default, this feature is disabled so it must be enabled. Enabling the Enhanced Stub Policy Type To enable, the Enhanced Stub Policy type go to the Configuration Menu under your name on the tool bar, and select Stubs. Click the Enable Enhanced stubs check box and if desired select the Show advanced options check box. Then click Save. Waterford Technologies 2016 All Rights Reserved 51

52 Enhanced Stub Example In this example, the user has opened an Enhanced Stub link for a file named DBuild.zip. They are present with a SISCIN web page with the latest version information about this file. From the Quick Restore tab they can restore the latest file by clicking the Restore Latest button. Using the Advanced tab, the user can view and select different versions of the file to restore that have been archived. They can also restore the file to an alternative location under Options. If desired they can request an when the file is restored. This is useful when restoring very large files from your Cloud archive. Waterford Technologies 2016 All Rights Reserved 52

53 Archive & OnDemand Stub Policy The Archive & OnDemand Policy Type will copy files that meet your selection criteria to your Microsoft Azure Blob storage or Amazon S3 Storage. Once they are safety stored in your SISCIN Archive the files will be replaced with a SISCIN Stub Link. When the job runs for this policy type, files are encrypted, compressed and then copied to the specific SISCIN Archive that you define in the policy and then stubbed. Files are not stubbed on storage until after the file has been archived. Files that have been archived can be restored using the SISCIN Explorer if the stub is deleted from Windows or SAN storage. Delete Policy The Delete Policy Type will delete files on your Windows Servers or SAN Storage that meet your selection criteria. THIS POLICY TYPE DOES NOT ARCHIVE FILES. ANY FILE THAT IS NOT IN ALREADY IN THE ARCHIVE AFTER THIS POLICY HAS RUN CANNOT BE RESTORED. Creating an Archive & OnDemand Policy In this section, we will go through the process of creating a SISCIN Policy that will Archive files to your SISCIN Cloud Archive and then Stub the files on your Windows Server or SAN Storage. The other policy types are created in the same manner using a Wizard for that specific policy type. SISCIN Polices are defined under the Agents menu. Select the Agent from the menu or drop-down list, click the Policies tab and then click the +Add a Policy button to start the Policy Creation Wizard. From the Action Type, drop-down list select the Archive & OnDemand Stub. Then select the WatchPoint or WatchPoints that are defined to the Agent. Selecting multiple WatchPoints will automatically generate multiple polices using the same criteria when the Wizard completes. This can be very helpful when you are creating the same policy criteria for multiple WatchPoints. Click Next. Waterford Technologies 2016 All Rights Reserved 53

54 In this step in the SISCIN Policy Wizard you will need to select the Cloud Archive where SISCIN will copy your files. Enter in a good Policy Description as this will be displayed when the Job for this policy is executing. From the Archive Volume, drop-down list select the appropriate Archive Volume. In this example, the Old Documents Archive has been selected. If you want to confirm the job before it executes you will need to select the Require confirmation before executing? option. You will be able to confirm or reject the job and review a summary of what types of files the job will target if executed. Click Next. Now you need to define your Policy Criteria. This criterion is very important as it determines which files will be acted upon by your policy. You will need to decide if this policy is to apply to All files in the WatchPoint, if you want to use a previously Saved Filter or Create a new filter. In most cases, you will either use a saved filter or create a new filter. In this example, we will select Create new filter. Waterford Technologies 2016 All Rights Reserved 54

55 Waterford Technologies 2016 All Rights Reserved 55

56 If you plan on reusing the criteria used in the creation of this Policy, we would recommend that you select the Save for reuse option. This will let you use these same criteria in other policies. In this example, we have named this filter Archive Old Files. Filter Options Now you will need to create your filter criteria. Filters can be applied against multiple file attributes. Filter can also be applied in Groups. In addition, your filter criteria can be evaluated using Boolean operations. For example, you might want to Archive & Stub all files with a PDF extension and that have a last modified date older than 2 years. Waterford Technologies 2016 All Rights Reserved 56

57 File Name Filter The File Name Filter evaluates the name of the file. You can use the exact name, names that begin with, files that contain a name, or a variety of options. This feature does not support wild cards. The begins with, ends with and contains work like wild card characters. File Path Filter The File Path Filter evaluates a folder path. You can use the exact paths, paths that begin with, paths that contain certain character or a variety of other options. In order to include all sub folders under a path you will need to use the criteria begins with or contains. This feature does not support wild cards. The begins with and contains work like wild card characters. Lists of folders in the is one of and is not one of options are separated by commas. Waterford Technologies 2016 All Rights Reserved 57

58 File Extension Filter The File Extension Filter evaluates file extensions. You can use the exact extensions (equal), extensions that begins with, a list of extensions (is one of), extensions that contains certain characters, or a variety of options. This feature does not support wild cards. The begins with and contains options work like wild card characters. Lists of extensions are separated by commas. You do not have to put the dot before the extension. Waterford Technologies 2016 All Rights Reserved 58

59 File Owner Filter The File Owner Filter evaluates the owner of a file. You can use the exact owners, owners that begins with, a list of owners (is one of), owners that contain certain characters, or a variety of options. This feature does not support wild cards. The begins with and contains options work like wild card characters. Lists of owners (is one of) are separated by commas. File Size Filter The Size Filter evaluates file by their size in MB. You can use the exact size, or a variety of options. This feature does not support wild cards. Waterford Technologies 2016 All Rights Reserved 59

60 Age Filter Age Filters evaluates files by their age. Evaluation can be Last Accessed Date, Last Modified Date and Creation Date. Days, Months and Years can be used as criteria. Date Filter Age Filters evaluates files by their age using calendar dates. Evaluation can be Last Accessed Date, Last Modified Date and Creation Date. A calendar date is used as criteria. Waterford Technologies 2016 All Rights Reserved 60

61 Archived Filter Archived Filters evaluates files whether or not they have been archived. Simple Filter Example Waterford Technologies 2016 All Rights Reserved 61

62 Multi-Criteria Filter Example Complex Filter Example Waterford Technologies 2016 All Rights Reserved 62

63 Complex Filter using Groups Example In this Archive & OnDemand Stub Policy we will be using the following criteria. Archive all extensions that meet the criteria in the list that have not been modified in at least 2 years. Click Next. We recommend keeping policies simple to start. Targeting specific types of files is recommended. You can always add more extensions to the list. It is also recommended that you not start out too aggressively when using time as criteria. You don t want to have to spend time restoring files that have been inadvertently archived as this can be time consuming and expensive. Waterford Technologies 2016 All Rights Reserved 63

64 Now you need to determine when the job for this policy will run. When you set a specific schedule, SISCIN automatically creates a job for the policy. If you select None then no job will be created. This option should be used when creating policies that you don t want to run which is ideal in the planning stages. Selecting Now will create a job and it will start running as soon as the Submit button is clicked. Selecting One Time will create a job and it will start running on the date and time specified. Click Submit to create the policy and schedule the job. Selecting Every X Hours will create a job and it will start running immediately and then again every x hours. This option should be used only on WatchPoints and folders with a moderate number of files. Waterford Technologies 2016 All Rights Reserved 64

65 You want to make sure that the policy will finish executing before the next one starts. Click Submit to create the policy and schedule the job. Selecting Daily will create a job that will run once a day at a specific time. This option should be used only on WatchPoints and folders with a moderate number of files. You want to make sure that the Policy will finish executing before the next one starts. Click Submit to create the policy and schedule the job. Waterford Technologies 2016 All Rights Reserved 65

66 Selecting Weekly will create a job that will run on a specific day of the week at a specific time. This is the recommended Schedule Type as it has the lowest impact on network performance. Click Submit to create the policy and schedule the job. After you click Submit you will see the newly created Policy, its Action Type and the filter it uses. You will also see when it is scheduled. If you click the Manage Filters link you will see the Policy Filters report. Waterford Technologies 2016 All Rights Reserved 66

67 Confirming or Rejecting a Job Execution If you used the Require confirmation before executing? option on your policy, you will need to confirm or reject the job before it will execute. We recommend that you use this option the first time any new policy is executed. You can do this from the Dashboard, the Agents report or Job Status Reports. From the Current Jobs queue you will see the following status for any jobs requiring confirmation. Clicking the link will take you to the Status History for a Job report. On this report you will see three tabs Confirm Job, Reject Job and Summary. We strongly recommend that unless you know that your criteria are perfect that you click the Summary tab. The Policy Job Summary report will allow you to double check your policy criteria and make sure that it is doing what you expected. Verify that the results for File Types and Date Criteria matches your policy. If everything looks correct, click Confirm Job. If you see anything that causes you concern click Reject Job. Waterford Technologies 2016 All Rights Reserved 67

68 Setting Up SISCIN System Notifications SISCIN can be configured to send notifications for a variety of events. This is strongly recommended. The Notifications setup can be found on the Configuration > Notifications report. SISCIN Notifications can be configured for the following events: To add a notification recipient, click the Manage Recipients button. Waterford Technologies 2016 All Rights Reserved 68

69 Then click Create new recipient button. Enter the users address and a description. Distribution lists are not supported as SISCIN does not have access to your environment. Then click Create. Click Edit Subscription on the desired notification. Then click the user under Add Recipients. This will add the user to the notification. Waterford Technologies 2016 All Rights Reserved 69

70 The selected user has now been added to the Notifications list. Waterford Technologies 2016 All Rights Reserved 70

71 Manage your files with SISCIN Explorer The SISCIN Storage Explorer provides an easily recognizable Folder / File tree user interface to navigate information in WatchPoints. You can navigate through a WatchPoints folders and files just like you would on a server. You can drill down to see more details, export file / folder information, and analyze the file information within a specific folder or entire folder tree (subdirectories). You can also Archive, Restore Files and Folder and Delete files from your Server or SAN storage. More information about How to use the SISCIN Storage Explorer can be found in the SISCIN Reporting Guide. Waterford Technologies 2016 All Rights Reserved 71

72 How to Archive files manually to your SISCIN Cloud Archive Not only can files be Archived to your Microsoft Azure Storage Cloud using policies you manage, they can also be Archived manually using the SISCIN Explorer. The SISCIN Explorer is accessed from the main menu. You can select individual Server Agents and the WatchPoints defined on them. You cannot manually stub a file in this fashion. Click Explore and then the Agent and if desired you can go directly to the WatchPoint. Using the SISCIN Explorer Tree navigate to the folder that contains the files you want to Archive. Waterford Technologies 2016 All Rights Reserved 72

73 In the right pane you will see a File Report for the Folder that you selected. Select the file that you want to archive using the Check Box in front of the File Name. Multiple Files can be selected from the same page. You cannot select multiple pages. If you need more files displayed, you will need to expand the size of the report. Now click the Actions button. Select Archive from the list. Waterford Technologies 2016 All Rights Reserved 73

74 From the Archive File Report select the Archive Volume that you are going to place the file. Click Yes, archive. A new job will be submitted to Archive the file. You can click on the status link to review the Job details. After the job completes there will be an icon of a cloud to the right of the file. This will indicate that the file has been Archived. You cannot stub a file in this fashion. Waterford Technologies 2016 All Rights Reserved 74

75 How to Restore Files from your SISCIN Cloud Archive The SISCIN Explorer enables you to restore files from your archives in the event that they get accidentally deleted, you need to restore an old file or if you want to replace stubbed files. Files can be restored individually or by folder. Restore by Folder The SISCIN Explorer is accessed from the main menu. You can select individual Server Agents and the WatchPoints defined on them. You cannot manually stub a file in this fashion. Click Explore and then the Agent and if desired you can go directly to the WatchPoint. Navigate to the folder that contains the files that you want to restore. From the Action drop down menu select Restore Directory. Waterford Technologies 2016 All Rights Reserved 75

76 From the Restore Directory Wizard verify the FolderPath is correct. Then select the type of restore you want to perform. You can do a Full Restore, Quick Restore with Enhanced Stubs or a Quick Restore with OnDemand Stubs. The Quick Restore option will restore files as stub links. Select the options that you need. If you need to restore files that have been deleted, select the Restore Deleted Files option. If you need to overwrite files that already exist, for example stubbed files, select the Overwrite Existing Files option. If you need to restore all the files in all sub directories under the folder you selected, select the Restore Subdirectories option. If you want to restore files to a different folder location, use the Restore To Alternate Location option. Click Yes, Restore. A new job will be submitted to Restore the folders and the files in the selected folders. You can click on the Status link to review the job details. Waterford Technologies 2016 All Rights Reserved 76

77 Restore by File The SISCIN Explorer is accessed from the main menu. You can select individual Server Agents and the WatchPoints defined on them. Click Explore and then the Agent and if desired you can go directly to the WatchPoint. Navigate to the folder that contains the files that you want to restore. Waterford Technologies 2016 All Rights Reserved 77

78 Select the file you want to restore. From the Action drop-down menu select Restore. Waterford Technologies 2016 All Rights Reserved 78

79 From the Restore Wizard verify the FullFilePath is correct. Then select the type of Restore you want to do. You can do a Full Restore, Quick Restore with Enhanced Stubs or a Quick Restore with OnDemand Stubs. The Quick Restore option will restore files as stub links. Select the options that you need. If you need to overwrite files that already exist, for example stubbed files, select the Overwrite Existing Files option. If you need to restore all of the files in all sub directories under the folder you selected select the Restore Subdirectories option. If you want to restore files to a different location use the Restore To Alternate Location option. Click Yes, Restore. A new job will be submitted to Restore the files in the selected folders. You can click on the Status link to review the Job details. Waterford Technologies 2016 All Rights Reserved 79

80 How to use SISCIN Explorer to Delete Files The SISCIN Explorer enables you to delete old and undesired files from your servers or storage devices quickly and easily. The SISCIN Explorer is accessed from the main menu. You can select individual Server Agents and the WatchPoints defined on them. You cannot manually stub a file in this fashion. Click Explore and then the Agent and if desired you can go directly to the WatchPoint. Navigate to the folder that contains the files that you want to delete. Waterford Technologies 2016 All Rights Reserved 80

81 Select the file you want to Delete. From the Action drop down menu select Delete. Waterford Technologies 2016 All Rights Reserved 81