Microsoft Azure Blob Storage to Alation Integration

Transcription

1 Microsoft Azure Blob Storage to Alation Integration By Information Asset Created By: Melvin Pereira Version: Status: Draft Last Update Date: 6/8/ :54 AM

2 Table of Contents 1 Introduction Prerequisites and Compatibility Installation Instructions Deploy Microsoft Azure Blob Storage to Alation Identify your Alation File System Configuration Upgrade Instructions Change log for Microsoft Azure Blob Storage to Alation Features Fixed Issues Known Issues Support Information Page 2 of 12

3 1 Introduction The Microsoft Azure Blob Storage to Alation Data Catalog solution leverages the java platform to integrate between Microsoft Azure Blob Storage and Alation. 2 Prerequisites and Compatibility Microsoft Azure Blob Storage to Alation solution requires following prerequisites and it is compatible with these software components: Table 1: Microsoft Azure Blob Storage 2Alation Prerequisites and Compatibility. COMPONENT NAME VERSION Alation 5 Java 8 Microsoft Azure Blob Storage Before attempting to run the integration make sure you have: Alation License. Alation Host. Alation File System ID. Alation API Token id. Azure Store Account. Azure Store Account Key. 3 Installation Instructions 3.1 Deploy Microsoft Azure Blob Storage to Alation Download the JAR file and the example.properties file to any location. 3.2 Identify your Alation File System The Microsoft Azure Blob Storage to Alation integration will create respective objects under a file system in Alation. Please obtain the ID of your file system or create a new one by: 1. Sign in to Alation as a user with Admin access. 2. In the top right of the screen, select Admin, then Settings. Note: If you do not see the Admin option in the menu, your user does not have Admin access. Page 3 of 12

4 Figure 1: Settings in Admin. 3. Select Add, then File System. Figure 2: Select file system. Page 4 of 12

5 4. Enter the Name of your file system. File system type is HDFS by default. Figure 3: Enter Name of file system. Page 5 of 12

6 5. Click on Add File System button. Figure 4: Click on Add File System. 6. Note the File System ID. Figure 5: File system ID. Page 6 of 12

7 4. Configuration Update the example.properties file with the configuration information of your Microsoft Azure Blob Storage and Alation instances. Open the properties file (example.properties) you downloaded with the solution and update the values with your information. Table 2: Microsoft Azure Blob Storage 2 Alation arguments. Name license azurestoreaccount azurestoreaccountkey alation.host alationfilesystemid alation.api Token alation.protocol Description Valid license to run the integration. Your name for Azure storage Account. This is the Access key to authenticate your application when making request to Azure Storage Account. Host of Alation. ID of File System created in Alation. API token for logging to Alation. Protocol for Alation. 1. To run the program, execute the following command from Windows Command Prompt a Linux/Unix shell, updating the highlighted portions as necessary depending on where you downloaded the JAR file and the example.properties file. 2. Note: The file path should not have folder names with space in it. Page 7 of 12

8 Command : java -cp C:\Users\hp\Desktop\azureblobstr2ala jar com.informationasset.alation.azureblob.main C:\Users\hp\Desktop\example.properties 3. You should see output. Don t close the window until control returns (i.e. you can type again as in the screenshot below). Figure 6: Executing command in Command prompt. Page 8 of 12

9 4. Return to Alation. Click on the title of your File System ( AzureBlobStr2Ala in the screenshot below). It is a hyperlink that should take you to the projects that were just imported from Microsoft Azure Blob Storage. Figure 7: Projects hyperlink. 5. You should see the Storage Account of Microsoft Azure Blob Storage in Alation. Figure 8: Contents. Page 9 of 12

10 6. Click on the Content(Folder). You should see the Containers of Microsoft Azure Blob Storage in Alation. Figure 9: List of Contents in Folder. 7. You should see file of one of the Container of Microsoft Azure Blob Storage in Alation. Figure 10: CSV file in Alation. Page 10 of 12

11 8. You should see data of that file from Microsoft Azure Blob Storage as a Description in Alation. Figure 11: Data in CSV file. Page 11 of 12

12 5. Upgrade Instructions Since this is the initial release of the solution, the upgrade from earlier release is not available. 6. Change log for Microsoft Azure Blob Storage to Alation Features Following are the features included in this package: Loads file of types CSV, JSON, XML, Parquet, and Avro from Azure Blob Storage to Alation. 6.2 Fixed Issues Following issues haven been fixed in this release: N/A 7 Known Issues This section covers issues and problems that are known: N/A 8 Support Information For further information or additional queries about Information Asset s Microsoft Azure Blob Storage to Alation please reach-out to our sales team at sales@information-asset.com or visit our website at Page 12 of 12