SAS Data Loader 2.4 for Hadoop

Transcription

1 SAS Data Loader 2.4 for Hadoop vapp Deployment Guide SAS Documentation

2 The correct bibliographic citation for this manual is as follows: SAS Institute Inc SAS Data Loader 2.4 for Hadoop: vapp Deployment Guide. Cary, NC: SAS Institute Inc. SAS Data Loader 2.4 for Hadoop: vapp Deployment Guide Copyright 2016, SAS Institute Inc., Cary, NC, USA All rights reserved. Produced in the United States of America. For a hard-copy book: No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, or otherwise, without the prior written permission of the publisher, SAS Institute Inc. For a web download or e-book: Your use of this publication shall be governed by the terms established by the vendor at the time you acquire this publication. The scanning, uploading, and distribution of this book via the Internet or any other means without the permission of the publisher is illegal and punishable by law. Please purchase only authorized electronic editions and do not participate in or encourage electronic piracy of copyrighted materials. Your support of others' rights is appreciated. NOTICE: This documentation contains information that is proprietary and confidential to SAS Institute Inc. It is provided to you on the condition that you agree not to reveal its contents to any person or entity except employees of your organization or SAS employees. This obligation of confidentiality shall apply until such time as the company makes the documentation available to the general public, if ever. The scanning, uploading, and distribution of this book via the Internet or any other means without the permission of the publisher is illegal and punishable by law. Please purchase only authorized electronic editions and do not participate in or encourage electronic piracy of copyrighted materials. Your support of others' rights is appreciated. U.S. Government License Rights; Restricted Rights: The Software and its documentation is commercial computer software developed at private expense and is provided with RESTRICTED RIGHTS to the United States Government. Use, duplication or disclosure of the Software by the United States Government is subject to the license terms of this Agreement pursuant to, as applicable, FAR , DFAR (a), DFAR (a) and DFAR and, to the extent required under U.S. federal law, the minimum restricted rights as set out in FAR (DEC 2007). If FAR is applicable, this provision serves as notice under clause (c) thereof and no other notice is required to be affixed to the Software or documentation. The Government's rights in Software and documentation shall be only those set forth in this Agreement. SAS Institute Inc., SAS Campus Drive, Cary, North Carolina Printing 1, January 2016 SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. indicates USA registration. Other brand and product names are trademarks of their respective companies. Other brand and product names are trademarks of their respective companies. SAS software might be provided with certain third-party software, including but not limited to open-source software, which is licensed under its applicable third-party software license agreement. A listing of this third-party software may be found at thirdpartylicenses. With respect to CENTOS third-party technology included with the vapp ( CENTOS ), CENTOS is open source software that is used with the Software and is not owned by SAS. Use, copying, distribution and modification of CENTOS is governed by the CENTOS EULA and the GNU General Public License (GPL) version 2.0. The CENTOS EULA can be found at A copy of the GPL license can be found at or can be obtained by writing to the Free Software Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA USA. The source code for CENTOS is available at vault.centos.org/. With respect to open-vm-tools third-party technology included in the vapp ("VMTOOLS"), VMTOOLS is open source software that is used with the Software and is not owned by SAS. Use, copying, distribution and modification of VMTOOLS is governed by the GNU General Public License (GPL) version 2.0. A copy of the GPL license can be found at or can be obtained by writing to the Free Software Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA USA. The source code for VMTOOLS is available at With respect to VIRTUALBOX third-party technology included in the vapp ("VIRTUALBOX"), VIRTUALBOX is open source software that is used with the Software and is not owned by SAS. Use, copying, distribution and modification of VIRTUALBOX is governed by the GNU General Public License (GPL) version 2.0. A copy of the GPL license can be found at or can be obtained by writing to the Free Software Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA USA. The source code for VIRTUALBOX is available at

3 Contents Chapter 1 Introduction About This Guide Related Guides What s New Do You Want to Migrate from a Previous Release? Chapter 2 First Steps A Few Tips Before You Start Step 1: View System Requirements Step 2: Copy Files to Your Machine Step 3: Configure the vapp to Use Kerberos Authentication Step 4: Review the Hadoop Configuration Settings Next Step Chapter 3 Set Up the vapp Using Oracle VM VirtualBox Before You Begin Step 1: Configure SAS Data Loader as a Virtual Machine Step 2: Start SAS Data Loader Next Steps Chapter 4 Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro Before You Begin Step 1: Configure SAS Data Loader as a Virtual Machine Step 2: Start SAS Data Loader Next Steps Chapter 5 Migrate from a Previous Release What Gets Migrated? Tips for Success Migrate from Release Migrate from Release Next Steps Chapter 6 Administration Tasks Tips for Running the vapp Start SAS Data Loader Power Off the vapp Check for vapp Updates Manage Your License Back Up and Restore Configuring a New Version of Hadoop Enable Logging and Download Log Files Appendix 1 Downloading the vapp with SAS Download Manager Appendix 2 Browser Configuration to Support Integrated Windows Authentication Appendix 3 Troubleshooting Support Community Troubleshooting Tips

4 iv Contents Recommended Reading

5 1 1 Introduction About This Guide Related Guides What s New Do You Want to Migrate from a Previous Release? About This Guide Thank you for choosing SAS Data Loader for Hadoop. This guide shows you how to set up SAS Data Loader for Hadoop running as a virtual machine, or vapp, on your computer. Anyone who installs business client software can use this guide. To deploy the vapp successfully, you need files from SAS and a supported hypervisor. The files from SAS are the vapp, and a vendor, such as VMware or Oracle, provides the hypervisor software that you use to set up and run the vapp. This guide covers the vapp deployment for the following delivery options: SAS Data Loader 2.4 for Hadoop SAS Data Loader 2.4 for Hadoop, Cloudera SAS Data Loader 2.4 for Hadoop, Hortonworks Related Guides Additional guides are available from the SAS Data Loader documentation page. Business analysts and data stewards can refer to the SAS Data Loader for Hadoop: User's Guide for information about configuring and using directives. Guides for system and Hadoop administrators are available. Before you can complete the vapp deployment, an administrator must perform steps to install and configure SAS software on the Hadoop cluster. If you need additional help with deploying or administering the SAS Data Loader for Hadoop, the support community is a great place to find answers. SAS Data Management

6 2 Chapter 1 / Introduction Join the community to ask questions and receive expert online support. What s New For information about new features and enhancements, see SAS Data Loader for Hadoop: User's Guide Do You Want to Migrate from a Previous Release? Migrating enables you to use saved information, such as saved directives and profiles, with a newer version of SAS Data Loader. For more information, see Chapter 5, Migrate from a Previous Release, on page 43.

7 3 2 First Steps A Few Tips Before You Start Step 1: View System Requirements Step 2: Copy Files to Your Machine vapp License File Hadoop Configuration Files Step 3: Configure the vapp to Use Kerberos Authentication Tips for Success Configure the vapp to Authenticate with MIT Kerberos Get Kerberos Settings from Your Administrator Download the JCE Unlimited Strength Jurisdiction Policy Files Step 4: Review the Hadoop Configuration Settings Next Step A Few Tips Before You Start Read this section first to understand which files are required on your machine before you can set up the vapp. Before you can set up the vapp, you must copy files to your machine. Consider copying the files to a folder on your machine that is named for the version of SAS Data Loader that you are deploying (for example, C: \SASDataLoader\2.4\). SAS sends an to your business or organization that includes information about the software order. This includes the license file as an attachment, which you will need to set up the vapp. Contact your Hadoop administrator and Kerberos administrator to obtain required information. o o o Your Hadoop administrator collects folders and settings that you need to set up the vapp. If the Hadoop environment that you will connect to uses Kerberos authentication, additional steps are required when you set up the vapp. Find out which Hadoop distribution is used, such as Cloudera CDH, Hortonworks HDP, or MapR Distribution.

8 4 Chapter 2 / First Steps Step 1: View System Requirements To view complete system requirements, including supported hypervisors, and hardware and web browser support, see: /PDF/default/sreq.pdf Step 2: Copy Files to Your Machine The following files and folders are required on your machine. vapp The vapp that you receive from SAS is based on your software order and the hypervisor that you intend to use. If you use a supported version of Oracle VM VirtualBox, refer to the following information. For Oracle VM VirtualBox The vapp is an OVA file The vapp file is named: dataloader-virtualbox.ova (OVA file). The Software Order from SAS contains a link to download the software using SAS Download Manager. Refer to Downloading the vapp with SAS Download Manager on page 61 for instructions. After you download the software, locate the OVA file in the following location of your SAS Software Depot: SAS_Data_Loader_for_Hadoop\2.4\VirtualBox \dataloader-virtualbox.ova.

9 Step 2: Copy Files to Your Machine 5 If you use a supported hypervisor by VMware, refer to the following information. For VMware Player Pro, Workstation, and Workstation Pro vapp files are packaged in a ZIP file How to get the ZIP file The vapp files are packaged in a file named: dataloader-vmware.zip (ZIP file). Extract files from the ZIP file to a folder on your machine (for example, C:\SASDataLoader\2.4\). All files in the ZIP file are required. o o If you use WinZip, right-click the ZIP file, and select Open with WinZip. In the WinZip application, click Unzip. If you do not use WinZip, right-click the ZIP file, and select Extract All. Note: The ZIP file contains the file that you open in your hypervisor, which is named SAS_Data_Loader_for_Hadoop.vmx (VMX file). How you get the ZIP file depends on your software order. Your Hadoop administrator might provide the ZIP file in a User folder and share it on a network server where you can copy it to your local drive. If you received a Software Order that contains a link for using SAS Download Manager, refer to Downloading the vapp with SAS Download Manager on page 61. After you download the software, locate the ZIP file in the following location of your SAS Software Depot: SAS_Data_Loader_for_Hadoop\2.4\VMWarePlayer \dataloader-vmware.zip. If the software was ordered from the SAS Store, a link to download the file is available from the SAS Store. License File The license file entitles you to use SAS Data Loader for Hadoop. License File Filename SAS_vApp_order-number_license.txt Where to get the file Copy to your machine Your SAS contact or Hadoop administrator might provide this file to you. SAS sends the license file to your business or organization as an attachment to an . Also, the file is located in the sid_files subdirectory where the SAS Data Loader software is downloaded. Note: The license file is also referred to as the SAS installation data file (SID). Copy the file to a folder on your machine (for example, C: \SASDataLoader\2.4\).

10 6 Chapter 2 / First Steps Hadoop Configuration Files The Hadoop configuration files enable the vapp to connect to the Hadoop cluster. Hadoop Configuration Files and Folders Folder names and structure The files are provided in two folders named conf and lib, and they must be copied to a folder on your machine named SASWorkspace\hadoop as shown below. The folder names are case-sensitive and must be spelled as shown. If necessary, use Windows Explorer to create the SASWorkspace\hadoop folder before you copy the folders. An example of the directory structure is C:\SASDataLoader \2.4\SASWorkspace\hadoop\ Where to get the files Ask your Hadoop administer for the files. Your Hadoop administrator might provide the folders in a User folder and share it on a network server where you can copy it to your local drive. Note: SAS Data Loader for Hadoop contains sensitive information. Protect any directories used by SAS Data Loader and the hypervisor software by making them accessible only to you. Step 3: Configure the vapp to Use Kerberos Authentication Perform the steps in this section if you plan to connect to a Hadoop environment that uses Kerberos authentication. If your Hadoop environment does not use Kerberos authentication, skip this step. Tips for Success Perform the steps in this section, as required, before you set up the vapp in the hypervisor. Consult with your Kerberos administrator to get the host name that was set up for your machine, and the values for required Kerberos settings on page 8. Kerberos systems that are available for Hadoop environments are Windows Active Directory (Active Directory) and MIT.

11 Step 3: Configure the vapp to Use Kerberos Authentication 7 o o If you are using MIT Kerberos for authentication, instructions are provided below to run the ksetup command to acquire tickets for your machine from the correct Kerberos realm. If you are using Active Directory only for authentication, no additional configuration is provided in this guide. Instead, your Kerberos administrator can refer to the SAS In-Database Products: Administrator's Guide for more information. Configure the vapp to Authenticate with MIT Kerberos TIP Consult with your Kerberos administrator to determine whether MIT Kerberos or MIT Kerberos for Windows is used. To protect the vapp using MIT Kerberos or if MIT Kerberos for Windows is used, you must configure your machine to acquire tickets for the vapp from the correct realm. Refer to the following options to configure your machine. If MIT Kerberos is used with client authentication performed through native Active Directory, run ksetup to add a Kerberos Key Distribution Center (KDC) and to assign the vapp host name to that KDC. For example, you might issue the following commands: ksetup /AddKdc KRB.ZZZ.COM kdcserver.zzz.com ksetup /AddHostToRealmMap dltest1.vapps.zzz.com KRB.ZZZ.COM where KRB.ZZZ.COM is the name of the Kerberos realm, kdcserver.zzz.com is the host machine of the KDC server, and dltest1.vapps.zzz.com is the host name used on the vapp client machine. If client authentication is performed through MIT Kerberos for Windows, modify the Kerberos configuration file to add the vapp host name to the Kerberos client domain realm mapping. 1 In Notepad, open the Kerberos configuration file. Typically, you can find this file at the following location: C:\ProgramData\MIT\Kerberos5\krb5.ini 2 Create the mapping. For example, you might enter the following: [libdefaults] #default realm settings [realms] KRB.ZZZ.COM = { kdc = kdcserver.zzz.com } [domain_realm] dltest1.vapps.zzz.com = KRB.ZZZ.COM where KRB.ZZZ.COM is the name of the Kerberos realm, kdcserver.zzz.com is the host machine of the KDC server, [domain_realm] is the header, and dltest1.vapps.zzz.com is the host name used on the vapp client machine. 3 Save the file and exit Notepad.

12 8 Chapter 2 / First Steps Get Kerberos Settings from Your Administrator When you set up the vapp, you must enter values for settings in the following table. These settings are displayed in the Settings dialog box in the SAS Data Loader: Information Center. TIP Ask your Kerberos administrator for the following settings. Field Host name User ID Kerberos Realm Kerberos Configuration File Host keytab file SAS server keytab file HTTP keytab file Value The host name portion of the Kerberos service principal names (SPN) created for the vapp. For example, if host/dltest1.vapps.zzz.com was created in the KDC for the vapp, use dltest1.vapps.zzz.com. The user name (for example, user1), and not the full user principal, such as user1@krb.zzz.com. The name of the Kerberos realm or AD domain against which the user authenticates. The location of the Kerberos configuration file. The location of the keytab generated for the host SPN. The location of the keytab generated for the SAS server SPN. The location of the keytab generated for the HTTP SPN. Download the JCE Unlimited Strength Jurisdiction Policy Files Note: Perform the following steps if the Java Cryptography Extension (JCE) local policy and US export policy files are not installed on your machine. These files are two JAR files that are packaged in a ZIP file that you download from Oracle at the following web page: download html Download the ZIP file, and then refer to the README for instructions on extracting the files to your machine. TIP Remember the location of these files. During the vapp setup, you enter the location of the two files to configure Kerberos authentication.

13 Step 4: Review the Hadoop Configuration Settings 9 Step 4: Review the Hadoop Configuration Settings During the vapp setup, you might have to enter values to configure the vapp and your machine to connect to the Hadoop environment. TIP When you set up the vapp, values for many settings are provided for you. In most cases, you can accept the defaults without changing the settings. Setting Hive server host Port number User ID and Password Oozie URL Impala server host Impala server port Details The fully qualified network name of the HiveServer2 for your Hadoop cluster. The port number of the HiveServer2 for your Hadoop cluster. The user name and password that SAS Data Loader for Hadoop uses to connect to the Hadoop server. Note: These settings are required if your Hadoop environment does not use Kerberos for authentication. The HTTP address of the Oozie web console (for example, which is an interface to the Oozie server. Oozie is a workflow scheduler in Hadoop that manages the execution of jobs. SAS Data Loader uses Oozie to copy data to and from databases such as Oracle and Teradata. Note: An Oozie URL is required if you want to use the Copy Data to Hadoop and Copy Data from Hadoop directives to move data between Hadoop and another data source. Additional configuration is required to use the directives. For more information, see SAS Data Loader for Hadoop: User's Guide. The fully qualified host name for the optional Impala server on your Hadoop cluster. Note: To increase performance, the Impala server is used by certain SAS Data Loader directives instead of Hive, and additional configuration is required. For information about how to enable support for Impala, see SAS Data Loader for Hadoop: User's Guide. The number of the port on the Impala server that receives client connection requests.

14 10 Chapter 2 / First Steps Next Step Do one of the following: Go to Chapter 3, Set Up the vapp Using Oracle VM VirtualBox, on page 11 to complete the deployment. Go to Chapter 4, Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro, on page 27 to complete the deployment.

15 11 3 Set Up the vapp Using Oracle VM VirtualBox Before You Begin Step 1: Configure SAS Data Loader as a Virtual Machine Step 2: Start SAS Data Loader Next Steps Before You Begin Make sure that you have copied the required files to your machine, and that you understand the Hadoop configuration settings as described in Chapter 2, First Steps, on page 3. Verify that you have installed a supported version of Oracle VM VirtualBox. For a list of supported versions, see: /PDF/default/sreq.pdf If you plan to connect to a Hadoop environment that uses Kerberos authentication, additional required steps are provided in this section. To understand what is required before you set up the vapp in Oracle VM VirutalBox, see Step 3: Configure the vapp to Use Kerberos Authentication on page 6. Step 1: Configure SAS Data Loader as a Virtual Machine 1 Open Oracle VM VirtualBox, and then click File Import Appliance.

16 12 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox 2 Click the folder icon to select a file to import. 3 Navigate to the folder where you saved the OVA file, and select the file. Click Open to continue.

17 Step 1: Configure SAS Data Loader as a Virtual Machine 13 4 Click Next to continue. 5 Select Import to import the vapp.

18 14 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox 6 Select Settings. 7 Select Shared Folders, and then select the add folder icon.

19 Step 1: Configure SAS Data Loader as a Virtual Machine 15 8 Select the drop-down menu in Folder Path, and then select Other. 9 Browse to locate the SASWorkspace folder, and select it. Click OK to continue. TIP You must have write-access to the SASWorkspace folder.

20 16 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox 10 Select OK to add SASWorkspace as the shared folder and to return to the Settings Window. 11 Perform the following steps to create a backup folder for the vapp. The backup location is another shared folder that you add. TIP Creating a backup for the vapp is optional, but recommended. A backup stores saved directives, profile reports, and other information that you can access at a later time. For more information, refer to Back Up and Restore on page 55. a b Use Windows Explorer to create a folder on your computer that will be the backup location, such as C:\SASDataLoader\2.4\backup. In the Settings panel for the vapp, select the add folder icon.

21 Step 1: Configure SAS Data Loader as a Virtual Machine 17 c Follow the steps in the wizard to browse for and save the backup folder that you created above. Specify information for the following fields: Folder Path: Select Other, and then browse to locate the backup folder. Folder Name: Enter backup as the name of the folder. The folder name is case-sensitive, so enter the folder name exactly as shown. 12 Perform the following steps to ensure that you have the right network settings. a b In the Settings panel for the vapp, select Network. Make sure the Enable Network Adapter check box is selected, and that the Attached to setting is NAT.

22 18 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox 13 Perform the following steps if Kerberos is used for authentication. a Edit the Hosts file for your machine to map the host IP address to the host name that Kerberos can recognize. TIP Ask your Hadoop administrator for the host name. To find your IP address, run the ipconfig command at a command prompt and look for the address for IPv4. i ii On your Windows desktop, click Start, and then click All Programs Accessories. Next right-click Notepad, and then click Run as administrator. In Notepad, open the Hosts file for your machine. Typically, you can find this file at the following location: C:\Windows\System32\drivers\etc\hosts iii Enter the IP address of your machine and the host name on the same line. An example of the text is shown below: dltest1.vapps.zzz.com. iv Save the file and exit Notepad. b Return the VirtualBox user interface. In the Network panel, select Advanced, and then the Port Forwarding button.

23 Step 1: Configure SAS Data Loader as a Virtual Machine 19 c Change the following settings for HTTP: Change Host IP to the IP address of your machine. Change Host Port to 80. Click OK to save the settings. 14 Click OK to exit the Settings window.

24 20 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox 15 Make sure the SAS Data Loader for Hadoop vapp is selected in the VirtualBox user interface, and then click Start. Note: Starting the vapp might take a minute or two. 16 When the vapp is ready, the following message is displayed in a VirtualBox window: Welcome to your SAS Data Loader Virtual Application. Perform one of the following steps to start the SAS Data Loader: Information Center: If Kerberos is used, open a web browser, and enter the host name. For example, enter the following in the browser address bar: If Kerberos is not used, do the following:

25 Step 1: Configure SAS Data Loader as a Virtual Machine 21 1 Locate the URL shown in the VirtualBox window. For example, the URL shown in the following image is 2 Open a web browser, and enter the URL in the browser address bar. Press Enter to continue. 17 The first time you open the SAS Data Loader: Information Center, the Settings window appears. Click the Browse button to locate your license file. TIP The license filename has the format SAS_vApp_ordernumber_license.txt.

26 22 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox Note: The license for one instance of the vapp for SAS Data Loader for Hadoop applies to a single user on a single client machine. 18 Do one of the following steps: If Kerberos is used, go to Step 19 on page 22 to complete the configuration. If Kerberos is not used, do not enter any other settings, and click OK. Next, go to Step 2: Start SAS Data Loader on page 23. Note: After you click OK, configuration files are updated, and then the SAS Data Loader: Information Center is displayed. Updating the configuration files can take several minutes to complete. 19 Perform the steps in this section if you plan to connect to a Hadoop environment that uses Kerberos authentication. If your Hadoop environment does not use Kerberos authentication, skip this step. CAUTION! Confirm that the values for Kerberos settings are correct before you save. If you save incorrect values for the following settings, the vapp will not connect successfully, and you must reinstall the vapp. Also, after you save the following settings, you cannot connect the vapp to an unsecured Hadoop environment. a b Click Run SAS Data Loader in secure mode. Enter values for the following fields. All fields are required. Host name User ID Kerberos realm Kerberos configuration file Host keytab file

27 Step 2: Start SAS Data Loader 23 SAS server keytab file HTTP keytab Local JCE security policy jar US JCE security jar c Click OK to save the settings, and then continue to Step 2: Start SAS Data Loader on page 23. Note: After you save the settings, the configuration files are updated, and then the SAS Data Loader: Information Center is displayed. Updating the configuration files can take several minutes to complete. Step 2: Start SAS Data Loader 1 In the SAS Data Loader: Information Center, click Start SAS Data Loader. 2 Perform the following steps to configure your connection to Hadoop services.

28 24 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox a b Enter or confirm values for the following required fields. Ask your Hadoop administrator for the values. User ID Host for the Hive server Port for the Hive server Note: The User ID field might not be editable, based the following: If you configured to run SAS Data Loader in secure mode (Kerberos). If MapR is the Hadoop distribution, User ID is not editable because the field is populated from a configuration file when you start the vapp. To change the User ID, you must enter a new value in the file vapphome\sasworkspace\hadoop\conf\mapr-users.json, and then restart the vapp. Finally, open the Hadoop Configuration panel and enter the new user ID. Enter or confirm values for the following optional fields. Ask your Hadoop administrator for the values. Password Note: The Password field might not be editable if you configured to run SAS Data Loader in secure mode.

29 Next Steps 25 Host for the Impala server Port for the Impala server SQL environment Preferred runtime target Oozie URL Note: The URL is similar to the following example: /oozie. c Click OK to close the Configuration window and to access the main page of SAS Data Loader. Next Steps Now that you have deployed SAS Data Loader for Hadoop, you can start exploring software features using sample data or using your own data. Verify that you can connect to the Hadoop cluster. One way to do that is to use the Browse Tables directive to browse tables on the Hadoop cluster. For information about using directives, refer to the SAS Data Loader for Hadoop: User's Guide on the SAS Data Loader documentation page. To use the directives Copy Data to Hadoop and Copy Data from Hadoop, you need to copy JDBC drivers from the Hadoop cluster to your shared

30 26 Chapter 3 / Set Up the vapp Using Oracle VM VirtualBox folder. For more information, see SAS Data Loader for Hadoop: User's Guide. To use the directive Load Data to LASR, your SAS Administrator needs to install a grid of SAS LASR Analytic Servers. For more information, see SAS Data Loader for Hadoop: User's Guide. If your Hadoop cluster uses the Cloudera Impala SQL environment or the Apache Spark run-time target, or both, then your SAS Data Loader directives can benefit from enhanced performance. To take advantage of these technologies, see "Enable Support for Impala and Spark" in the SAS Data Loader for Hadoop: User's Guide To learn about administrative tasks, see Chapter 6, Administration Tasks, on page 51 for more information.

31 27 4 Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro Before You Begin Step 1: Configure SAS Data Loader as a Virtual Machine Step 2: Start SAS Data Loader Next Steps Before You Begin Make sure that you have copied the required files to your machine, and that you understand the Hadoop configuration settings as described in Chapter 2, First Steps, on page 3. Verify that you have installed a supported version of VMware Player Pro, Workstation, or Workstation Pro. For a list of supported versions, see: /PDF/default/sreq.pdf If you plan to connect to a Hadoop environment that uses Kerberos authentication, additional steps are required. To understand what is required before you set up the hypervisor, see Step 3: Configure the vapp to Use Kerberos Authentication on page 6. The screen captures in this chapter show a supported version of VMware Player Pro. Other supported versions of VMware hypervisors might differ. Step 1: Configure SAS Data Loader as a Virtual Machine 1 Open the VMware hypervisor, and then click Open a Virtual Machine.

32 28 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro 2 Navigate to the directory where you extracted files from the ZIP file. Select the VMX file for SAS Data Loader, and then click Open. 3 After SAS Data Loader for Hadoop displays, click Edit virtual machine settings. CAUTION! Do not click Play virtual machine at this time. Play the vapp only after you edit the settings.

33 Step 1: Configure SAS Data Loader as a Virtual Machine 29 4 In the Hardware tab, select Network Adapter in the left panel. In the right panel, make sure that Connect at power on and NAT: Used to share the host s IP address are selected.

34 30 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro 5 Click the Options tab, and then select Shared Folders in the left panel. In the right panel, select Always enabled, and then select the Add button.

35 Step 1: Configure SAS Data Loader as a Virtual Machine 31 6 Click Next to start the Add Shared Folder wizard. 7 Click the Browse button.

36 32 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro 8 Browse to locate the SASWorkspace folder, and select it. Click OK to continue. TIP You must have write-access to the SASWorkspace folder. 9 Make sure that the Name field contains SASWorkspace. The name is casesensitive and must be spelled exactly as shown. Click Next to continue.

37 Step 1: Configure SAS Data Loader as a Virtual Machine Click Finish to accept the default selection, and return to the Virtual Machine Settings window. 11 Perform the following steps to create a backup folder for the vapp. The backup location is another shared folder that you set up with the Add Shared Folder wizard. TIP Creating a backup for the vapp is optional, but recommended. A backup stores saved directives, profile reports, and other information that you can access at a later time. For more information, refer to Back Up and Restore on page 55. a Use Windows Explorer to create a folder on your computer that will be the backup location, such as C:\SASDataLoader\2.4\backup.

38 34 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro b In the Virtual Machine Settings window, click Add to start the Add Shared Folder Wizard again. Click Next to start the Add Shared Folder wizard. c Follow the steps in the wizard to add and save the backup folder that you created above. Specify information for the following fields: Host Path: Enter the directory location for the folder or use the Browse button to select the directory. Name: Enter backup as the name of the shared folder. The folder name is case-sensitive, so enter the folder name exactly as shown. 12 Click OK to close the Virtual Machine Settings window. 13 In the Home panel, make sure SAS Data Loader for Hadoop is selected, and then click Play virtual machine.

39 Step 1: Configure SAS Data Loader as a Virtual Machine 35 Note: The hypervisor requires a minute or two to start the vapp. 14 When the vapp is ready, a message is displayed in the VMware window instructing you how to connect to the SAS Data Loader software. Perform one of the following steps: If Kerberos is used, you must map the vapp IP address to the host name that Kerberos can recognize. 1 On your Windows desktop, click Start, and then click All Programs Accessories. Next right-click Notepad, and then click Run as administrator. 2 In Notepad, open the Hosts file for your machine. Typically, you can find this file at the following location: C:\Windows\System32\drivers\etc\hosts 3 Enter the vapp IP address shown in the VMware window and the host name on the same line. An example of the text is shown below: dltest1.vapps.zzz.com. TIP Ask your Hadoop administrator for the host name.

40 36 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro 4 Save the file and exit Notepad. 5 Open a web browser, and enter the host name in the browser address bar (for example, Press Enter to continue. If Kerberos is not used: 1 Locate the URL shown in the VMware window. For example, the URL in the VMWare window shown above is 2 Open a web browser, and enter the URL in the browser address bar. Press Enter to continue. Note: If an informational Removable Devices window appears, review the information about removable devices and click OK. 15 When the SAS Data Loader: Information Center is displayed, the Settings window appears. Click the Browse button to locate your license file. TIP The license filename has the format SAS_vApp_ordernumber_license.txt.

41 Step 1: Configure SAS Data Loader as a Virtual Machine 37 Note: The license for one instance of the vapp for SAS Data Loader for Hadoop applies to a single user on a single client machine. 16 Do one of the following steps: If Kerberos is used, go to Step 17 on page 37 to complete the configuration. If Kerberos is not used, do not enter any other settings, and click OK. Next, proceed to Step 2: Start SAS Data Loader on page 38. Note: After you select OK, the SAS Data Loader: Information will start. Accessing the Information Center can take several minutes to complete. 17 Perform the steps in this section if you plan to connect to a Hadoop environment that uses Kerberos authentication. If your Hadoop environment does not use Kerberos authentication, skip this step. CAUTION! Confirm that the values for Kerberos settings are correct before you save. If you save incorrect values for the following settings, the vapp will not connect successfully, and you must reinstall the vapp. Also, after you save the following settings, you cannot connect the vapp to an unsecured Hadoop environment. a b Click Run SAS Data Loader in secure mode. Enter values for the following fields. All fields are required. Host name User ID Kerberos realm Kerberos configuration file Host keytab file SAS server keytab file

42 38 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro HTTP keytab Local JCE security policy jar US JCE security jar c Click OK to save the settings, and then continue to the next step to start SAS Data Loader. Note: After you save the settings, configuration files are updated, and then the SAS Data Loader: Information Center is displayed. Updating the configuration files can take several minutes to complete. Step 2: Start SAS Data Loader 1 In the SAS Data Loader: Information Center, click Start SAS Data Loader. 2 Perform the following steps to configure your connection to Hadoop services.

43 Step 2: Start SAS Data Loader 39 a b Enter or confirm values for the following required fields. Ask your Hadoop administrator for the values. User ID Host for the Hive server Port for the Hive server Note: The User ID field might not be editable, based the following: If you configured to run SAS Data Loader in secure mode (Kerberos). If MapR is the Hadoop distribution, User ID is not editable because the field is populated from a configuration file when you start the vapp. To change the User ID, you must enter a new value in the file vapphome\sasworkspace\hadoop\conf\mapr-users.json, and then restart the vapp. Finally, open the Hadoop Configuration panel and enter the new user ID. Enter or confirm values for the following optional fields. Ask your Hadoop administrator for the values. Password Note: The Password field might not be editable if you configured to run SAS Data Loader in secure mode.

44 40 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro Host for the Impala server Port for the Impala server SQL environment Preferred runtime target Oozie URL Note: The URL is similar to the following example: /oozie. c Click OK to close the Configuration window and to access the main page of SAS Data Loader. Next Steps Now that you have deployed SAS Data Loader for Hadoop, you can start exploring software features using sample data or using your own data. Verify that you can connect to the Hadoop cluster. One way to do that is to use the Browse Tables directive to browse tables on the Hadoop cluster. For information about using directives, refer to the SAS Data Loader for Hadoop: User's Guide on the SAS Data Loader documentation page. To use the directives Copy Data to Hadoop and Copy Data from Hadoop, you need to copy JDBC drivers from the Hadoop cluster to your shared

45 Next Steps 41 folder. For more information, see SAS Data Loader for Hadoop: User's Guide. To use the directive Load Data to LASR, your SAS Administrator needs to install a grid of SAS LASR Analytic Servers. For more information, see SAS Data Loader for Hadoop: User's Guide. If your Hadoop cluster uses the Cloudera Impala SQL environment or the Apache Spark run-time target, or both, then your SAS Data Loader directives can benefit from enhanced performance. To take advantage of these technologies, see "Enable Support for Impala and Spark" in the SAS Data Loader for Hadoop: User's Guide To learn about administrative tasks, see Chapter 6, Administration Tasks, on page 51 for more information.

46 42 Chapter 4 / Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro

47 43 5 Migrate from a Previous Release What Gets Migrated? Tips for Success Migrate from Release Migrate from Release Next Steps What Gets Migrated? Follow the steps in this section to keep and use existing content from a previous release for your deployment of SAS Data Loader 2.4 for Hadoop. You can migrate the following information so that it is available when you use SAS Data Loader 2.4 for Hadoop. Saved directives and profile reports Configuration settings History information about job runs User preferences User ID and other Hadoop configuration settings (for environments that do not use Kerberos authentication) Note: Passwords are not migrated, so you must re-enter any passwords. Also, information that is entered in the SAS Data Loader: Information Center Settings panel is not migrated. You must re-enter the license information and, if the Hadoop cluster is secured by Kerberos, the Kerberos information. Tips for Success Create a separate folder to store the files for release 2.4 only (for example, C:\SASDataLoader\2.4\). Unless instructed to do so in the following migration instructions, keep the contents of the release 2.4 folder separate from the previous releases. During the migration, you will have folders on your machine that have the same names, but the folders contain files that are specific to a release.

48 44 Chapter 5 / Migrate from a Previous Release Make sure you follow the steps for your release. o o If you plan to migrate from SAS Data Loader 2.3 for Hadoop (2.3), go to Migrate from Release 2.3 on page 44. If you plan to migrate from SAS Data Loader 2.2 for Hadoop (2.2), go to Migrate from Release 2.2 on page 46. TIP To find which release you are using, click the Help menu, and then select About SAS Data Loader in the SAS Data Loader user interface. The release number is available on the Information tab. Migrate from Release 2.3 TIP Before you start the vapp for release 2.4 for the first time, you must copy directories from your previous shared folder to the new SASWorkspace shared folder for release 2.4. This is an important step to upgrade successfully. If you do start the vapp before you copy the directories, you have to start the migration process over. For more information, see Troubleshooting Tips on page 65. Perform the following steps to migrate from release Perform a backup for release 2.3. To initiate a backup, click the More menu in the SAS Data Loader user interface, and then select Back Up Directives. For general information about how backups work, see Back Up and Restore on page Create a new SASWorkspace folder for release 2.4, and then make sure you have the required files on your machine for release 2.4. For more information, see Chapter 2, First Steps, on page 3. TIP An example of the directory structure that you might have on your machine is C:\SASDataLoader\2.4\SASWorkspace\... 3 Copy the following folders that are in the shared folder for the release 2.3, and paste them to the SASWorkspace folder for release 2.4. SASData JDBCDrivers Note: For more information about JDBC drivers, see SAS Data Loader for Hadoop: User's Guide. 4 Perform the following steps to copy the backup folder for release 2.3. a b Copy the backup folder from release 2.3, and paste it into a new folder for release 2.4. Rename the backup folder to restore.

49 Migrate from Release Follow the steps to restore from the backup for release Follow the steps specific to your hypervisor to restore your environment from the backup for release 2.3. Oracle VM VirtualBox 1 Configure the virtual machine, and add the shared directory for the vapp, as described in Step 1 on page 11 through Step 10 on page Before you close the Settings window, add the restore location to the shared directories list. i ii Select Shared Folders, and then select the add folder icon. Enter values for the following fields: Folder Path: Enter the directory location for the restore folder, or use the Browse button to select the directory. TIP The restore folder is the renamed copy of the backup folder from release 2.3. Folder Name: Enter restore as the name of the shared folder. iii Save your settings, and then continue with the standard start-up process. Note: Settings for the SAS Data Loader: Information Center are not included in the backup and restore process. You must re-enter any required configuration settings for the Information Center, such as the license file location and Kerberos settings for your Hadoop environment. VMware Hypervisors 1 Create a folder for the new vapp, and add the required Hadoop configuration files as described in Step 2: Copy Files to Your Machine on page 4. 2 Configure the virtual machine, and add the shared directory for the vapp, as described in Step 1 on page 27 through Step 10 on page Before you close the Virtual Machine Settings window, add the restore location to the shared directories list. i ii In the Folders section, click Add. Follow the steps in the Add Shared Folder Wizard and specify information for the following fields. Host Path: Enter the directory location for the restore folder, or use the Browse button to select the directory. TIP The restore folder is the renamed copy of the backup folder from release 2.3. Name: Enter restore as the name of the shared folder.

50 46 Chapter 5 / Migrate from a Previous Release 4 Save your changes, and then continue with the standard start-up process, as described in Step 13 on page 34. Note: Settings for the SAS Data Loader: Information Center are not included in the backup and restore process. You must re-enter any required configuration settings for the Information Center, such as the license file location and Kerberos settings for your Hadoop environment. 7 Clear the restore directory, and remove the restore shared folder. 8 Go to Next Steps on page 48. Migrate from Release 2.2 TIP Before you start the vapp for release 2.4 for the first time, you must copy directories from your previous shared folder to the new SASWorkspace shared folder for release 2.4. This is an important step to upgrade successfully. If you do start the vapp before you copy the directories, you have to start the migration process over. For more information, see Troubleshooting Tips on page 65. Perform the following steps to migrate from release Power off your vapp, if it is running. For more information, see Power Off the vapp on page Make sure you have the required files on your machine for release 2.4. For more information, see Chapter 2, First Steps, on page 3. 3 Perform the following steps to copy folders that were used for release 2.2 so that they are migrated to release 2.4. a b Using Windows Explorer, navigate to the shared folder that you set up for the previous release. Note: To find the directory path of the shared folder: Oracle VM VirtualBox: Click Settings for the vapp, and then click Shared Folders. Look for the host path in the folders list. VMware Hypervisors: In the Virtual Machine Settings window for the vapp, select the Options tab, and then select Shared Folders. Look for the host path of the shared folder in the right panel. Copy the folders that are in the shared folder for the previous release, and paste them to the SASWorkspace folder for release 2.4. The following folders are required: Configuration SASData Note: The Configuration\HadoopConfig subdirectory that was part of some previous releases is not used in release 2.4. Each of the following folders is optional. If you want to use the existing JDBC drivers and profiles, copy the following folders.

51 Migrate from Release JDBCDrivers Profiles Note: For more information about JDBC drivers and profiles, see SAS Data Loader for Hadoop: User's Guide. 4 Do one of the following: Chapter 3, Set Up the vapp Using Oracle VM VirtualBox, on page 11 Chapter 4, Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro, on page 27 TIP Make sure that you apply the license file for release Perform the following steps to migrate all saved profiles. Note: After you perform the following steps, you are not presented with this wizard again. a Click Migrate Profiles. b Click Continue to SAS Data Loader.

52 48 Chapter 5 / Migrate from a Previous Release After you complete the profiles migration, the SAS Data Loader for Hadoop interface is displayed. 6 Verify that saved information was migrated. Click Saved Directives or Saved Profile Reports. 7 Go to Next Steps on page 48. Next Steps Additional configuration might be required after migration. Regarding the addition of support for Apache Spark and Cloudera Impala: o o If Spark and Impala are installed on your Hadoop cluster, both might be enabled by default in 2.4, as shown in the Hadoop Configuration panel of the Configuration window. With Spark and Impala enabled, saved directives from previous releases continue to run unchanged, without using Spark or Impala. o To use Spark or Impala, saved directives that were created prior to 2.4 need to be created anew in 2.4. To learn about the directives that support Spark and Impala, see the Getting Started chapter of the SAS Data Loader for Hadoop: User's Guide.

53 Next Steps 49 o Spark is the required to use the new Cluster-Survive Data directive. Spark and Impala are otherwise optional. If your cluster uses Kerberos, open SAS Data Loader 2.4 for Hadoop and open the Configuration window. If the User ID field contains any value, click the trash can icon to remove that value. If you deleted a User ID value, then validate the settings in the Configuration window. For additional information, see the Troubleshooting topic in the SAS Data Loader for Hadoop: User's Guide. If Hadoop is secured using LDAP, you must provide the password in the Hadoop Configuration panel. If you use the directives Copy Data to Hadoop and Copy Data from Hadoop, you must enter your password in the Databases panel of the Configuration window. For more information, see Maintaining SAS Data Loader in the SAS Data Loader for Hadoop: User's Guide. If you use the directive Load Data to LASR, you must enter your password in the LASR Analytic Servers panel of the Configuration window. For more information, see Maintaining SAS Data Loader in the SAS Data Loader for Hadoop: User's Guide.

54 50 Chapter 5 / Migrate from a Previous Release

55 51 6 Administration Tasks Tips for Running the vapp Start SAS Data Loader Power Off the vapp Check for vapp Updates Manage Your License Find Information about Your License Renew Your License Request a Temporary License Back Up and Restore Tips for Configuring Backup and Restore What Gets Backed Up? Configure the Backup Location Restore: Configure a New vapp to Use a Backup Configuring a New Version of Hadoop Before You Begin General Steps for Configuring a New Version of Hadoop Enable Logging and Download Log Files Turn On Logging Download Log Files Tips for Running the vapp You can close and open SAS Data Loader in a web browser without shutting down the vapp. The vapp continues to play until you shut it down in the hypervisor. If you close the browser tab for SAS Data Loader while the vapp is playing, any jobs on the Hadoop cluster continue to run. Also, their run status continues to be collected. After SAS Data Loader displays in your browser, you do not have to keep the browser tab for SAS Data Loader: Information Center open. While the vapp is still playing, you can close the tab for the Information Center at any time and still access SAS Data Loader. Do not close the hypervisor while the vapp is playing. Shut down SAS Data Loader for Hadoop as described in Power Off the vapp on page 53.

56 52 Chapter 6 / Administration Tasks Note: If you shut down vapp processes with Windows Task Manager, the vapp might not restart properly. If this happens, see Troubleshooting Tips on page 65 for more information. For VMware hypervisors: If the vapp is playing, the cursor can disappear when you interact with the VMware user interface. This behavior is expected as it ensures that you have to enter the web address in a web browser to open the SAS Data Loader: Information Center. To restore your cursor, press Ctrl+Alt. You can suspend the vapp to free memory on your Windows host. This enables you to restart the vapp quickly, which can reduce resuming your vapp from minutes to seconds. You must restart the vapp after you configure a connection to a new database. You must restart the vapp after you change the version of Hadoop. A change can include a version update of an existing Hadoop vendor, or if you configure the vapp to use a different Hadoop vendor. Start SAS Data Loader If you powered down the vapp, refer to the following instructions to restart the vapp and start SAS Data Loader for Hadoop. Oracle VirtualBox 1 Make sure the SAS Data Loader for Hadoop vapp is selected in the VirtualBox user interface, and then click Start. Note: Starting the vapp might take a minute or two. When the vapp is ready, the following message is displayed in a VirtualBox window: Welcome to your SAS Data Loader Virtual Application. 2 Perform one of the following steps to start the SAS Data Loader: Information Center: If Kerberos is used, open a web browser, then and enter the host name (for example, in the browser address bar. If Kerberos is not used: 1 Locate the URL shown in the VirtualBox window (for example, 2 Open a web browser, and enter the URL in the browser address bar. Press Enter to continue. 3 In the SAS Data Loader: Information Center, click Start SAS Data Loader. VMware Hypervisors 1 Make sure the SAS Data Loader for Hadoop vapp is selected in the VMware user interface, and then click Play virtual machine.

57 Check for vapp Updates 53 Note: Starting the vapp might take a minute or two. When the vapp is ready, the following message is displayed in a VirtualBox window: Welcome to your SAS Data Loader Virtual Application. 2 Perform one of the following steps to start the SAS Data Loader: Information Center: If Kerberos is used, open a web browser, then and enter the host name (for example, in the browser address bar. If Kerberos is not used: 1 Locate the URL shown in the VMware window (for example, ). 2 Open a web browser, and enter the URL in the browser address bar. Press Enter to continue. 3 In the SAS Data Loader: Information Center, click Start SAS Data Loader. Power Off the vapp Perform the following steps to power off the vapp. Oracle VirtualBox 1 In the browser, close the tab for SAS Data Loader if it is open. 2 Close the VirtualBox window that is running SAS Data Loader. 3 In the Close Virtual Machine dialog box, select Power off the machine, and then click OK. VMware Hypervisors 1 In the browser, close the tab for SAS Data Loader if it is open. 2 In the VMware window, click Player Power Shut Down Guest. Note: The term guest refers to the guest operating system that runs the vapp. 3 Click Yes to confirm that you want to power off the vapp. Check for vapp Updates Follow these steps to check for the availability of vapp software updates, and to download and install updates. If you have reasonable broadband capacity, vapp updates can take less than 15 minutes. When you update the vapp, you might also see an Information Center link to notes that describe the release s changes. 1 Open the browser for the SAS Data Loader: Information Center if it is not already open.

58 54 Chapter 6 / Administration Tasks 2 Locate the Notifications section in the bottom left corner of SAS Data Loader: Information Center. 3 To check to see whether a vapp update is available, click Check for Updates. 4 If a vapp update is available, open the Run Status directive to ensure that you have named and saved your jobs. If jobs are still running, click Refresh to see their current status. 5 For any running directives, either wait for them to complete, or select the Stop option from the action menu. 6 Close the SAS Data Loader tab in the web browser. 7 Return to SAS Data Loader: Information Center and click Update. The software update process stops the vapp, replaces the vapp, and then starts the new vapp in the hypervisor. 8 When the SAS Data Loader: Information Center indicates that the vapp update is complete, click Start SAS Data Loader. Manage Your License When you first deployed SAS Data Loader, you applied a license file. You can find out when your license expires and how to renew your license. Find Information about Your License 1 Click the Help menu, and then select About SAS Data Loader in the SAS Data Loader user interface. 2 Click the License Information tab to access the following information: The date on which the license expires. Site information, which is useful for when you contact SAS to renew your license. Renew Your License 1 Contact your SAS Installation Representative to renew your license. After you renew the license, you receive a Renewal Order that contains a new license file. 2 Save the license file to a directory on the computer that hosts the vapp. 3 If SAS Data Loader is running, make sure all running jobs have finished, and then save your changes. 4 Access the SAS Data Loader: Information Center. If necessary, see Start SAS Data Loader on page 52 for how to access the SAS Data Loader: Information Center.

59 Back Up and Restore 55 5 Click the Settings icon in the top right corner. 6 In the Settings window, click Browse, and then navigate to the directory that contains the new license file. Next, select the license file, and click Open. 7 In the Settings window, click OK. 8 In the Applying Settings Changes window, click Yes to confirm your selection. 9 To begin using SAS Data Loader with the new license, restart the vapp. Note: The license remains valid for the renewal period designated in the Renewal Order . Request a Temporary License If you need an emergency license, perform the following steps to download a temporary license file that extends the use of your licensed SAS software products for six days: 1 In a web browser, open the SAS Install Center, at documentation/installcenter/index.html. 2 Under Site and Account Data on the right side of the page, select Request a Temporary License Extension. You can also select Resend the SAS Installation Data. Note: The license file is also referred to as the SAS installation data file (SID file). 3 After you receive your temporary license file, you can apply the license as described in Renew Your License on page 54. Back Up and Restore Tips for Configuring Backup and Restore Directives and other information from an existing vapp deployment can be saved, and then applied to a new vapp deployment. Here are some tips to remember before you get started: To configure the vapp to back up directives, you add a new shared folder, named backup, to be the location where directives are stored. After this shared folder is added, data is saved to it each time a user clicks Back Up Directives in the SAS Data Loader interface. To restore directives, you configure a new vapp with a new shared folder that points to the location of the backup shared folder. An important step is to rename the shared folder restore before you save it. The folder names backup and restore are case-sensitive, so enter the folder names exactly as shown.

60 56 Chapter 6 / Administration Tasks Only one backup at a time is supported. If a user initiates a backup, any previous backup information in the backup shared folder is overwritten. What Gets Backed Up? The following information is saved each time a user initiates a backup. Saved directives and profile reports Configuration settings History information about job runs User ID and other Hadoop configuration settings (for environments that do not use Kerberos authentication) Note: Passwords are not backed up, so you must re-enter any passwords. Also, information that is entered in the SAS Data Loader: Information Center Settings window is not backed up. You must re-enter the license information and if the Hadoop cluster is secured by Kerberos, the Kerberos information. Configure the Backup Location The steps for configuring your backup location are provided in the steps for setting up the vapp. For VirtualBox, refer to this step for creating a backup folder on page 16. Note: You create the backup folder as a shared folder. If the vapp is running when you click to add the backup folder, make sure you select the Automount and Make Permanent options. After you save the backup folder, you must restart the vapp in order for the backup folder to be mounted. For VMware hypervisors, refer to this step for creating a backup folder on page 33. Restore: Configure a New vapp to Use a Backup Before You Begin Before you proceed with the restore process, ensure that you have completed these prerequisites: Make sure you have the required files on your machine, as described in Chapter 2, First Steps, on page 3. A backup location has been defined, and a backup has been performed. Oracle VM VirtualBox To restore your SAS Data Loader for Hadoop environment, complete the following steps: 1 Create a folder for the new vapp, and add the required Hadoop configuration files as described in Step 2: Copy Files to Your Machine on page 4. 2 Configure the virtual machine, and add the shared directory for the vapp, as described in Step 1 on page 11 through Step 10 on page 16.

61 Back Up and Restore 57 3 Before you close the Settings window, add the restore location to the shared directories list. a b c Select Shared Folders, and then select the add folder icon. Follow the steps to add a shared folder named restore that points to the path for the backup folder. Folder Path: Enter the directory location for the backup folder or use the Browse button to select the directory. Folder Name: Enter restore as the name of the shared folder. Save your settings, and then continue with the standard start-up process. 4 Continue to Next Steps on page 57. VMware Hypervisors To restore your SAS Data Loader for Hadoop environment, complete the following steps: 1 Create a folder for the new vapp, and add the required Hadoop configuration files as described in Step 2: Copy Files to Your Machine on page 4. 2 Configure the virtual machine, and add the shared directory for the vapp, as described in Step 1 on page 27 through Step 10 on page Before you close the Virtual Machine Settings window, add the restore location to the shared directories list. a b In the Folders section, click Add. Follow the steps in the Add Shared Folder Wizard and specify information for the following fields. Host Path: Enter the directory location for the backup folder or use the Browse button to select the directory. Name: Enter restore as the name of the shared folder. 4 Save your changes, and then continue with the standard start-up process, as described in Step 13 on page 34. Note: Settings for the Information Center are not included in the backup and restore process. You must re-enter any required configuration settings for the Information Center, such as the license file location and Kerberos settings for your Hadoop environment. 5 Continue to Next Steps on page 57. Next Steps When you access SAS Data Loader for Hadoop, information from your previous environment, including saved directives and configuration settings, is available from the new vapp. Perform the following steps, as needed: If you use the directives Copy Data to Hadoop and Copy Data from Hadoop, you must enter your password in the Database Configuration panel.

62 58 Chapter 6 / Administration Tasks For more information, see Chapter 9, Maintaining SAS Data Loader in SAS Data Loader for Hadoop: User's Guide. If you use the directive Load Data to LASR, you must enter your password in the LASR Server Configuration panel. For more information, see Chapter 9, Maintaining SAS Data Loader in SAS Data Loader for Hadoop: User's Guide. Configuring a New Version of Hadoop Before You Begin If you upgrade the version of your existing Hadoop vendor, or you configure a new Hadoop vendor; you can configure SAS Data Loader for Hadoop to access it. Before you configure the vapp, your Hadoop administrator must configure the offering, SAS In-Database Technologies for Hadoop, on the Hadoop cluster. For more information, your Hadoop administrator can refer to SAS In- Database Products: Administrator's Guide. Your Hadoop administrator must provide two folders that you need to copy to your machine. The folders are conf and lib. Ask your Hadoop administrator to make these folders available. General Steps for Configuring a New Version of Hadoop Note: If you have configured the vapp with a MapR distribution of Hadoop and want to configure a different Hadoop vendor, such as Cloudera CDH, do not follow the steps below. Instead, shut down the vapp as described in Power Off the vapp on page 53, and then reinstall the vapp as described in Chapter 3, Set Up the vapp Using Oracle VM VirtualBox, on page 11 or Chapter 4, Set Up the vapp Using VMware Player Pro, Workstation, or Workstation Pro, on page 27. Configuring a new version of Hadoop includes the following steps: 1 Shut down the vapp as described in Power Off the vapp on page Copy the two folders provided by your Hadoop administrator into the SASWorkspace\hadoop directory. The two folders, named conf and lib, contain the required files to configure the vapp to use the Hadoop cluster. When you copy these files, choose to overwrite the existing conf and lib folders. 3 Power on the vapp as described in Start SAS Data Loader on page 52, and perform the following steps for the new version of Hadoop: a After you start the Information Center, enter new Kerberos settings, if necessary.

63 Enable Logging and Download Log Files 59 b After you start SAS Data Loader, click the More menu, and then select Configuration. In the Configuration window, expand Hadoop Configuration and update values as needed. Enable Logging and Download Log Files Turn On Logging For debugging purposes, you can enable logging. SAS recommends that you enable logging only when directed to do so by your SAS Technical Support representative. To maintain performance, logging is not recommended under normal circumstances. Perform the following steps to enable or disable logging inside the vapp. 1 Check the Run Status to ensure that no directives are running. This is important because the SAS Object Spawner and other services restart when you enable logging. The same services also restart when you disable logging. 2 Open the SAS Data Loader: Information Center. 3 Click the Settings icon. 4 To activate logging, select the Turn logging on (for debugging only) check box. To deactivate logging, make sure the check box is not selected. Click OK. 5 In the Applying Settings Changes window, click Yes to confirm your selection. Note: Log files are stored in the following location: vapp-path\vappinstance\sasworkspace\logs. Download Log Files Perform the following steps to download and view log files generated by the vapp. 1 Open the browser for the SAS Data Loader: Information Center if it is not already open. 2 Click the Help icon in the top right, and then click Download log file. 3 Look for the prompt that enables you to open or save the file that contains the log files. Choose to Open. 4 Unzip the file to access the logs. Note: The following logs are rotated based on file size. When the active log file reaches 10MB, a new log file is created. Up to ten log files are kept on the system, and the oldest log is deleted if the number of logs exceeds ten.

64 60 Chapter 6 / Administration Tasks o o o \opt\sasinside\sasconfig\lev1\web\webappserver \SASDataDirectorServer_1\logs\server.log \opt\sasinside\var\runtime\logs\appserver\servers \SASvAppServer1\server.log \opt\sasinside\var\runtime\logs\appserver\servers \SASvAppServer2\server.log The following logs are rotated daily. Every 24 hours a new log file is created, and there is no limit on the number of logs. o o o vapp-path\vapp-instance\sasworkspace\logs \SASDataLoader.log vapp-path\vapp-instance\sasworkspace\logs \SASDMSharedServies.log vapp-path\vapp-instance\sasworkspace\logs \SASWebProfile.log

65 61 Downloading the vapp with SAS Download Manager Appendix 1 SAS Download Manager is an application that enables users to download SAS software. If you received a Software Order with a link to SAS Download Manager, refer to the following instructions to download the vapp to a new software depot. 1 Open your Software Order for SAS Data Loader 2.4 vapp, and click the URL for downloading SAS Download Manager. 2 On the Downloads web page, click the version of SAS Download Manager that applies to Windows operating environments. 3 On the SAS Login web page, enter your address and password, or create a new profile. 4 In the SAS Download Manager table, locate the platform Microsoft Windows for x64. In that row, click the link in the Request Download column. 5 Click Accept to accept the license agreement for SAS Download Manager. 6 If you receive a pop-up message, click Run to begin the download. 7 In the Ready to Execute dialog box, click Run. 8 In the Choose Language dialog box, select a language for SAS Download Manager and click OK. 9 On the Order Information page, enter the order number and installation key that are provided in the Software Order . You can copy and paste the installation key. When you are finished, click Next. 10 If you are prompted to do so, enter your user name and password and click OK. 11 On the Specify Order Details page, click the link to review your order. In the Notes field, add text that identifies this particular order, for future reference. Click Next to continue. 12 On the Specify Order Options page, accept the default selection, which downloads the complete order. Click Next to continue. 13 On the Specify SAS Software Depot Directory page, enter a new path for the new depot.

66 62 Appendix 1 / Downloading the vapp with SAS Download Manager TIP SAS Data Loader for Hadoop must be installed in an empty depot directory. 14 On the Final Review page, review and print your order information, and click Download. SAS Download Manager proceeds to download your client software order. Note: If necessary, you can click Stop the Download Process, and restart the process later. 15 On the Download Complete page, click Next. 16 On the final page, review and print the download information, and then click Finish to close SAS Download Manager. TIP Save the Software Order so that you can refer back to it as needed.

67 63 Appendix 2 Browser Configuration to Support Integrated Windows Authentication SAS Data Loader for Hadoop supports Integrated Windows Authentication (IWA) through Firefox and Chrome browsers with additional browser configuration. For more information, see Support for Integrated Windows Authentication. Firefox Perform the following steps to configure Firefox on the client machine that hosts the vapp. 1 Enter about:config in the address bar. 2 Enter negotiate in the filter text box. 3 Set the network.negotiate-auth.delegation-uris value to the domain of the host name assigned to the vapp. 4 Set the network.negotiate-auth.trusted-uris value to the domain of the host name assigned to the vapp (for example, vapps.sas.com). 5 If you are using the Kerberos for Windows client for user authentication, set network.auth.use-sspi to false. 6 Close the browser. Chrome Perform the following steps to configure Chrome on the client machine that hosts the vapp. 1 Close all open Chrome browser instances. 2 Open Control Panel Internet Options from the Windows Start menu. 3 Click the Security tab. 4 Click Local intranet. 5 Click Sites, and then click Advanced. 6 Enter the host name assigned to the vapp in the Add this website to the zone field.

68 64 Appendix 2 / Browser Configuration to Support Integrated Windows Authentication TIP You can enter * as a wildcard for the vapp host name (for example, *.vapps.sas.com). 7 Click Add, click Close, and then click OK. 8 Click the Advanced tab. 9 Scroll down to the Security section. 10 Select the Enable Integrated Windows Authentication option. 11 Click OK to close the Internet Properties Control Panel. 12 Click the Windows Start button. 13 Enter regedit in the search box, and then press the Enter key. 14 In the Registry Editor, expand HKEY_LOCAL_MACHINE, and then expand SOFTWARE. 15 Right-click Policies, and then select New Key. 16 As appropriate, enter Google as the name of the new key. 17 As appropriate, right-click Google, and then select New Key. 18 As appropriate, enter Chrome as the name of the new key. 19 Right-click Chrome, and then select New String Value. The right pane displays a new registry entry of type REG_SZ. 20 Enter the following name for the new string value: AuthNegotiateDelegateWhitelist 21 Right-click AuthNegotiateDelegateWhitelist and select Modify. 22 In the Edit String window, in the Value data field, enter the host name that is or will be used in Kerberos to refer to the client. 23 Click OK to close the Edit String window. 24 Exit the Registry Editor. 25 Restart the Chrome browser.

69 65 Appendix 3 Troubleshooting Support Community Troubleshooting Tips Support Community If you need additional help with deploying or administering the SAS Data Loader for Hadoop, the support community is a great place to find answers. SAS Data Management Join the community to ask questions and receive expert online support. Troubleshooting Tips If something is not working, refer to the following table for tips and solutions. Issue When I run the vapp and open the Information Center, an error states that the system could not find the required Hadoop files. Wrong User ID is displayed after you restore or after migration. Tips Be sure to create a shared folder named SASWorkspace, and copy the conf and lib to SASWorkspace\hadoop. Next, exit the Information Center and restart the vapp to continue the process. Note: The folder name SASWorkspace is case-sensitive, so enter the folder name exactly as shown. In some cases, the User ID is not updated after you restore or migrate from a previous release. For example, if you connect to Hadoop secured by Kerberos with a vapp that previously connected to an unsecure Hadoop environment, the previous User ID remains. The previous User ID is the one entered when the Hadoop environment was not secure. Go to the Hadoop Configuration panel and delete the user ID. Look for the delete button next to the user ID field.

70 66 Appendix 3 / Troubleshooting Issue vapp fails to start in VMware Player Pro, and an error message states that Intel VT-x or AMD-v is not available. Migration from a previous version is not working. vapp does not restart properly after you end vapp processes with Windows Task Manager. Tips This message indicates that running a virtual machine (virtualization) is not supported or configured in your firmware. To resolve this issue, run a utility to configure your machine. First, determine whether your machine has an Intel or AMD processor: 1 Press the Windows key and the R key on your keyboard at the same time. The Run dialog box appears. 2 In the Open field of the dialog box, enter msinfo32 and click OK. 3 In the System Information window, ensure that System Summary is selected in the left panel. 4 In the right panel, find System Type and ensure that you have a 64-bit computer. Next, find Processor to determine the processor type, Intel, or AMD. 5 Download one of the following: Next, download, and run the utility for your machine processor: Download the Intel tool. Download the AMD tool. Finally, visit the virtualization hardware extensions page to enable Intel and AMD virtualization hardware extensions. To obtain information about how to navigate through your specific BIOS, contact the support site for the manufacturer of your computer. Note: For additional information about virtualization support, refer to the VMware Knowledge Base. Before you start the vapp (release 2.4) for the first time, copy the appropriate directories from your previous shared folder to the new SASWorkspace shared folder for release 2.4. If you encounter this problem, try the following steps: 1 Shut down the vapp (release 2.4) as described in Power Off the vapp on page Remove the folder where you unzipped the files for release Continue with the migration for your release. If vapp processes were shut down with Windows Task Manager, the vapp might not restart and the following message might be displayed: Service Temporarily Unavailable. If you encounter this problem, try the following steps: 1 Shut down the vapp as described in Power Off the vapp on page Power on the vapp as described in Start SAS Data Loader on page 52.

71 67 Recommended Reading SAS Data Loader for Hadoop: User's Guide SAS In-Database Products: Administrator's Guide SAS 9.4 DS2 Language Reference SAS/ACCESS for Relational Databases: Reference SAS Quality Knowledge Base for Contact Information 23: Installation and Configuration (see the online Help for usage information) For a complete list of SAS publications, go to sas.com/store/books. If you have questions about which titles you need, please contact a SAS Representative: SAS Books SAS Campus Drive Cary, NC Phone: Fax: sasbook@sas.com Web address: sas.com/store/books

72 68 Recommended Reading

73