Aster Express Getting Started Guide

Transcription

1 Aster Express Getting Started Guide Release Number 6.10 Product ID: B K May 2016

2 The product or products described in this book are licensed products of Teradata Corporation or its affiliates. Teradata, Active Data Warehousing, Active Enterprise Intelligence, Applications-Within, Aprimo Marketing Studio, Aster, BYNET, Claraview, DecisionCast, Gridscale, MyCommerce, QueryGrid, SQL-MapReduce, Teradata Decision Experts, "Teradata Labs" logo, Teradata ServiceConnect, Teradata Source Experts, WebAnalyst, and Xkoto are trademarks or registered trademarks of Teradata Corporation or its affiliates in the United States and other countries. Adaptec and SCSISelect are trademarks or registered trademarks of Adaptec, Inc. AMD Opteron and Opteron are trademarks of Advanced Micro Devices, Inc. Apache, Apache Avro, Apache Hadoop, Apache Hive, Hadoop, and the yellow elephant logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. Apple, Mac, and OS X all are registered trademarks of Apple Inc. Axeda is a registered trademark of Axeda Corporation. Axeda Agents, Axeda Applications, Axeda Policy Manager, Axeda Enterprise, Axeda Access, Axeda Software Management, Axeda Service, Axeda ServiceLink, and Firewall-Friendly are trademarks and Maximum Results and Maximum Support are servicemarks of Axeda Corporation. Data Domain, EMC, PowerPath, SRDF, and Symmetrix are registered trademarks of EMC Corporation. GoldenGate is a trademark of Oracle. Hewlett-Packard and HP are registered trademarks of Hewlett-Packard Company. Hortonworks, the Hortonworks logo and other Hortonworks trademarks are trademarks of Hortonworks Inc. in the United States and other countries. Intel, Pentium, and XEON are registered trademarks of Intel Corporation. IBM, CICS, RACF, Tivoli, and z/os are registered trademarks of International Business Machines Corporation. Linux is a registered trademark of Linus Torvalds. LSI is a registered trademark of LSI Corporation. Microsoft, Active Directory, Windows, Windows NT, and Windows Server are registered trademarks of Microsoft Corporation in the United States and other countries. NetVault is a trademark or registered trademark of Dell Inc. in the United States and/or other countries. Novell and SUSE are registered trademarks of Novell, Inc., in the United States and other countries. Oracle, Java, and Solaris are registered trademarks of Oracle and/or its affiliates. QLogic and SANbox are trademarks or registered trademarks of QLogic Corporation. Quantum and the Quantum logo are trademarks of Quantum Corporation, registered in the U.S.A. and other countries. Red Hat is a trademark of Red Hat, Inc., registered in the U.S. and other countries. Used under license. SAP is the trademark or registered trademark of SAP AG in Germany and in several other countries. SAS and SAS/C are trademarks or registered trademarks of SAS Institute Inc. SPARC is a registered trademark of SPARC International, Inc. Symantec, NetBackup, and VERITAS are trademarks or registered trademarks of Symantec Corporation or its affiliates in the United States and other countries. Unicode is a registered trademark of Unicode, Inc. in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product and company names mentioned herein may be the trademarks of their respective owners. THE INFORMATION CONTAINED IN THIS DOCUMENT IS PROVIDED ON AN "AS-IS" BASIS, WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF IMPLIED WARRANTIES, SO THE ABOVE EXCLUSION MAY NOT APPLY TO YOU. IN NO EVENT WILL TERADATA CORPORATION BE LIABLE FOR ANY INDIRECT, DIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING LOST PROFITS OR LOST SAVINGS, EVEN IF EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. The information contained in this document may contain references or cross-references to features, functions, products, or services that are not announced or available in your country. Such references do not imply that Teradata Corporation intends to announce such features, functions, products, or services in your country. Please consult your local Teradata Corporation representative for those features, functions, products, or services available in your country. Information contained in this document may contain technical inaccuracies or typographical errors. Information may be changed or updated without notice. Teradata Corporation may also make improvements or changes in the products or services described in this information at any time without notice. To maintain the quality of our products and services, we would like your comments on the accuracy, clarity, organization, and value of this document. Please teradata-books@lists.teradata.com. Any comments or materials (collectively referred to as "Feedback") sent to Teradata Corporation will be deemed non-confidential. Teradata Corporation will have no obligation of any kind with respect to Feedback and will be free to use, reproduce, disclose, exhibit, display, transform, create derivative works of, and distribute the Feedback and derivative works thereof without limitation on a royalty-free basis. Further, Teradata Corporation will be free to use any ideas, concepts, know-how, or techniques contained in such Feedback for any purpose whatsoever, including developing, manufacturing, or marketing products or services incorporating Feedback. Copyright by Teradata. All Rights Reserved.

3 Summary Summary Aster Express comprises two virtual machines (a Queen Node and a Worker Node) that run 64-bit SUSE Linux Enterprise Server (SLES), and have 20 GBs of pre-configured disk space. NOTE: You must follow all steps described in Set Up Aster Express, paying close attention to those marked "IMPORTANT", in order to ensure your Aster Express environment is set up correctly. Contents Summary Contents Download Aster Express Install Aster Express Set Up Aster Express Start the Aster Management Console (AMC) Activate the Cluster Aster Express User Log In AppCenter Log In Additional Resources and Information Shut Down the Worker and Queen VMs Set up the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector Troubleshooting Download Aster Express Prerequisites Hardware requirements (minimum): 4 GB memory (Teradata recommends 8 GB memory) 20 GB free disk space Software requirements: OS: Microsoft Windows XP, Windows Vista, or Windows 7* * Aster Express requires a 64-bit capable CPU. A 32-bit operating system such as Windows XP can run as the host platform for the VMs, but the CPU needs to support a 64-bit Linux environment within the image. Aster Express Getting Started Guide 3

4 Download Aster Express 7-Zip: Extract (or uncompress) the Aster Express package using 7-Zip, available from: VMware Player: Download and install the latest (free) version of the VMware Player from: Virtual Network Editor: VMware Player 7.0 does not come pre-bundled with the necessary executable file vmnetcfg.exe to run the Virtual Network Editor. The Set up the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector section provides the necessary information to acquire this executable file and to configure the virtual network so that it is correctly bridged to the host computer. Note: This is only required if you want to connect Aster VMs to the Teradata-Aster Database Connector or to the Teradata QueryGrid: Aster-Hadoop Connector. Downloads from Slow Internet Connections: When downloading from a slow Internet connection, we recommend installing a download manager. If your download crashes, the download manager will allow you to restart the download where it left off rather than starting over. You can get a download manager from: Table 1-1: MD5 Checksums Aster Express Download Files Select one of these options for downloading the required files to your system: For faster networks, download this one larger file: AsterExpress6.10.7z (3.15 GB) For slower networks, download these eight smaller files: AsterExpress6.10.7z.001 (650 MB) AsterExpress6.10.7z.002 (650 MB) AsterExpress6.10.7z.003 (650 MB) AsterExpress6.10.7z.004 (650 MB) AsterExpress6.10.7z.005 (631 MB) MD5 Checksum Check the integrity of the download using the table below to check the file sizes and validate the MD5 Checksums. Packages Version Initial Disk Space Download Size MD5 Checksum AsterExpress6.10.7z GB 3,388,300,317 bytes 0dfba1f15a9ad8f1adb3e23b9141b26b AsterExpress6.10.7z MB 681,574,400 bytes c1c0b82bd99a506cd2a3e71099cc7148 AsterExpress6.10.7z MB 681,574,400 bytes 79367abc33750ad63caf3fe1e4721eed AsterExpress6.10.7z MB 681,574,400 bytes e96afab2b9b5aed3ad808111fc37c2b4 Aster Express Getting Started Guide 4

5 Install Aster Express Table 1-1: MD5 Checksums (continued) Packages Version Initial Disk Space Download Size MD5 Checksum AsterExpress6.10.7z MB 681,574,400 bytes e01b6fabf6351b34c2ba1de5dc3448ed AsterExpress6.10.7z MB 662,002,717 bytes 4a7ed7f2379b1c0d22cdc08f66bf7ad7 Install Aster Express 1 Navigate to the AsterExpress6.10.7z or AsterExpress6.10.7z.001 image file on your system. 2 Right-click on the AsterExpress6.10.7z or AsterExpress6.10.7z.001 image file and select 7-Zip > Extract Files... 3 In Extract to type C:\ 4 This directory structure will be extracted: C:\Aster 6.10\Virtual Images\Aster\Aster Queen The Aster Queen directory contains the Queen node image. The Queen node is the entry point for connecting to the Aster cluster. C:\Aster 6.10\Virtual Images\Aster\Aster Worker The Aster Worker directory contains the Worker node image. The Worker node is responsible for storing data, doing locally-optimized query planning, and executing queries. C:\Aster 6.10\Virtual Images\Aster\Aster Resources The Aster Resources directory contains these documents: Aster Analytics Foundation User Guide, Aster AppCenter User Guide, Aster Client Guide, Aster Developer Guide, Aster Development Environment User Guide, Aster Express User Guide, and Aster R User Guide. Set Up Aster Express IMPORTANT: The Queen virtual machine must be fully up and running before opening a Worker virtual machine. 1 Configure your virtual network using one of these methods: Navigate to the Control Panel and select Network. Go to the Start Menu and right-click My Network Places. Windows 7 users: Navigate to the Control Panel and right-click Network and Sharing Center. Or Aster Express Getting Started Guide 5

6 Set Up Aster Express Navigate to the Control Panel, under Network and Internet select View network status and tasks. The network configuration window opens. 2 In the left pane, click Change adapter settings. 3 In the main pane, click VMware Network Adapter VMnet8 to set the IP Address. The VMware Network Adapter VMnet8 status window opens. Aster Express Getting Started Guide 6

7 Set Up Aster Express 4 Click Properties. The VMware Network Adapter VMnet8 Properties window opens. 5 Select Internet Protocol Version 4 (TCP/IPv4) and select Properties. The Internet Protocol Version 4 (TCP/IPv4) Properties window opens. 6 Set the IP address to: Set the Subnet mask to: Click OK, and click the Close button on the two subsequent windows to close the VMware Network Adapter VMnet8 configuration windows. 9 Start VMware Player. Aster Express Getting Started Guide 7

8 Start the Aster Management Console (AMC) 10 To start the Aster virtual images, navigate to the VMware Player Welcome Page and choose Open a Virtual Machine. 11 Navigate to the Aster Queen folder in your file directory and select the Aster Queen file. 12 Double-click this file or choose the Open option. The Aster Queen window opens. 13 Click Play virtual machine. The VMware Player dialog box opens. 14 IMPORTANT: Select the 'I moved it' button and click OK. IMPORTANT: The Queen virtual machine takes one to two minutes to be fully up and running. Once a login prompt is displayed, you can open a Worker virtual machine. NOTE: Please see the Set up the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector section for more information regarding the Linux login prompt. 15 To open a Worker virtual machine: IMPORTANT: Before opening a Worker virtual machine, ensure that the Queen is fully up and running and a login prompt is displayed. a b Open another instance of the VMware Player. Repeat steps 9 through 13 in this section, but this time, navigate to the Aster Worker Node options instead of the Aster Queen Node options. The Queen and Worker virtual machines are now running, and the cluster can be configured through the Aster Management Console (AMC). Start the Aster Management Console (AMC) The Aster Management Console (AMC) allows you to monitor all activity and system resources. 1 To access the AMC, enter this URL: 2 You may ignore any website security certificate warnings and continue to the website. Aster Express Getting Started Guide 8

9 Start the Aster Management Console (AMC) 3 Enter the Username: db_superuser and Password: db_superuser and click Login. 4 The AMC Dashboard opens. 5 Check the status of the nodes by navigating to Admin>Cluster Management. Aster Express Getting Started Guide 9

10 Activate the Cluster 6 The Queen and Worker nodes are now visible under the Nodes tab. Activate the Cluster 1 To activate the Aster cluster, navigate to Admin>Cluster Management in the AMC. 2 Verify that the Worker node Status is Prepared before continuing to Step 3. If the Worker node Status indicates New, refer to the Recovering when the Worker node State indicates New instead of Prepared topic under Troubleshooting in order to correct the issue. 3 Click the Activate Cluster button. 4 During this process the Activate Cluster button is dim. Upon completion the status will show as Active in the AMC Dashboard screen. Your Aster Express cluster is now up and running and ready to start analyzing Big Data. 5 To run queries, use the Aster Database Cluster Terminal (ACT). For information on using ACT, see the Aster Express User Guide. Aster Express User Log In To log in to Aster Express as the aster user: aster-queen login: aster Password: aster aster@aster-queen:~> NOTE: Aster Express user log in can also be performed from Aster Worker nodes. Aster Express Getting Started Guide 10

11 AppCenter Log In AppCenter Log In To access AppCenter, enter this URL and then the username and password: Username: admin Password: aster4data For information on using AppCenter, see the Aster AppCenter User Guide. Additional Resources and Information For additional resources and information about Aster Express, including software download, tutorials and video demonstrations, refer to the Teradata Aster Community website: Shut Down the Worker and Queen VMs IMPORTANT: You must shut down the Worker image first. 1 To close the first virtual image, select the Aster Worker (not the Queen) image. 2 Navigate to the Player dropdown menu, continue to the Power > Suspend sub-menus, and click Suspend. Aster Express Getting Started Guide 11

12 Set up the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector The Suspend action preserves the state of the virtual machine, returns it to the library in the Suspended state, and restores it when you access the virtual machine at a later time. Please refer to the VMware Player website for more information. 3 Click Yes in the VMware Player dialog box to confirm that you want to suspend the Worker virtual machine. 4 The VMware Player welcome page is displayed after the suspend operation is complete. 5 Navigate to the Aster Queen image instead of the Aster Worker image, and repeat steps 1 through 4 in this section. Now, the Worker and Queen virtual images are both Suspended. 6 Click Player > Exit to exit each VMware Player. Set up the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector The Teradata-Aster Database Connector requires that Aster Express and Teradata have access to each other over a network via a bridged connection. Additionally, the Teradata QueryGrid: Aster-Hadoop Connector requires that Aster Express and Hadoop have access to each other over a network. First, follow steps 1 through 12 (in this section) to begin the set-up for both the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector. Note: This is only required if you want to connect Aster VMs to the Teradata-Aster Database Connector or the Teradata QueryGrid: Aster-Hadoop Connector. Second, follow the final steps in Complete the network configuration for the Teradata- Aster Database Connector or Complete the network configuration for the Teradata QueryGrid: Aster-Hadoop Connectorto complete the specified configuration process. To establish these bridged connections: 1 Download the (free) trial version of VMware Workstation from: 2 Open a Command Prompt window and run this command: VMware-workstation-full exe /e.\vmware_extract. The folder vmware_extract is the destination directory where you want to extract the contents of the installer. 3 Navigate to the vmware_extract folder and use 7-zip to open the core.cab file and extract the contents. 4 Copy vmnetcfg.exe to the directory where you installed the VMware Player. 5 Open vmnetcfg.exe file to display the Virtual Network Editor configuration screen. Aster Express Getting Started Guide 12

13 Set up the Teradata-Aster Database Connector and the Teradata QueryGrid: Aster-Hadoop Connector 6 Select the VMnet0 in the top part of the screen. 7 Select the Bridged (connect VMs directly to the external network) radio button option in the VMnet Information section. 8 From the drop-down menu, select Intel(R) 82579LM Gigabit Network Connection or the network connection you will use to connect the VM host to Teradata or Hadoop. 9 Click Apply, then click OK. 10 Connect the physical machine on which the Aster Express VMs are installed (the host machine) to an Ethernet network. 11 Verify that you can reach the IP address of the Teradata database over the Ethernet network from the host machine. 12 The Aster Express VMs are accessible over the network via their eth1 IP addresses. To find out the eth1 IP address of each VM: a b c Log in to Linux on the Aster Queen with Username: aster and Password: aster. Perform ifconfig -a on the Aster Queen to find out its eth1 IP address. Make a note of it. Repeat these steps on the Aster Worker to obtain its eth1 IP address. Complete the network configuration for the Teradata-Aster Database Connector 1 Log on to the Teradata database machine and ping both the Aster Queen and the Aster Worker VMs using their eth1 IP addresses to ensure they are reachable. 2 Follow the instructions in the Aster Express User Guide for connecting to the Teradata- Aster Database Connector. Aster Express Getting Started Guide 13

14 Troubleshooting Complete the network configuration for the Teradata QueryGrid: Aster- Hadoop Connector 1 Connect the physical machine on which the Aster Express VMs are installed (the host machine) to an Ethernet network. 2 Verify that you can reach the IP address of the HCatalog machine over the Ethernet network from the host machine. The Teradata QueryGrid: Aster-Hadoop Connector connects to Hadoop through HCatalog. 3 Log on to the Hadoop nodes and ping both the Aster Queen and the Aster Worker VMs using their eth1 IP addresses to ensure they are reachable. 4 Follow the instructions in the Aster Express User Guide for configuring the Teradata QueryGrid: Aster-Hadoop Connector. Troubleshooting For questions regarding your CPU Compatibility, please refer to these websites for compatibility details: VMware Workstation Processor Check Utility PDF Windows CPU Checking Tool Trouble Connecting to the Queen Node: Check that you are not also connected to a VPN. The VPN may override your local network and prevent you from connecting to the Queen Node. Linux Login: It is not necessary to log into the virtual machines directly. However, if you wish to log in to Linux on the VMs, use Username: aster and Password: aster for both the Queen and Worker Nodes. Network errors: The Queen and Worker VMs are connected using two network interfaces: eth0 connected via NAT. This connects the VMs so they can communicate with each other. eth1 connected via a bridge connection, which is configured to request a DHCP address on the bridged network. This is intended to provide a way to connect to Teradata or Hadoop clusters using an Ethernet network. If your VM host is not connected to an Ethernet network, you will see the error Interface could not be set up for eth1 when the VMs start up. This is normal and can be ignored. Recovering when the Worker node State indicates New instead of Prepared. The Worker node State will indicate NEW when the Worker node is brought up before the Queen node. To resolve this issue, perform a soft restart from the AMC. On the AMC console, navigate to and select the Soft Restart menu option: Admin > Cluster Management > Soft Restart For information on using the AMC, see the Aster Express User Guide. Aster Express Getting Started Guide 14