Important Notice Cloudera, Inc. All rights reserved.

Transcription

1

2 Important Notice Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, and any other product or service names or slogans contained in this document, except as otherwise disclaimed, are trademarks of Cloudera and its suppliers or licensors, and may not be copied, imitated or used, in whole or in part, without the prior written permission of Cloudera or the applicable trademark holder. Hadoop and the Hadoop elephant logo are trademarks of the Apache Software Foundation. All other trademarks, registered trademarks, product names and company names or logos mentioned in this document are the property of their respective owners. Reference to any products, services, processes or other information, by trade name, trademark, manufacturer, supplier or otherwise does not constitute or imply endorsement, sponsorship or recommendation thereof by us. Complying with all applicable copyright laws is the responsibility of the user. Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Cloudera. Cloudera may have patents, patent applications, trademarks, copyrights, or other intellectual property rights covering subject matter in this document. Except as expressly provided in any written license agreement from Cloudera, the furnishing of this document does not give you any license to these patents, trademarks copyrights, or other intellectual property. The information in this document is subject to change without notice. Cloudera shall not be liable for any damages resulting from technical errors or omissions which may be present in this document, or from use of this document. Cloudera, Inc Page Mill Road, Building 2 Palo Alto, CA info@cloudera.com US: Intl: Release Information Version: Date: June 26, Cloudera ODBC Driver for Apache Hive

3 Table of Contents ABOUT THE CLOUDERA ODBC DRIVER FOR APACHE HIVE 5 WINDOWS DRIVER 6 WINDOWS SYSTEM REQUIREMENTS 6 INSTALLING THE DRIVER ON WINDOWS 6 CREATING A DATA SOURCE NAME ON WINDOWS 6 CONFIGURING A DSN-LESS CONNECTION ON WINDOWS 9 CONFIGURING AUTHENTICATION ON WINDOWS 11 CONFIGURING ADVANCED OPTIONS ON WINDOWS 14 CONFIGURING HTTP OPTIONS ON WINDOWS 16 CONFIGURING SSL VERIFICATION ON WINDOWS 17 CONFIGURING THE TEMPORARY TABLE FEATURE 18 CONFIGURING SERVER-SIDE PROPERTIES ON WINDOWS 19 CONFIGURING LOGGING OPTIONS ON WINDOWS 20 CONFIGURING KERBEROS AUTHENTICATION FOR WINDOWS 21 VERIFYING THE DRIVER VERSION NUMBER ON WINDOWS 25 MACOS DRIVER 27 MACOS SYSTEM REQUIREMENTS 27 INSTALLING THE DRIVER ON MACOS 27 VERIFYING THE DRIVER VERSION NUMBER ON MACOS 27 LINUX DRIVER 29 LINUX SYSTEM REQUIREMENTS 29 INSTALLING THE DRIVER USING THE RPM FILE 29 INSTALLING THE DRIVER ON DEBIAN 31 VERIFYING THE DRIVER VERSION NUMBER ON LINUX 31 AIX DRIVER 33 AIX SYSTEM REQUIREMENTS 33 INSTALLING THE DRIVER ON AIX 33 VERIFYING THE DRIVER VERSION NUMBER ON AIX 34 CONFIGURING THE ODBC DRIVER MANAGER ON NON-WINDOWS MACHINES 35 SPECIFYING ODBC DRIVER MANAGERS ON NON-WINDOWS MACHINES 35 SPECIFYING THE LOCATIONS OF THE DRIVER CONFIGURATION FILES 35 CONFIGURING ODBC CONNECTIONS 37 CREATING A DATA SOURCE NAME ON A NON-WINDOWS MACHINE 37 CONFIGURING A DSN-LESS CONNECTION ON A NON-WINDOWS MACHINE 39 CONFIGURING SERVICE DISCOVERY MODE ON A NON-WINDOWS MACHINE 41 Cloudera ODBC Driver for Apache Hive 3

4 CONFIGURING AUTHENTICATION ON A NON-WINDOWS MACHINE 42 CONFIGURING SSL VERIFICATION ON A NON-WINDOWS MACHINE 44 CONFIGURING SERVER-SIDE PROPERTIES ON A NON-WINDOWS MACHINE 45 CONFIGURING LOGGING OPTIONS 45 TESTING THE CONNECTION 47 AUTHENTICATION MECHANISMS 49 USING A CONNECTION STRING 51 DSN CONNECTION STRING EXAMPLE 51 DSN-LESS CONNECTION STRING EXAMPLES 51 FEATURES 54 SQL CONNECTOR FOR HIVEQL 54 DATA TYPES 54 CATALOG AND SCHEMA SUPPORT 56 HIVE_SYSTEM TABLE 56 SERVER-SIDE PROPERTIES 56 TEMPORARY TABLES 57 GET TABLES WITH QUERY 58 ACTIVE DIRECTORY 58 WRITE-BACK 58 DYNAMIC SERVICE DISCOVERY USING ZOOKEEPER 59 SECURITY AND AUTHENTICATION 59 DRIVER CONFIGURATION OPTIONS 60 CONFIGURATION OPTIONS APPEARING IN THE USER INTERFACE 60 CONFIGURATION OPTIONS HAVING ONLY KEY NAMES 80 ODBC API CONFORMANCE LEVEL 83 CONTACT US 85 4 Cloudera ODBC Driver for Apache Hive

5 About the Cloudera ODBC Driver for Apache Hive About the Cloudera ODBC Driver for Apache Hive The Cloudera ODBC Driver for Apache Hive is used for direct SQL and HiveQL access to Apache Hadoop / Hive distributions, enabling Business Intelligence (BI), analytics, and reporting on Hadoop / Hive-based data. The driver efficiently transforms an application s SQL query into the equivalent form in HiveQL, which is a subset of SQL-92. If an application is Hive-aware, then the driver is configurable to pass the query through to the database for processing. The driver interrogates Hive to obtain schema information to present to a SQL-based application. Queries, including joins, are translated from SQL to HiveQL. For more information about the differences between HiveQL and SQL, see "SQL Connector for HiveQL" on page 54. The Cloudera ODBC Driver for Apache Hive complies with the ODBC 3.80 data standard and adds important functionality such as Unicode and 32- and 64-bit support for high-performance computing environments. ODBC is one of the most established and widely supported APIs for connecting to and working with databases. At the heart of the technology is the ODBC driver, which connects an application to the database. For more information about ODBC, see the Data Access Standards Glossary: For complete information about the ODBC specification, see the ODBC API Reference: The Installation and Configuration Guide is suitable for users who are looking to access data residing within Hive from their desktop environment. Application developers might also find the information helpful. Refer to your application for details on connecting via ODBC. Cloudera ODBC Driver for Apache Hive 5

6 Windows Driver Windows Driver Windows System Requirements The Cloudera ODBC Driver for Apache Hive supports Apache Hive versions 0.11 through 1.2. Install the driver on client machines where the application is installed. Each machine that you install the driver on must meet the following minimum system requirements: Windows Server 2008 or later 100 MB of available disk space Visual C++ Redistributable for Visual Studio 2013 installed (with the same bitness as the driver that you are installing). You can download the installation packages at To install the driver, you must have Administrator privileges on the machine. Installing the Driver on Windows On 64-bit Windows operating systems, you can execute both 32- and 64-bit applications. However, 64-bit applications must use 64-bit drivers, and 32-bit applications must use 32-bit drivers. Make sure that you use the version of the driver that matches the bitness of the client application: ClouderaHiveODBC32.msi for 32-bit applications ClouderaHiveODBC64.msi for 64-bit applications You can install both versions of the driver on the same machine. To install the Cloudera ODBC Driver for Apache Hive on Windows: 1. Depending on the bitness of your client application, double-click to run ClouderaHiveODBC32.msi or ClouderaHiveODBC64.msi. 2. Click Next. 3. Select the check box to accept the terms of the License Agreement if you agree, and then click Next. 4. To change the installation location, click Change, then browse to the desired folder, and then click OK. To accept the installation location, click Next. 5. Click Install. 6. When the installation completes, click Finish. Creating a Data Source Name on Windows Typically, after installing the Cloudera ODBC Driver for Apache Hive, you need to create a Data Source Name (DSN). Alternatively, for information about DSN-less connections, see "Configuring a DSN-less Connection on Windows" on page 9. 6 Cloudera ODBC Driver for Apache Hive

7 Windows Driver To create a Data Source Name on Windows: 1. Open the ODBC Administrator: If you are using Windows 7 or earlier, click Start > All Programs > Cloudera ODBC Driver for Apache Hive 2.5 > ODBC Administrator. Or, if you are using Windows 8 or later, on the Start screen, type ODBC administrator, and then click the ODBC Administrator search result. Make sure to select the ODBC Data Source Administrator that has the same bitness as the client application that you are using to connect to Hive. 2. In the ODBC Data Source Administrator, click the Drivers tab, and then scroll down as needed to confirm that the Cloudera ODBC Driver for Apache Hive appears in the alphabetical list of ODBC drivers that are installed on your system. 3. Choose one: To create a DSN that only the user currently logged into Windows can use, click the User DSN tab. Or, to create a DSN that all users who log into Windows can use, click the System DSN tab. It is recommended that you create a System DSN instead of a User DSN. Some applications load the data using a different user account, and might not be able to detect User DSNs that are created under another user account. 4. Click Add. 5. In the Create New Data Source dialog box, select Cloudera ODBC Driver for Apache Hive and then click Finish. The Cloudera ODBC Driver for Apache Hive DSN Setup dialog box opens. 6. In the Data Source Name field, type a name for your DSN. 7. Optionally, in the field, type relevant details about the DSN. 8. In the Hive Server Type drop-down list, select Hive Server 1 or Hive Server 2. If you are connecting through Apache ZooKeeper, then Hive Server 1 is not supported. 9. Choose one: To connect to Hive without using the Apache ZooKeeper service, in the Service Discovery Mode drop-down list, select No Service Discovery. Or, to enable the driver to discover Hive Server 2 services via the ZooKeeper service, in the Service Discovery Mode drop-down list, select ZooKeeper. Cloudera ODBC Driver for Apache Hive 7

8 Windows Driver 10. Choose one: If you selected No Service Discovery above, then in the Host(s) field, type the IP address or host name of the Hive server. Or, if you selected ZooKeeper above, then in the Host(s) field, type a commaseparated list of ZooKeeper servers. Use the following format, where [ZK_Host] is the IP address or host name of the ZooKeeper server and [ZK_Port] is the number of the TCP port that the ZooKeeper server uses to listen for client connections: [ZK_Host1]:[ZK_Port1],[ZK_Host2]:[ZK_Port2] 11. In the Port field, if you selected No Service Discovery above, then type the number of the TCP port that the Hive server uses to listen for client connections. Otherwise, do not type a value in the field. 12. In the Database field, type the name of the database schema to use when a schema is not explicitly specified in a query. You can still issue queries on other schemas by explicitly specifying the schema in the query. To inspect your databases and determine the appropriate schema to use, type the show databases command at the Hive command prompt. 13. In the ZooKeeper Namespace field, if you selected ZooKeeper above, then type the namespace on ZooKeeper under which Hive Server 2 znodes are added. Otherwise, do not type a value in the field. 14. In the Authentication area, configure authentication as needed. For more information, see "Configuring Authentication on Windows" on page 11. Hive Server 1 does not support authentication. Most default configurations of Hive Server 2 require User Name authentication. To verify the authentication mechanism that you need to use for your connection, check the configuration of your Hadoop / Hive distribution. For more information, see "Authentication Mechanisms" on page Optionally, if the operations against Hive are to be done on behalf of a user that is different than the authenticated user for the connection, type the name of the user to be delegated in the Delegation UID field. This option is applicable only when connecting to a Hive Server 2 instance that supports this feature. 16. In the Thrift Transport drop-down list, select the transport protocol to use in the Thrift layer. 8 Cloudera ODBC Driver for Apache Hive

9 Windows Driver For information about how to determine which Thrift transport protocols your Hive server supports, see "Authentication Mechanisms" on page If the Thrift Transport option is set to HTTP, then to configure HTTP options such as custom headers, click HTTP Options. For more information, see "Configuring HTTP Options on Windows" on page To configure client-server verification over SSL, click SSL Options. For more information, see "Configuring SSL Verification on Windows" on page To configure advanced driver options, click Advanced Options. For more information, see "Configuring Advanced Options on Windows" on page To configure server-side properties, click Advanced Options and then click Server Side Properties. For more information, see "Configuring Server-Side Properties on Windows" on page To configure the Temporary Table feature, click Advanced Options and then click Temporary Table Configuration. For more information, see "Configuring the Temporary Table Feature" on page 18 and "Temporary Tables" on page 57. Important: When connecting to Hive 0.14 or later, the Temporary Tables feature is always enabled and you do not need to configure it in the driver. 22. To configure logging behavior for the driver, click Logging Options. For more information, see "Configuring Logging Options on Windows" on page To test the connection, click Test. Review the results as needed, and then click OK. If the connection fails, then confirm that the settings in the Cloudera ODBC Driver for Apache Hive DSN Setup dialog box are correct. Contact your Hive server administrator as needed. 24. To save your settings and close the Cloudera ODBC Driver for Apache Hive DSN Setup dialog box, click OK. 25. To close the ODBC Data Source Administrator, click OK. Configuring a DSN-less Connection on Windows Some client applications provide support for connecting to a data source using a driver without a Data Source Name (DSN). To configure a DSN-less connection, you can use a connection string or the Cloudera Hive ODBC Driver Configuration tool that is installed with the Cloudera ODBC Driver for Apache Hive. The following section explains how to use the driver configuration tool. For information about using connection strings, see "Using a Connection String" on page 51. Cloudera ODBC Driver for Apache Hive 9

10 Windows Driver To configure a DSN-less connection using the driver configuration tool: 1. Choose one: If you are using Windows 7 or earlier, click Start > All Programs > Cloudera ODBC Driver for Apache Hive 2.5 > Driver Configuration. Or, if you are using Windows 8 or later, click the arrow button at the bottom of the Start screen, and then click Cloudera ODBC Driver for Apache Hive 2.5 > Driver Configuration. Make sure to select the Driver Configuration Tool that has the same bitness as the client application that you are using to connect to Hive. 2. If you are prompted for administrator permission to make modifications to the machine, click OK. You must have administrator access to the machine to run this application because it makes changes to the registry. 3. In the Hive Server Type drop-down list, select Hive Server 1 or Hive Server 2. If you are connecting through Apache ZooKeeper, then Hive Server 1 is not supported. 4. Choose one: To connect to Hive without using the Apache ZooKeeper service, in the Service Discovery Mode drop-down list, select No Service Discovery. Or, to enable the driver to discover Hive Server 2 services via the ZooKeeper service, in the Service Discovery Mode drop-down list, select ZooKeeper. 5. In the ZooKeeper Namespace field, if you selected ZooKeeper above, then type the namespace on ZooKeeper under which Hive Server 2 znodes are added. Otherwise, do not type a value in the field. 6. In the Authentication area, configure authentication as needed. For more information, see "Configuring Authentication on Windows" on page 11. Hive Server 1 does not support authentication. Most default configurations of Hive Server 2 require User Name authentication. To verify the authentication mechanism that you need to use for your connection, check the configuration of your Hadoop / Hive distribution. For more information, see "Authentication Mechanisms" on page Cloudera ODBC Driver for Apache Hive

11 Windows Driver 7. Optionally, if the operations against Hive are to be done on behalf of a user that is different than the authenticated user for the connection, then in the Delegation UID field, type the name of the user to be delegated. This option is applicable only when connecting to a Hive Server 2 instance that supports this feature. 8. In the Thrift Transport drop-down list, select the transport protocol to use in the Thrift layer. For information about how to determine which Thrift transport protocols your Hive server supports, see "Authentication Mechanisms" on page If the Thrift Transport option is set to HTTP, then to configure HTTP options such as custom headers, click HTTP Options. For more information, see "Configuring HTTP Options on Windows" on page To configure client-server verification over SSL, click SSL Options. For more information, see "Configuring SSL Verification on Windows" on page To configure advanced options, click Advanced Options. For more information, see "Configuring Advanced Options on Windows" on page To configure server-side properties, click Advanced Options and then click Server Side Properties. For more information, see "Configuring Server-Side Properties on Windows" on page To configure the Temporary Table feature, click Advanced Options and then click Temporary Table Configuration. For more information, see "Temporary Tables" on page 57 and "Configuring the Temporary Table Feature" on page 18. Important: When connecting to Hive 0.14 or later, the Temporary Tables feature is always enabled and you do not need to configure it in the driver. 14. To save your settings and close the Cloudera Hive ODBC Driver Configuration tool, click OK. Configuring Authentication on Windows Some Hive servers are configured to require authentication for access. To connect to a Hive server, you must configure the Cloudera ODBC Driver for Apache Hive to use the authentication mechanism that matches the access requirements of the server and provides the necessary credentials. For information about how to determine the type of authentication your Hive server requires, see "Authentication Mechanisms" on page 49. Cloudera ODBC Driver for Apache Hive 11

12 Windows Driver ODBC applications that connect to Hive Server 2 using a DSN can pass in authentication credentials by defining them in the DSN. To configure authentication for a connection that uses a DSN, use the ODBC Data Source Administrator. Normally, applications that are not Hive Server 2 aware and that connect using a DSN-less connection do not have a facility for passing authentication credentials to the Cloudera ODBC Driver for Apache Hive for a connection. However, the Cloudera Hive ODBC Driver Configuration tool enables you to configure authentication without using a DSN. Important: Credentials defined in a DSN take precedence over credentials configured using the driver configuration tool. Credentials configured using the driver configuration tool apply for all connections that are made using a DSN-less connection unless the client application is Hive Server 2 aware and requests credentials from the user. Using No Authentication When connecting to a Hive server of type Hive Server 1, you must use No Authentication. When you use No Authentication, Binary is the only Thrift transport protocol that is supported. To configure a connection without authentication: 1. Choose one: To access authentication options for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, and then click Configure. Or, to access authentication options for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool. 2. In the Mechanism drop-down list, select No Authentication. 3. If the Hive server is configured to use SSL, then click SSL Options to configure SSL for the connection. For more information, see "Configuring SSL Verification on Windows" on page To save your settings and close the dialog box, click OK. Using Kerberos This authentication mechanism is available only for Hive Server 2. When you use Kerberos authentication, the Binary transport protocol is not supported. If the Use Only SSPI advanced option is disabled, then Kerberos must be installed and configured before you can use this authentication mechanism. For information about configuring Kerberos on your machine, see "Configuring Kerberos Authentication for Windows" on page 21. For information about setting the Use Only SSPI advanced option, see "Configuring Advanced Options on Windows" on page Cloudera ODBC Driver for Apache Hive

13 Windows Driver To configure Kerberos authentication: 1. Choose one: To access authentication options for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, and then click Configure. Or, to access authentication options for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool. 2. In the Mechanism drop-down list, select Kerberos. 3. Choose one: To use the default realm defined in your Kerberos setup, leave the Realm field empty. Or, if your Kerberos setup does not define a default realm or if the realm of your Hive Server 2 host is not the default, then, in the Realm field, type the Kerberos realm of the Hive Server In the Host FQDN field, type the fully qualified domain name of the Hive Server 2 host. To use the Hive server host name as the fully qualified domain name for Kerberos authentication, in the Host FQDN field, type _HOST. 5. To allow the driver to pass your credentials directly to the server for use in authentication, select Delegate Kerberos Credentials. 6. In the Service Name field, type the service name of the Hive server. 7. In the Thrift Transport drop-down list, select the transport protocol to use in the Thrift layer. Important: When using this authentication mechanism, the Binary transport protocol is not supported. 8. If the Hive server is configured to use SSL, then click SSL Options to configure SSL for the connection. For more information, see "Configuring SSL Verification on Windows" on page To save your settings and close the dialog box, click OK. Using User Name This authentication mechanism requires a user name but not a password. The user name labels the session, facilitating database tracking. This authentication mechanism is available only for Hive Server 2. Most default configurations of Hive Server 2 require User Name authentication. When you use User Name authentication, SSL is not supported and SASL is the only Thrift transport protocol available. Cloudera ODBC Driver for Apache Hive 13

14 Windows Driver To configure User Name authentication: 1. Choose one: To access authentication options for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, and then click Configure. Or, to access authentication options for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool. 2. In the Mechanism drop-down list, select User Name. 3. In the User Name field, type an appropriate user name for accessing the Hive server. 4. To save your settings and close the dialog box, click OK. Using User Name And Password This authentication mechanism requires a user name and a password. This authentication mechanism is available only for Hive Server 2. To configure User Name And Password authentication: 1. Choose one: To access authentication options for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, and then click Configure. Or, to access authentication options for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool. 2. In the Mechanism drop-down list, select User Name And Password. 3. In the User Name field, type an appropriate user name for accessing the Hive server. 4. In the Password field, type the password corresponding to the user name you typed above. 5. To save the password, select the Save Password (Encrypted) check box. Important: The password is obscured, that is, not saved in plain text. However, it is still possible for the encrypted password to be copied and used. 6. In the Thrift Transport drop-down list, select the transport protocol to use in the Thrift layer. 7. If the Hive server is configured to use SSL, then click SSL Options to configure SSL for the connection. For more information, see "Configuring SSL Verification on Windows" on page To save your settings and close the dialog box, click OK. Configuring Advanced Options on Windows You can configure advanced options to modify the behavior of the driver. 14 Cloudera ODBC Driver for Apache Hive

15 Windows Driver To configure advanced options on Windows: 1. Choose one: To access advanced options for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, then click Configure, and then click Advanced Options. Or, to access advanced options for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool, and then click Advanced Options. 2. To disable the SQL Connector feature, select the Use Native Query check box. 3. To defer query execution to SQLExecute, select the Fast SQLPrepare check box. 4. To allow driver-wide configurations to take precedence over connection and DSN settings, select the Driver Config Take Precedence check box. 5. To use the asynchronous version of the API call against Hive for executing a query, select the Use Async Exec check box. This option is applicable only when connecting to a Hive cluster running Hive or later. 6. To retrieve table names from the database by using the SHOW TABLES query, select the Get Tables With Query check box. This option is applicable only when connecting to Hive Server To enable the driver to return SQL_WVARCHAR instead of SQL_VARCHAR for STRING and VARCHAR columns, and SQL_WCHAR instead of SQL_CHAR for CHAR columns, select the Unicode SQL Character Types check box. 8. To enable the driver to return the hive_system table for catalog function calls such as SQLTables and SQLColumns, select the Show System Table check box. 9. To have the driver automatically attempt to reconnect to the server if communications are lost, select Enable Auto Reconnect. 10. To specify which mechanism the driver uses by default to handle Kerberos authentication, do one of the following: To use the SSPI plugin by default, select the Use Only SSPI check box. To use MIT Kerberos by default and only use the SSPI plugin if the GSSAPI library is not available, clear the Use Only SSPI check box. 11. To enable the driver to automatically open a new session when the existing session is no longer valid, select the Invalid Session Auto Recover check box. Cloudera ODBC Driver for Apache Hive 15

16 Windows Driver This option is applicable only when connecting to Hive Server In the Rows Fetched Per Block field, type the number of rows to be fetched per block. 13. In the Default String Column Length field, type the maximum data length for STRING columns. 14. In the Binary Column Length field, type the maximum data length for BINARY columns. 15. In the Decimal Column Scale field, type the maximum number of digits to the right of the decimal point for numeric data types. 16. In the Socket Timeout field, type the number of seconds that an operation can remain idle before it is closed. This option is applicable only when asynchronous query execution is being used against Hive Server 2 instances. 17. To save your settings and close the Advanced Options dialog box, click OK. Configuring HTTP Options on Windows You can configure options such as custom headers when using the HTTP transport protocol in the Thrift layer. For information about how to determine if your Hive server supports the HTTP transport protocol, see "Authentication Mechanisms" on page 49. To configure HTTP options on Windows: 1. Choose one: If you are configuring HTTP for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, then click Configure, and then make sure that the Thrift Transport option is set to HTTP. Or, if you are configuring HTTP for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool and then make sure that the Thrift Transport option is set to HTTP. 2. To access HTTP options, click HTTP Options. The HTTP options are available only when the Thrift Transport option is set to HTTP. 3. In the HTTP Path field, type the partial URL corresponding to the Hive server. 16 Cloudera ODBC Driver for Apache Hive

17 Windows Driver 4. To create a custom HTTP header, click Add, then type appropriate values in the Key and Value fields, and then click OK. 5. To edit a custom HTTP header, select the header from the list, then click Edit, then update the Key and Value fields as needed, and then click OK. 6. To delete a custom HTTP header, select the header from the list, and then click Remove. In the confirmation dialog box, click Yes. 7. To save your settings and close the HTTP Options dialog box, click OK. Configuring SSL Verification on Windows If you are connecting to a Hive server that has Secure Sockets Layer (SSL) enabled, you can configure the driver to connect to an SSL-enabled socket. When using SSL to connect to a server, the driver supports identity verification between the client (the driver itself) and the server. To configure SSL verification on Windows: 1. Choose one: To access SSL options for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, then click Configure, and then click SSL Options. Or, to access advanced options for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool, and then click SSL Options. 2. Select the Enable SSL check box. 3. To allow self-signed certificates from the server, select the Allow Self-signed Server Certificate check box. 4. To allow the common name of a CA-issued SSL certificate to not match the host name of the Hive server, select the Allow Common Name Host Name Mismatch check box. 5. To specify the CA certificates that you want to use to verify the server, do one of the following: To verify the server using the trusted CA certificates from a specific.pem file, specify the full path to the file in the Trusted Certificates field and clear the Use System Trust Store check box. Or, to use the trusted CA certificates.pem file that is installed with the driver, leave the Trusted Certificates field empty, and clear the Use System Trust Store check box. Or, to use the Windows Trust Store, select the Use System Trust Store check box. Important: If you are using the Windows Trust Store, make sure to import the trusted CA certificates into the Trust Store. If the trusted CA supports certificate revocation, select the Check Certificate Revocation check box. Cloudera ODBC Driver for Apache Hive 17

18 Windows Driver 6. To configure two-way SSL verification, select the Two Way SSL check box and then do the following: a. In the Client Certificate File field, specify the full path of the PEM file containing the client's certificate. b. In the Client Private Key File field, specify the full path of the file containing the client's private key. c. If the private key file is protected with a password, type the password in the Client Private Key Password field. To save the password, select the Save Password (Encrypted) check box. Important: The password is obscured, that is, not saved in plain text. However, it is still possible for the encrypted password to be copied and used. 7. To save your settings and close the SSL Options dialog box, click OK. Configuring the Temporary Table Feature You can configure the driver to create temporary tables. For more information about this feature, including details about the statement syntax used for temporary tables, see "Temporary Tables" on page 57. Important: When connecting to Hive 0.14 or later, the Temporary Tables feature is always enabled and you do not need to configure it in the driver. To configure the Temporary Table feature: 1. Choose one: To configure the temporary table feature for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN and click Configure, then click Advanced Options, and then click Temporary Table Configuration. Or, to configure the temporary table feature for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool, then click Advanced Options, and then click Temporary Table Configuration. 2. To enable the Temporary Table feature, select the Enable Temporary Table check box. 3. In the Web HDFS Host field, type the host name or IP address of the machine hosting both the namenode of your Hadoop cluster and the WebHDFS service. If this field is left blank, then the host name of the Hive server is used. 4. In the Web HDFS Port field, type the WebHDFS port for the namenode. 5. In the HDFS User field, type the name of the HDFS user that the driver uses to create the necessary files for supporting the Temporary Table feature. 18 Cloudera ODBC Driver for Apache Hive

19 Windows Driver 6. In the Data File HDFS Dir field, type the HDFS directory that the driver uses to store the necessary files for supporting the Temporary Table feature. Due to a known issue in Hive (see HDFS paths with space characters do not work with versions of Hive prior to In the Temp Table TTL field, type the number of minutes that a temporary table is guaranteed to exist in Hive after it is created. 8. To save your settings and close the Temporary Table Configuration dialog box, click OK. Configuring Server-Side Properties on Windows You can use the driver to apply configuration properties to the Hive server. To configure server-side properties on Windows: 1. Choose one: To configure server-side properties for a DSN, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, then click Configure, then click Advanced Options, and then click Server Side Properties. Or, to configure server-side properties for a DSN-less connection, open the Cloudera Hive ODBC Driver Configuration tool, then click Advanced Options, and then click Server Side Properties. 2. To create a server-side property, click Add, then type appropriate values in the Key and Value fields, and then click OK. For example, to set the value of the mapreduce.job.queuename property to myqueue, type mapreduce.job.queuename in the Key field and then type myqueue in the Value field. For a list of all Hadoop and Hive server-side properties that your implementation supports, type set -v at the Hive CLI command line or Beeline. You can also execute the set -v query after connecting using the driver. 3. To edit a server-side property, select the property from the list, then click Edit, then update the Key and Value fields as needed, and then click OK. 4. To delete a server-side property, select the property from the list, and then click Remove. In the confirmation dialog box, click Yes. 5. To change the method that the driver uses to apply server-side properties, do one of the following: To configure the driver to apply each server-side property by executing a query when opening a session to the Hive server, select the Apply Server Side Properties With Queries check box. Cloudera ODBC Driver for Apache Hive 19

20 Windows Driver Or, to configure the driver to use a more efficient method for applying server-side properties that does not involve additional network round-tripping, clear the Apply Server Side Properties With Queries check box. The more efficient method is not available for Hive Server 1, and it might not be compatible with some Hive Server 2 builds. If the server-side properties do not take effect when the check box is clear, then select the check box. 6. To configure the driver to convert server-side property key names to all lower-case characters, select the Convert Key Name To Lower Case check box. 7. To save your settings and close the Server Side Properties dialog box, click OK. Configuring Logging Options on Windows To help troubleshoot issues, you can enable logging. In addition to functionality provided in the Cloudera ODBC Driver for Apache Hive, the ODBC Data Source Administrator provides tracing functionality. Important: Only enable logging or tracing long enough to capture an issue. Logging or tracing decreases performance and can consume a large quantity of disk space. To enable driver logging on Windows: 1. To access logging options, open the ODBC Data Source Administrator where you created the DSN, then select the DSN, then click Configure, and then click Logging Options. 2. From the Log Level drop-down list, select the logging level corresponding to the amount of information that you want to include in log files: Logging Level OFF FATAL ERROR WARNING INFO Disables all logging. Logs severe error events that lead the driver to abort. Logs error events that might allow the driver to continue running. Logs events that might result in an error if action is not taken. Logs general information that describes the progress of the driver. 20 Cloudera ODBC Driver for Apache Hive

21 Windows Driver DEBUG TRACE Logging Level Logs detailed information that is useful for debugging the driver. Logs all driver activity. 3. In the Log Path field, specify the full path to the folder where you want to save log files. 4. If requested by Technical Support, type the name of the component for which to log messages in the Log Namespace field. Otherwise, do not type a value in the field. 5. In the Max Number Files field, type the maximum number of log files to keep. After the maximum number of log files is reached, each time an additional file is created, the driver deletes the oldest log file. 6. In the Max File Size field, type the maximum size of each log file in megabytes (MB). After the maximum file size is reached, the driver creates a new file and continues logging. 7. Click OK. 8. Restart your ODBC application to make sure that the new settings take effect. The Cloudera ODBC Driver for Apache Hive produces a log file named HiveODBC_driver.log at the location that you specify in the Log Path field. To disable driver logging on Windows: 1. Open the ODBC Data Source Administrator where you created the DSN, then select the DSN, then click Configure, and then click Logging Options. 2. From the Log Level drop-down list, select LOG_OFF. 3. Click OK. 4. Restart your ODBC application to make sure that the new settings take effect. Configuring Kerberos Authentication for Windows Active Directory The Cloudera ODBC Driver for Apache Hive supports Active Directory Kerberos on Windows. There are two prerequisites for using Active Directory Kerberos on Windows: MIT Kerberos is not installed on the client Windows machine. The MIT Kerberos Hadoop realm has been configured to trust the Active Directory realm so that users in the Active Directory realm can access services in the MIT Kerberos Hadoop realm. Cloudera ODBC Driver for Apache Hive 21

22 Windows Driver MIT Kerberos Downloading and Installing MIT Kerberos for Windows For information about Kerberos and download links for the installer, see the MIT Kerberos website: To download and install MIT Kerberos for Windows 4.0.1: 1. Download the appropriate Kerberos installer: For a 64-bit machine, use the following download link from the MIT Kerberos website: For a 32-bit machine, use the following download link from the MIT Kerberos website: The 64-bit installer includes both 32-bit and 64-bit libraries. The 32-bit installer includes 32- bit libraries only. 2. To run the installer, double-click the.msi file that you downloaded above. 3. Follow the instructions in the installer to complete the installation process. 4. When the installation completes, click Finish. Setting Up the Kerberos Configuration File Settings for Kerberos are specified through a configuration file. You can set up the configuration file as an.ini file in the default location, which is the C:\ProgramData\MIT\Kerberos5 directory, or as a.conf file in a custom location. Normally, the C:\ProgramData\MIT\Kerberos5 directory is hidden. For information about viewing and using this hidden directory, refer to Microsoft Windows documentation. For more information on configuring Kerberos, refer to the MIT Kerberos documentation. To set up the Kerberos configuration file in the default location: 1. Obtain a krb5.conf configuration file. You can obtain this file from your Kerberos administrator, or from the /etc/krb5.conf folder on the machine that is hosting the Hive Server 2 instance. 2. Rename the configuration file from krb5.conf to krb5.ini. 3. Copy the krb5.ini file to the C:\ProgramData\MIT\Kerberos5 directory and overwrite the empty sample file. 22 Cloudera ODBC Driver for Apache Hive

23 Windows Driver To set up the Kerberos configuration file in a custom location: 1. Obtain a krb5.conf configuration file. You can obtain this file from your Kerberos administrator, or from the /etc/krb5.conf folder on the machine that is hosting the Hive Server 2 instance. 2. Place the krb5.conf file in an accessible directory and make note of the full path name. 3. Open the System window: If you are using Windows 7 or earlier, click Start, then right-click Computer, and then click Properties. Or, if you are using Windows 8 or later, right-click This PC on the Start screen, and then click Properties. 4. Click Advanced System Settings. 5. In the System Properties dialog box, click the Advanced tab and then click Environment Variables. 6. In the Environment Variables dialog box, under the System Variables list, click New. 7. In the New System Variable dialog box, in the Variable Name field, type KRB5_CONFIG. 8. In the Variable Value field, type the full path to the krb5.conf file. 9. Click OK to save the new variable. 10. Make sure that the variable is listed in the System Variables list. 11. Click OK to close the Environment Variables dialog box, and then click OK to close the System Properties dialog box. Setting Up the Kerberos Credential Cache File Kerberos uses a credential cache to store and manage credentials. To set up the Kerberos credential cache file: 1. Create a directory where you want to save the Kerberos credential cache file. For example, create a directory named C:\temp. 2. Open the System window: If you are using Windows 7 or earlier, click Start, then right-click Computer, and then click Properties. Or, if you are using Windows 8 or later, right-click This PC on the Start screen, and then click Properties. 3. Click Advanced System Settings. 4. In the System Properties dialog box, click the Advanced tab and then click Environment Variables. 5. In the Environment Variables dialog box, under the System Variables list, click New. 6. In the New System Variable dialog box, in the Variable Name field, type KRB5CCNAME. Cloudera ODBC Driver for Apache Hive 23

24 Windows Driver 7. In the Variable Value field, type the path to the folder you created above, and then append the file name krb5cache. For example, if you created the folder C:\temp, then type C:\temp\krb5cache. krb5cache is a file (not a directory) that is managed by the Kerberos software, and it should not be created by the user. If you receive a permission error when you first use Kerberos, make sure that the krb5cache file does not already exist as a file or a directory. 8. Click OK to save the new variable. 9. Make sure that the variable appears in the System Variables list. 10. Click OK to close the Environment Variables dialog box, and then click OK to close the System Properties dialog box. 11. To make sure that Kerberos uses the new settings, restart your machine. Obtaining a Ticket for a Kerberos Principal A principal refers to a user or service that can authenticate to Kerberos. To authenticate to Kerberos, a principal must obtain a ticket by using a password or a keytab file. You can specify a keytab file to use, or use the default keytab file of your Kerberos configuration. To obtain a ticket for a Kerberos principal using a password: 1. Open MIT Kerberos Ticket Manager. 2. In MIT Kerberos Ticket Manager, click Get Ticket. 3. In the Get Ticket dialog box, type your principal name and password, and then click OK. If the authentication succeeds, then your ticket information appears in MIT Kerberos Ticket Manager. To obtain a ticket for a Kerberos principal using a keytab file: 1. Open a command prompt: If you are using Windows 7 or earlier, click Start, then click All Programs, then click Accessories, and then click Command Prompt. If you are using Windows 8 or later, click the arrow button at the bottom of the Start screen, then find the Windows System program group, and then click Command Prompt. 2. In the Command Prompt, type a command using the following syntax: kinit -k -t [KeytabPath] [Principal] [KeytabPath] is the full path to the keytab file. For example: C:\mykeytabs\myUser.keytab. 24 Cloudera ODBC Driver for Apache Hive

25 Windows Driver [Principal] is the Kerberos user principal to use for authentication. For example: 3. If the cache location KRB5CCNAME is not set or used, then use the -c option of the kinit command to specify the location of the credential cache. In the command, the -c argument must appear last. For example: kinit -k -t C:\mykeytabs\myUser.keytab -c C:\ProgramData\MIT\krbcache Krbcache is the Kerberos cache file, not a directory. To obtain a ticket for a Kerberos principal using the default keytab file: For information about configuring a default keytab file for your Kerberos configuration, refer to the MIT Kerberos documentation. 1. Open a command prompt: If you are using Windows 7 or earlier, click Start, then click All Programs, then click Accessories, and then click Command Prompt. If you are using Windows 8 or later, click the arrow button at the bottom of the Start screen, then find the Windows System program group, and then click Command Prompt. 2. In the Command Prompt, type a command using the following syntax: kinit -k [principal] [principal] is the Kerberos user principal to use for authentication. For example: MyUser@EXAMPLE.COM. 3. If the cache location KRB5CCNAME is not set or used, then use the -c option of the kinit command to specify the location of the credential cache. In the command, the -c argument must appear last. For example: kinit -k -t C:\mykeytabs\myUser.keytab myuser@example.com -c C:\ProgramData\MIT\krbcache Krbcache is the Kerberos cache file, not a directory. Verifying the Driver Version Number on Windows If you need to verify the version of the Cloudera ODBC Driver for Apache Hive that is installed on your Windows machine, you can find the version number in the ODBC Data Source Administrator. Cloudera ODBC Driver for Apache Hive 25

26 Windows Driver To verify the driver version number on Windows: 1. Open the ODBC Administrator: If you are using Windows 7 or earlier, click Start > All Programs > Cloudera ODBC Driver for Apache Hive 2.5 > ODBC Administrator. Or, if you are using Windows 8 or later, on the Start screen, type ODBC administrator, and then click the ODBC Administrator search result. Make sure to select the ODBC Data Source Administrator that has the same bitness as the client application that you are using to connect to Hive. 2. Click the Drivers tab and then find the Cloudera ODBC Driver for Apache Hive in the list of ODBC drivers that are installed on your system. The version number is displayed in the Version column. 26 Cloudera ODBC Driver for Apache Hive

27 macos Driver macos Driver macos System Requirements The Cloudera ODBC Driver for Apache Hive supports Apache Hive versions 0.11 through 1.2. Install the driver on client machines where the application is installed. Each machine that you install the driver on must meet the following minimum system requirements: macos version 10.9, 10.10, or MB of available disk space iodbc or later Installing the Driver on macos The Cloudera ODBC Driver for Apache Hive is available for macos as a.dmg file named ClouderaHiveODBC.dmg. The driver supports both 32- and 64-bit client applications. To install the Cloudera ODBC Driver for Apache Hive on macos: 1. Double-click ClouderaHiveODBC.dmg to mount the disk image. 2. Double-click ClouderaHiveODBC.pkg to run the installer. 3. In the installer, click Continue. 4. On the Software License Agreement screen, click Continue, and when the prompt appears, click Agree if you agree to the terms of the License Agreement. 5. Optionally, to change the installation location, click Change Install Location, then select the desired location, and then click Continue. By default, the driver files are installed in the /opt/cloudera/hiveodbc directory. 6. To accept the installation location and begin the installation, click Install. 7. When the installation completes, click Close. Next, configure the environment variables on your machine to make sure that the ODBC driver manager can work with the driver. For more information, see "Configuring the ODBC Driver Manager on Non-Windows Machines" on page 35. Verifying the Driver Version Number on macos If you need to verify the version of the Cloudera ODBC Driver for Apache Hive that is installed on your macos machine, you can query the version number through the Terminal. To verify the driver version number on macos: At the Terminal, run the following command: pkgutil --info com.cloudera.hiveodbc Cloudera ODBC Driver for Apache Hive 27