Installing Datameer with MapR on an Edge Node

Size: px
Start display at page:

Download "Installing Datameer with MapR on an Edge Node"

Transcription

1 Installing Datameer with MapR on an Edge Node If Datameer is installed on an edge node and has to be connected with MapR, you also need to install the MapR client software on the edge node, so the node has access to the MapR cluster. If it is possible to install the Datameer instance on the cluster (e.g. for a PoC) you can save the steps for preparing the edge node and proceed with the steps after the node has been prepared as a MapR client (Datameer install). Preparing the Edge Node On the edge node, install the MapR client software as well as the Datameer software. Downloading the required files Download the following files: Oracle JDK 1.7, from the Oracle Web The latest MySQL connector J to install a live instance of datameer Datameer zip file for MapR ftp If you don't have a browser on the virtual machine, you should send these files to it using ftp. To install an ftp server on CentOS do the following: Enter #yum install vsfptd. Answer with y to the question "Is this ok y/n?" Start the fpt server. Enter #service vsftpd start. Transfer files to the virtual machine using your favorite ftp client. You can't transfer files using the user root. If you created a CentOS virtual machine, you have another user available to transfer files. Install the Oracle JDK In the folder where you saved the downloaded files, type: Oracle JDK install #rpm -Uvh jdk-7u79-linux-64.rpm (or the file name of the.rpm file you downloaded) To check that Java was installed correcly enter: #java -version If it worked correctly, the output should be something similar to:

2 java -v output java version "1.7.0_79" Java(TM) SE Runtime Environment (build 1.7.0_79-b15) Java HotSpot(TM) 64-Bit Server virtual machine (build b02, mixed mode) Install the MapR Client software First, you need to manually create a MapR repository. 1. Create a file called maprtech.repo with the following content: MapR repo file [maprtech] name=mapr Technologies baseurl= enabled=1 gpgcheck=0 protected= The baseurl parameter should be the release folder, which matches the version of the your MapR cluster. Copy the maprtech.repo file into the /etc/yum.repos.d folder. Install the MapR client with the following command: #yum install mapr-client Answer with y to the question "Is this ok y/n:" This action installs the MapR client and all the dependencies for it to work. The output of the install is similar to this:

3 MapR Client install output Running Transaction Warning: RPMDB altered outside of yum. Installing : syslinux-nonlinux el6.noarch 1/3 Installing : syslinux el6.x86_64 2/3 Installing : mapr-client ga-1.x86_64 3/3 To configure default settings: run configure.sh (as root), using the -C (uppercase) option to specify the CLDB nodes of the default cluster, and the -c (lowercase) option to specify that it is a client configuration /opt/mapr/server/configure.sh [-N <cluster name>] -c -C <CLDB node>[:<port>][,<cldb node>[:<port>]...] To use this client with a secure cluster, add the -secure option to the configure.sh /opt/mapr/server/configure.sh [-N <cluster name>] -secure -c -C <CLDB node>[:<port>][,<cldb node>[:<port>]...] Verifying : mapr-client ga-1.x86_64 1/3 Verifying : syslinux el6.x86_64 2/3 Verifying : syslinux-nonlinux el6.noarch 3/3 Installed: mapr-client.x86_64 0: GA-1 Dependency Installed: syslinux.x86_64 0: el6 syslinux-nonlinux.noarch 0: el6 Complete! There is some information about how to configure the client in this output, is useful for the next step. Configure the MapR Client software 1. Add the IP address of the MapR server into the /etc/hosts file of the CentOS virtual machine. If you have several CLDB nodes, the IP addresses of all of them should be entered in the /etc/hosts file. 2. Edit the /etc/hosts file and add the addresses. The result should be similar to this:

4 localhost x.z datameer x.y maprdemo CentOS VM /etc/hosts 3. Use the following command from the mapr-client install: /opt/mapr/server/configure.sh [-N <cluster name>] -c -C <CLDB node>[:<port>][,<cldb node>[:<port>]...] Find the cluster name and CLDB node name from the /opt/mapr/conf/mapr-clusters.conf file on a node from the MapR cluster. For example, in the MapR sandbox the content of mapr-clusters.conf is: demo.mapr.com secure=false maprdemo:7222 In this example, the cluster name is demo.mapr.com and the CLDB name is on maprdemo. With these names, execute the following command on the CentOS client, with multiple nodes separated by a comma: Configure MapR client #/opt/mapr/server/configure.sh -N demo.mapr.com -c -C maprdemo Check that the client can communicate with the cluster using the following commands:

5 Check MapR Client # yarn node -list 16/04/22 18:17:02 INFO client.maprzkbasedrmfailoverproxyprovider: Updated RM address to maprdemo/ :8032 Total Nodes:1 Node-Id Node-State Node-Http-Address Number-of-Running-Containers maprdemo:57841 RUNNING maprdemo: # hadoop fs -ls / Found 8 items drwxr-xr-x :14 /apps drwxr-xr-x :58 /hbase drwxrwxrwx :15 /oozie drwxr-xr-x :01 /opt drwxr-xr-x - root root :11 /tables drwxrwxrwx :58 /tmp drwxr-xr-x :14 /user drwxr-xr-x :59 /var If both the YARN command and the Hadoop fs command work, this means we have communicated with the Resource Manager and with the MapR File System. We can now go on with the Datameer installation Installing Datameer on MapR Refer to Set Up Datameer on MapR and the Installation Guide for this section. When creating a user, make sure the UUID is above 500. To do so, use the following command to specify UUIDS when creating users: # useradd --system -m -gid datameer --uid 502 datameer Configuring Datameer First, create a folder on the maprfs for the user datameer by entering the following command in the command line:

6 # hadoop fs -mkdir /user/datameer # hadoop fs -chown -R datameer:datameer /user/datameer # hadoop fs -ls /user Found 8 items drwxr-xr-x - datameer datameer :49 /user/datameer drwx :14 /user/hbaseuser drwxr-xr-x :10 /user/hive drwxr-xr-x :12 /user/mapr drwx :14 /user/mruser drwxr-xr-x - root root :14 /user/root drwx :14 /user/user01 drwx :14 /user/user02 The last command verifies that the folder you created exists and that the permissions are correctly set. For the communication between Datameer and MapR to work, you need to define a datameer user on the MapR cluster as well. If this is not done, the cluster can't execute the commands coming from an unknown user. To do so, use the same commands we used to create the user datameer on the CentOS virtual machine for Datameer, but this time on the MapR: Create datameer user on MapR # groupadd --system datameer # useradd --system -m -gid datameer --uid 502 datameer Make sure the UUID is higher than 500. MapR multi-node cluster On a MapR multi-node cluster the group datameer and the user datameer must be defined in every node. This is already done if you are using Active Directory with a PAM to control the user access to the cluster. If not, create the user datameer manually on each node In Datameer, go to the Admin tab and select Hadoop Cluster. Change the Cluster Mode to MapR. In the Datameer Private Folder field, enter /user/datameer. Enter the cluster name in the Cluster Name field.

7 To add custom properties, you need to know where the native libraries are saved. Find out where native libraries are saved by using the following command: Native libraries # hadoop checknative 16/04/22 20:32:44 WARN bzip2.bzip2factory: Failed to load/initialize native-bzip2 library system-native, will use pure-java version 16/04/22 20:32:44 INFO zlib.zlibfactory: Successfully loaded & initialized native-zlib library Native library checking: hadoop: true /opt/mapr/hadoop/hadoop-2.7.0/lib/native/libhadoop.so zlib: true /lib64/libz.so.1 snappy: true /opt/mapr/hadoop/hadoop-2.7.0/lib/native/libsnappy.so.1 lz4: true revision:99 bzip2: false openssl: false Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)! The native libraries are shown: hadoop: true /opt/mapr/hadoop/hadoop-2.7.0/lib/native/libhadoop.so The folder for the native libraries is: /opt/mapr/hadoop/hadoop-2.7.0/lib/native In Default Hadoop Properties comment out the following properties so you can define them in custom properties:

8 #mapreduce.output.fileoutputformat.compress=true #mapreduce.output.fileoutputformat.compress.type=block #mapreduce.map.output.compress=true #mapred.map.output.compression.type=block In Hadoop Distribution Specific Properties (mapr mr2), comment out the following properties so you can define them in custom properties: #mapreduce.output.fileoutputformat.compress=false #mapreduce.map.output.compress=false #tez.runtime.compress=false In Custom Properties, enter the following: Custom Properties das.tez.session-pool.max-idle-time=6s tez.shuffle-vertex-manager.desired-task-input-size= ipc.maximum.data.length= tez.am.launch.env=ld_library_path=$ld_library_path:/opt/mapr/hadoop/hadoop /lib/native tez.task.launch.env=ld_library_path=$ld_library_path:/opt/mapr/hadoop/hado op-2.7.0/lib/native yarn.app.mapreduce.am.env=ld_library_path=$ld_library_path:/opt/mapr/hadoo p/hadoop-2.7.0/lib/native io.compression.codecs=org.apache.hadoop.io.compress.defaultcodec,org.apach e.hadoop.io.compress.gzipcodec, org.apache.hadoop.io.compress.bzip2codec,org.apache.hadoop.io.compress.sna ppycodec tez.runtime.compress=true tez.runtime.compress.codec=org.apache.hadoop.io.compress.snappycodec mapreduce.map.output.compress=true mapreduce.output.fileoutputformat.compress=true mapreduce.output.fileoutputformat.compress.type=block mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.comp ress.snappycodec mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.snappyco dec You also need to find the native libraries to make sure small jobs don't fail. Find which native libraries Datameer is using by entering the following:

9 # sudo -u datameer bin/conductor.sh check Found JAVA=/usr/java/jdk1.7.0_79/jre/bin/java in JAVA_HOME=/usr/java/jdk1.7.0_79 Java 7 found DeployMode: live DAS Options: Java native libraries: Checking arguments to Jetty: JETTY_HOME = /usr/local/datameer mapr mr2 JETTY_CONF = /usr/local/datameer mapr mr2/etc/jetty.conf JETTY_RUN = /tmp JETTY_PID = /tmp/jetty-dap.pid JETTY_LOGS = CONFIGS = /usr/local/datameer mapr mr2/etc/jetty.xml JAVA = /usr/java/jdk1.7.0_79/jre/bin/java JAVA_OPTIONS = -Xmx2048m -XX:MaxPermSize=384m -Xms256m -XX:MaxNewSize=448m -XX:SurvivorRatio=6 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+HeapDumpOnOutOfMemoryError -XX:+CMSClassUnloadingEnabled -XX:+CMSPermGenSweepingEnabled -Dfile.encoding=utf-8 -server -Ddeploy.mode=live CLASSPATH = Jetty running pid=4997 In this example, the line starting with "Java native libraries:" indicates that no native libraries were loaded. To make available the MapR native libraries, copy the folder where the mapr native libraries are located into <datameer home folder>/lib. # cp -r /opt/mapr/hadoop/hadoop-2.7.0/lib/native./lib After this, restart Datameer: # sudo -u datameer bin/conductor.sh restart Found JAVA=/usr/java/jdk1.7.0_79/jre/bin/java in JAVA_HOME=/usr/java/jdk1.7.0_79 Java 7 found DeployMode: live DAS Options: Java native libraries: /usr/local/datameer mapr mr2/lib/native Note: The variable DAS_PORT overrides the port 8080 defined by jetty.port in start.ini Starting jetty using port 8443 Stopping Jetty: OK Starting Jetty: STARTED Jetty Mon May 2 10:26:41 CEST 2016 under PID 5595 In this example, the Datameer virtual machine found the native libraries. Executing a small job now works correctly. Native Libraries with MapR

10 The native libs for MapR Hadoop distribution change frequently within minor version, so Datameer packages built for MapR Hadoop distributions doesn't include native libs. Other distributions like Cloudera or HDP have a native folder within the <datameer home folder>/lib, so with these other distributions it is not required to add the native libraries (in most cases) to get the compression working properly.

Hortonworks Technical Preview for Apache Falcon

Hortonworks Technical Preview for Apache Falcon Architecting the Future of Big Data Hortonworks Technical Preview for Apache Falcon Released: 11/20/2013 Architecting the Future of Big Data 2013 Hortonworks Inc. All Rights Reserved. Welcome to Hortonworks

More information

How to Install and Configure EBF15545 for MapR with MapReduce 2

How to Install and Configure EBF15545 for MapR with MapReduce 2 How to Install and Configure EBF15545 for MapR 4.0.2 with MapReduce 2 1993-2015 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any means (electronic,

More information

Cloudera Manager Quick Start Guide

Cloudera Manager Quick Start Guide Cloudera Manager Guide Important Notice (c) 2010-2015 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, Cloudera Impala, and any other product or service names or slogans contained in this

More information

Oracle WebLogic Server (WLS) 11gR1 ( and ) Installation on Oracle Linux 5 and 6

Oracle WebLogic Server (WLS) 11gR1 ( and ) Installation on Oracle Linux 5 and 6 1 of 11 8/25/2016 11:19 AM Back to normal view: https://oracle-base.com/articles/11g/oracle-weblogic-server-11gr1-1036-installation-on-oracle-linux-5-and-6-11gr1 Oracle WebLogic Server (WLS) 11gR1 (10.3.5

More information

Installing SmartSense on HDP

Installing SmartSense on HDP 1 Installing SmartSense on HDP Date of Publish: 2018-07-12 http://docs.hortonworks.com Contents SmartSense installation... 3 SmartSense system requirements... 3 Operating system, JDK, and browser requirements...3

More information

How to Install and Configure Big Data Edition for Hortonworks

How to Install and Configure Big Data Edition for Hortonworks How to Install and Configure Big Data Edition for Hortonworks 1993-2015 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying,

More information

Linux Essentials Objectives Topics:

Linux Essentials Objectives Topics: Linux Essentials Linux Essentials is a professional development certificate program that covers basic knowledge for those working and studying Open Source and various distributions of Linux. Exam Objectives

More information

Running various Bigtop components

Running various Bigtop components Running various Bigtop components Running Hadoop Components One of the advantages of Bigtop is the ease of installation of the different Hadoop Components without having to hunt for a specific Hadoop Component

More information

Contents Configuring P Creating the WebLogic Environment for P6... 7

Contents Configuring P Creating the WebLogic Environment for P6... 7 P6 and WebLogic Configuration Guide Release 8.4 September 2014 Contents Configuring P6... 5 Creating the WebLogic Environment for P6... 7 Prerequisites for P6 EPPM Configuration... 7 Uninstalling Previous

More information

Learning the Wonders. An introduction to creating great web-applications with Project Wonder. Deployment. Markus Ruggiero. 2013, Markus Ruggiero

Learning the Wonders. An introduction to creating great web-applications with Project Wonder. Deployment. Markus Ruggiero. 2013, Markus Ruggiero An introduction to creating great web-applications with Project Wonder Deployment by Markus Ruggiero 2013, Markus Ruggiero Table of Contents Deployment 1. Deployment... 4 1.1. Setting up the environment...

More information

Installing Alfresco components one by one. Angel Borroy

Installing Alfresco components one by one. Angel Borroy Installing Alfresco components one by one Angel Borroy developer@keensoft Alfresco components (201702) https://community.alfresco.com/docs/doc-6641-alfresco-community-edition-file-list-201702 Alfresco

More information

Using the MySQL Yum Repository

Using the MySQL Yum Repository Using the MySQL Yum Repository Abstract This document provides some basic instructions for using the MySQL Yum Repository to install and upgrade MySQL. It is excerpted from the MySQL 5.6 Reference Manual.

More information

Contents Prerequisites... 5 Installing Contract Management Web Services... 11

Contents Prerequisites... 5 Installing Contract Management Web Services... 11 Installing and Configuring Contract Management Web Services July 2014 Contents Prerequisites... 5 Base Contract Management Installation... 5 Java Runtime Environment Requirements... 5 Contract Management

More information

Guidelines - Configuring PDI, MapReduce, and MapR

Guidelines - Configuring PDI, MapReduce, and MapR Guidelines - Configuring PDI, MapReduce, and MapR This page intentionally left blank. Contents Overview... 1 Set Up Your Environment... 2 Get MapR Server Information... 2 Set Up Your Host Environment...

More information

Red Hat JBoss Enterprise Application Platform 7.0

Red Hat JBoss Enterprise Application Platform 7.0 Red Hat JBoss Enterprise Application Platform 7.0 Patching and Upgrading Guide For Use with Red Hat JBoss Enterprise Application Platform 7.0 Last Updated: 2018-01-18 Red Hat JBoss Enterprise Application

More information

The Yum Server. 1. Configuring Yum Server (Say Server IP is ) 2. Configuring Yum Client (Say Client IP is

The Yum Server. 1. Configuring Yum Server (Say Server IP is ) 2. Configuring Yum Client (Say Client IP is The Yum Server Yum is an automatic updater and package installer/remover for rpm systems. It automatically computes dependencies and figures out what things should occur to install packages. It makes it

More information

Part II (c) Desktop Installation. Net Serpents LLC, USA

Part II (c) Desktop Installation. Net Serpents LLC, USA Part II (c) Desktop ation Desktop ation ation Supported Platforms Required Software Releases &Mirror Sites Configure Format Start/ Stop Verify Supported Platforms ation GNU Linux supported for Development

More information

Oracle Big Data Discovery

Oracle Big Data Discovery Oracle Big Data Discovery Installation Guide Version 1.4.0 Revision B January 2017 Copyright and disclaimer Copyright 2015, 2017, Oracle and/or its affiliates. All rights reserved. Oracle and Java are

More information

How to Configure Big Data Management 10.1 for MapR 5.1 Security Features

How to Configure Big Data Management 10.1 for MapR 5.1 Security Features How to Configure Big Data Management 10.1 for MapR 5.1 Security Features 2014, 2016 Informatica LLC. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying,

More information

Teradata Studio and Studio Express

Teradata Studio and Studio Express Teradata Studio and Studio Express Installation Guide Release 16.20 April 2018 B035-2037-518K Copyright and Trademarks Copyright 2006-2018 by Teradata. All Rights Reserved. All copyrights and trademarks

More information

Oracle Communication Policy Controller. Lab Environment Preparation

Oracle Communication Policy Controller. Lab Environment Preparation Oracle Communication Policy Controller Edition 1.0 April 2013 Copyright 2013, Oracle and/or its affiliates. All rights reserved. Disclaimer This document contains proprietary information and is protected

More information

FUJITSU Cloud Service S5 Installation and Configuration of MySQL on a CentOS VM

FUJITSU Cloud Service S5 Installation and Configuration of MySQL on a CentOS VM FUJITSU Cloud Service S5 Installation and Configuration of MySQL on a CentOS VM This guide details the steps required to install and configure MySQL on a CentOS VM Introduction The FUJITSU Cloud Service

More information

Hortonworks Data Platform v1.0 Powered by Apache Hadoop Installing and Configuring HDP using Hortonworks Management Center

Hortonworks Data Platform v1.0 Powered by Apache Hadoop Installing and Configuring HDP using Hortonworks Management Center Hortonworks Data Platform v1.0 Powered by Apache Hadoop Installing and Configuring HDP using Hortonworks Management Center This work by Hortonworks, Inc. is licensed under a Creative Commons Attribution-ShareAlike

More information

Red Hat JBoss Enterprise Application Platform 7.2

Red Hat JBoss Enterprise Application Platform 7.2 Red Hat JBoss Enterprise Application Platform 7.2 Patching and Upgrading Guide For Use with Red Hat JBoss Enterprise Application Platform 7.2 Last Updated: 2018-11-29 Red Hat JBoss Enterprise Application

More information

Pivotal Capgemini Just Do It Training HDFS-NFS Gateway Labs

Pivotal Capgemini Just Do It Training HDFS-NFS Gateway Labs Pivotal Capgemini Just Do It Training HDFS-NFS Gateway Labs In this lab exercise you will have an opportunity to explore HDFS as well as become familiar with using the HDFS- NFS Bridge. First we will go

More information

docs.hortonworks.com

docs.hortonworks.com docs.hortonworks.com Hortonworks Data Platform : Security Administration Tools Guide Copyright 2012-2014 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform, powered by Apache Hadoop,

More information

About Backup and Restore, on page 1 Supported Backup and Restore Procedures, on page 3

About Backup and Restore, on page 1 Supported Backup and Restore Procedures, on page 3 About, on page 1 Supported Procedures, on page 3 Back Up Automation Data Using the GUI, on page 4 Restore Automation Data Using the GUI, on page 6 Schedule a Backup of Automation Data Using the GUI, on

More information

Installation Guide. Community release

Installation Guide. Community release Installation Guide Community 151 release This document details step-by-step deployment procedures, system and environment requirements to assist Jumbune deployment 1 P a g e Table of Contents Introduction

More information

Hortonworks DataFlow

Hortonworks DataFlow Hortonworks DataFlow Installing an HDF Cluster for IBM Power Systems (December 22, 2017) docs.hortonworks.com Hortonworks DataFlow: Installing an HDF Cluster for IBM Power Systems Copyright 2012-2017 Hortonworks,

More information

Running Java Programs

Running Java Programs Running Java Programs Written by: Keith Fenske, http://www.psc-consulting.ca/fenske/ First version: Thursday, 10 January 2008 Document revised: Saturday, 13 February 2010 Copyright 2008, 2010 by Keith

More information

Contents Configuring P6 and P6 Professional Cloud Connect... 5 Creating the WebLogic Environment for P6... 7

Contents Configuring P6 and P6 Professional Cloud Connect... 5 Creating the WebLogic Environment for P6... 7 P6 Server Configuration Guide 16 R1 March 2016 Contents Configuring P6 and P6 Professional Cloud Connect... 5 Creating the WebLogic Environment for P6... 7 Prerequisites for P6 EPPM Configuration... 8

More information

Pentaho MapReduce with MapR Client

Pentaho MapReduce with MapR Client Pentaho MapReduce with MapR Client Change log (if you want to use it): Date Version Author Changes Contents Overview... 1 Before You Begin... 1 Use Case: Run MapReduce Jobs on Cluster... 1 Set Up Your

More information

Cloudera Manager Installation Guide

Cloudera Manager Installation Guide Cloudera Manager Installation Guide Important Notice (c) 2010-2015 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, Cloudera Impala, and any other product or service names or slogans contained

More information

QMetry 7 Installation Guide - Linux Platform

QMetry 7 Installation Guide - Linux Platform QMetry 7 Installation Guide - Linux Platform 1 Introduction 2 Pre-requisites 2.1 Hardware Requirements 2.2 Software Requirements 2.2.1 Set JAVA_HOME and PATH on Linux 2.2.2 Set Java Cryptography Extension

More information

Hands-on Exercise Hadoop

Hands-on Exercise Hadoop Department of Economics and Business Administration Chair of Business Information Systems I Prof. Dr. Barbara Dinter Big Data Management Hands-on Exercise Hadoop Building and Testing a Hadoop Cluster by

More information

APEX Installation Guide. Sven van der Meer, Liam Fallon, John Keeney. Version SNAPSHOT, T16:01:13Z

APEX Installation Guide. Sven van der Meer, Liam Fallon, John Keeney. Version SNAPSHOT, T16:01:13Z APEX Installation Guide Sven van der Meer, Liam Fallon, John Keeney Version 2.0.0-SNAPSHOT, 2018-10-10T16:01:13Z Table of Contents 1. Requirements............................................................................................

More information

Important Notice Cloudera, Inc. All rights reserved.

Important Notice Cloudera, Inc. All rights reserved. Cloudera Upgrade Important Notice 2010-2018 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, and any other product or service names or slogans contained in this document are trademarks

More information

Getting Started with Pentaho and Cloudera QuickStart VM

Getting Started with Pentaho and Cloudera QuickStart VM Getting Started with Pentaho and Cloudera QuickStart VM This page intentionally left blank. Contents Overview... 1 Before You Begin... 1 Prerequisites... 1 Use Case: Development Sandbox for Pentaho and

More information

Important Notice Cloudera, Inc. All rights reserved.

Important Notice Cloudera, Inc. All rights reserved. Cloudera Upgrade Important Notice 2010-2018 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, and any other product or service names or slogans contained in this document are trademarks

More information

Booting a Galaxy Instance

Booting a Galaxy Instance Booting a Galaxy Instance Create Security Groups First time Only Create Security Group for Galaxy Name the group galaxy Click Manage Rules for galaxy Click Add Rule Choose HTTPS and Click Add Repeat Security

More information

Configure Sensu and other Actions to Register Clients

Configure Sensu and other Actions to Register Clients Configure Sensu and other Actions to Register Clients Contents Introduction Prerequisites Requirements Components Used Background Information Configure Install Epel Repository Install Erlang Install Redis,

More information

ULTEO OPEN VIRTUAL DESKTOP CENTOS 6.0 SUPPORT

ULTEO OPEN VIRTUAL DESKTOP CENTOS 6.0 SUPPORT ULTEO OPEN VIRTUAL DESKTOP V4.0.2 CENTOS 6.0 SUPPORT Contents 1 Prerequisites: CentOS 6.0 3 1.1 System Requirements.............................. 3 1.2 SELinux....................................... 3

More information

Oracle Big Data Discovery

Oracle Big Data Discovery s Oracle Big Data Discovery Installation Guide Version 1.5.0 Revision A September 2017 Copyright and disclaimer Copyright 2015, 2017, Oracle and/or its affiliates. All rights reserved. Oracle and Java

More information

This tutorial will guide you how to setup and run your own minecraft server on a Linux CentOS 6 in no time.

This tutorial will guide you how to setup and run your own minecraft server on a Linux CentOS 6 in no time. This tutorial will guide you how to setup and run your own minecraft server on a Linux CentOS 6 in no time. Running your own server lets you play together with your friends and family with your own set

More information

Identity Connect Release Notes,,,

Identity Connect Release Notes,,, ,,, registered trademark of salesforce.com, Inc., as are other names and marks. Other marks appearing herein may be trademarks of their respective owners. Abstract Notes covering Identity Connect prerequisites,

More information

Informatica Cloud Spring Hadoop Connector Guide

Informatica Cloud Spring Hadoop Connector Guide Informatica Cloud Spring 2017 Hadoop Connector Guide Informatica Cloud Hadoop Connector Guide Spring 2017 December 2017 Copyright Informatica LLC 2015, 2017 This software and documentation are provided

More information

Red Hat Virtualization 4.1

Red Hat Virtualization 4.1 Red Hat Virtualization 4.1 Upgrade Guide Update and upgrade tasks for Red Hat Virtualization Last Updated: 2018-03-06 Red Hat Virtualization 4.1 Upgrade Guide Update and upgrade tasks for Red Hat Virtualization

More information

VIRTUAL GPU LICENSE SERVER VERSION , , AND 5.1.0

VIRTUAL GPU LICENSE SERVER VERSION , , AND 5.1.0 VIRTUAL GPU LICENSE SERVER VERSION 2018.10, 2018.06, AND 5.1.0 DU-07754-001 _v7.0 through 7.2 March 2019 User Guide TABLE OF CONTENTS Chapter 1. Introduction to the NVIDIA vgpu Software License Server...

More information

SAS Data Loader 2.4 for Hadoop

SAS Data Loader 2.4 for Hadoop SAS Data Loader 2.4 for Hadoop vapp Deployment Guide SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2015. SAS Data Loader 2.4 for Hadoop: vapp Deployment

More information

Hortonworks DataFlow

Hortonworks DataFlow Hortonworks DataFlow Installing HDF Services on a New HDP Cluster for IBM (December 22, 2017) docs.hortonworks.com Hortonworks DataFlow: Installing HDF Services on a New HDP Cluster for IBM Power Systems

More information

Orchid Fusion VMS Installation Guide

Orchid Fusion VMS Installation Guide Orchid Fusion VMS Installation Guide Version 2.4.0 Orchid Fusion VMS Installation Guide v2.4.0 1 C O N T E N T S About the Orchid Fusion VMS Installation Guide 2 Installation 3 Working in Windows 3 Working

More information

KNIME Extension for Apache Spark Installation Guide. KNIME AG, Zurich, Switzerland Version 3.7 (last updated on )

KNIME Extension for Apache Spark Installation Guide. KNIME AG, Zurich, Switzerland Version 3.7 (last updated on ) KNIME Extension for Apache Spark Installation Guide KNIME AG, Zurich, Switzerland Version 3.7 (last updated on 2018-12-10) Table of Contents Introduction.....................................................................

More information

Hortonworks SmartSense

Hortonworks SmartSense Hortonworks SmartSense Installation (April 3, 2017) docs.hortonworks.com Hortonworks SmartSense: Installation Copyright 2012-2017 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform,

More information

Choose OS and click on it

Choose OS and click on it 1. Installation: 1.1. Install Node.js. Cordova runs on the Node.js platform, which needs to be installed as the first step. Download installer from: https://nodejs.org/en/download/ 1.1.1. Choose LTS version,

More information

Red Hat JBoss Web Server 3

Red Hat JBoss Web Server 3 Red Hat JBoss Web Server 3 Installation Guide Install and Configure Red Hat JBoss Web Server 3. Last Updated: 2017-10-18 Red Hat JBoss Web Server 3 Installation Guide Install and Configure Red Hat JBoss

More information

Hortonworks SmartSense

Hortonworks SmartSense Hortonworks SmartSense Installation (January 8, 2018) docs.hortonworks.com Hortonworks SmartSense: Installation Copyright 2012-2018 Hortonworks, Inc. Some rights reserved. The Hortonworks Data Platform,

More information

KNIME Extension for Apache Spark Installation Guide

KNIME Extension for Apache Spark Installation Guide Installation Guide KNIME GmbH Version 2.3.0, July 11th, 2018 Table of Contents Introduction............................................................................... 1 Supported Hadoop distributions...........................................................

More information

Run Syncope in real environments

Run Syncope in real environments Run Syncope in real environments Version Warning The content below is for Apache Syncope

More information

Hortonworks DataFlow

Hortonworks DataFlow Hortonworks DataFlow Installing HDF Services on a New HDP Cluster (February 28, 2018) docs.hortonworks.com Hortonworks DataFlow: Installing HDF Services on a New HDP Cluster Copyright 2012-2018 Hortonworks,

More information

IOL INTACT Installation Guide

IOL INTACT Installation Guide IOL INTACT Installation Guide February 25, 2014 Contents 1 System Requirements 1 2 Installing IOL INTACT 3 3 Post-Installation 4 3.1 Wireshark............................. 4 3.2 Opening pcap Files........................

More information

Ensuring your computer has Java

Ensuring your computer has Java Ensuring your computer has Java TournamentSR and all of its support programs require the Java Standard Runtime Environment (JRE). This is a free program that can be downloaded and installed from the Internet.

More information

Hortonworks Technical Preview for Stinger Phase 3 Released: 12/17/2013

Hortonworks Technical Preview for Stinger Phase 3 Released: 12/17/2013 Architecting the Future of Big Data Hortonworks Technical Preview for Stinger Phase 3 Released: 12/17/2013 Document Version 1.0 2013 Hortonworks Inc. All Rights Reserved. Architecting the Future of Big

More information

Hortonworks DataFlow

Hortonworks DataFlow Hortonworks DataFlow Installing an HDF Cluster (June 9, 2017) docs.hortonworks.com Hortonworks DataFlow: Installing an HDF Cluster Copyright 2012-2017 Hortonworks, Inc. Some rights reserved. Except where

More information

Welcome to Kmax Installing Kmax

Welcome to Kmax Installing Kmax Welcome to Kmax 10.2 Kmax is a cross-platform, Java-based application that will run on Windows, Linux, or Mac OS X. This distribution of Kmax replaces all previous releases except for Kmax on Mac OS X

More information

SAS Event Stream Processing for Edge Computing 4.3: Deployment Guide

SAS Event Stream Processing for Edge Computing 4.3: Deployment Guide SAS Event Stream Processing for Edge Computing 4.3: Deployment Guide SAS Documentation June 2017 The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2017. SAS Event Stream

More information

Important Notice Cloudera, Inc. All rights reserved.

Important Notice Cloudera, Inc. All rights reserved. Cloudera QuickStart Important Notice 2010-2017 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, and any other product or service names or slogans contained in this document are trademarks

More information

Important Notice Cloudera, Inc. All rights reserved.

Important Notice Cloudera, Inc. All rights reserved. Cloudera QuickStart Important Notice 2010-2017 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, and any other product or service names or slogans contained in this document are trademarks

More information

SYMANTEC SOLUTIONS DEPLOYMENT GUIDE. Single-Step Deployment of Veritas TM Storage Foundation and High Availability on RHEL 6.4/6.

SYMANTEC SOLUTIONS DEPLOYMENT GUIDE. Single-Step Deployment of Veritas TM Storage Foundation and High Availability on RHEL 6.4/6. SYMANTEC SOLUTIONS DEPLOYMENT GUIDE Single-Step Deployment of Veritas TM Storage Foundation and High Availability 6.0.3 on RHEL 6.4/6.5 Using Yum Author: Patric Uebele Technical Product Manager Version:

More information

SPLUNK ENTERPRISE AND ECS TECHNICAL SOLUTION GUIDE

SPLUNK ENTERPRISE AND ECS TECHNICAL SOLUTION GUIDE SPLUNK ENTERPRISE AND ECS TECHNICAL SOLUTION GUIDE Splunk Frozen and Archive Buckets on ECS ABSTRACT This technical solution guide describes a solution for archiving Splunk frozen buckets to ECS. It also

More information

CSCI 201 Lab 1 Environment Setup

CSCI 201 Lab 1 Environment Setup CSCI 201 Lab 1 Environment Setup "The journey of a thousand miles begins with one step." - Lao Tzu Introduction This lab document will go over the steps to install and set up Eclipse, which is a Java integrated

More information

Configuring a Hadoop Environment for Test Data Management

Configuring a Hadoop Environment for Test Data Management Configuring a Hadoop Environment for Test Data Management Copyright Informatica LLC 2016, 2017. Informatica LLC. No part of this document may be reproduced or transmitted in any form, by any means (electronic,

More information

<Partner Name> <Partner Product> RSA Ready Implementation Guide for. MapR Converged Data Platform 3.1

<Partner Name> <Partner Product> RSA Ready Implementation Guide for. MapR Converged Data Platform 3.1 RSA Ready Implementation Guide for MapR Jeffrey Carlson, RSA Partner Engineering Last Modified: 02/25/2016 Solution Summary RSA Analytics Warehouse provides the capacity

More information

Ambari Managed HDF Upgrade

Ambari Managed HDF Upgrade 3 Ambari Managed HDF Upgrade Date of Publish: 2018-08-13 http://docs.hortonworks.com Contents Pre-upgrade tasks... 3 Review credentials...3 Stop Services...3 Verify NiFi Toolkit Version...4 Upgrade Ambari

More information

CentOS 7 with MariaDB

CentOS 7 with MariaDB CentOS 7 with MariaDB OS Web Server and PHP MariaDB and Full Text Search Engine Other Middleware Middleware Setup and Configuration Database PHP NetCommons2 Before Install Preparation Installation Download

More information

Linux Installation Guide

Linux Installation Guide Linux Installation Guide Kinetic - Edge & Fog Processing Module (EFM) 1.5.0 Revised: May 9, 2018 Introduction... 3 Features and Functions... 3 The Edge and Fog Processing Module Components... 4 Hardware

More information

SAS Event Stream Processing 4.3 on Windows: Deployment Guide

SAS Event Stream Processing 4.3 on Windows: Deployment Guide SAS Event Stream Processing 4.3 on Windows: Deployment Guide SAS Documentation July 26, 2017 The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2017. SAS Event Stream

More information

Deployment Guide. 3.1 For Windows For Linux Docker image Windows Installation Installation...

Deployment Guide. 3.1 For Windows For Linux Docker image Windows Installation Installation... TABLE OF CONTENTS 1 About Guide...1 2 System Requirements...2 3 Package...3 3.1 For Windows... 3 3.2 For Linux... 3 3.3 Docker image... 4 4 Windows Installation...5 4.1 Installation... 5 4.1.1 Install

More information

How to Configure Informatica HotFix 2 for Cloudera CDH 5.3

How to Configure Informatica HotFix 2 for Cloudera CDH 5.3 How to Configure Informatica 9.6.1 HotFix 2 for Cloudera CDH 5.3 1993-2015 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying,

More information

Copyright Heraflux Technologies. Do not redistribute or copy as your own. 1

Copyright Heraflux Technologies. Do not redistribute or copy as your own. 1 @kleegeek davidklee.net heraflux.com in/davidaklee Specialties / Focus Areas / Passions: Performance Tuning Business Continuity Virtualization & Cloud Infrastructure Architecture Health & Efficiency Capacity

More information

OpenNebula 4.6 Quickstart CentOS 6 and ESX 5.x

OpenNebula 4.6 Quickstart CentOS 6 and ESX 5.x OpenNebula 4.6 Quickstart CentOS 6 and ESX 5.x Release 4.6 OpenNebula Project June 12, 2014 CONTENTS 1 Package Layout 3 2 Step 1. Infrastructure Set-up 5 3 Step 2. OpenNebula Front-end Set-up 7 4 Step

More information

Installing an HDF cluster

Installing an HDF cluster 3 Installing an HDF cluster Date of Publish: 2018-08-13 http://docs.hortonworks.com Contents Installing Ambari...3 Installing Databases...3 Installing MySQL... 3 Configuring SAM and Schema Registry Metadata

More information

SQL Server Administration on Linux 2017

SQL Server Administration on Linux 2017 @kleegeek davidklee.net heraflux.com davidaklee Specialties / Focus Areas / Passions: Performance Tuning Business Continuity Virtualization & Cloud Infrastructure Architecture Health & Efficiency Capacity

More information

Using The Hortonworks Virtual Sandbox Powered By Apache Hadoop

Using The Hortonworks Virtual Sandbox Powered By Apache Hadoop Using The Hortonworks Virtual Sandbox Powered By Apache Hadoop This work by Hortonworks, Inc. is licensed under a Creative Commons Attribution ShareAlike3.0 Unported License. Legal Notice Copyright 2012

More information

Date Version Changes Owner. 14-Dec First Version JC. 14-Feb Version for release at City University JC

Date Version Changes Owner. 14-Dec First Version JC. 14-Feb Version for release at City University JC Workshop - Installation Open Health Informatics John Chelsom 21st February 2011 Revision History Date Version Changes Owner 14-Dec-2010 1.0 First Version JC 14-Feb-2011 2.0 Version for release at City

More information

Linux Essentials. Programming and Data Structures Lab M Tech CS First Year, First Semester

Linux Essentials. Programming and Data Structures Lab M Tech CS First Year, First Semester Linux Essentials Programming and Data Structures Lab M Tech CS First Year, First Semester Adapted from PDS Lab 2014 and 2015 Login, Logout, Password $ ssh mtc16xx@192.168.---.--- $ ssh X mtc16xx@192.168.---.---

More information

Beta. VMware vsphere Big Data Extensions Administrator's and User's Guide. vsphere Big Data Extensions 1.0 EN

Beta. VMware vsphere Big Data Extensions Administrator's and User's Guide. vsphere Big Data Extensions 1.0 EN VMware vsphere Big Data Extensions Administrator's and User's Guide vsphere Big Data Extensions 1.0 This document supports the version of each product listed and supports all subsequent versions until

More information

Working with Database Connections. Version: 7.3

Working with Database Connections. Version: 7.3 Working with Database Connections Version: 7.3 Copyright 2015 Intellicus Technologies This document and its content is copyrighted material of Intellicus Technologies. The content may not be copied or

More information

Virtual Hosting With PureFTPd And MySQL (Incl. Quota And Bandwidth Management) On CentOS 6.4

Virtual Hosting With PureFTPd And MySQL (Incl. Quota And Bandwidth Management) On CentOS 6.4 Virtual Hosting With PureFTPd And MySQL (Incl. Quota And Bandwidth Management) On CentOS 6.4 Version 1.0 Author: Falko Timme Follow me on Twitter Last edited 03/22/2013 This

More information

Installation 1. Installing DPS. Date of Publish:

Installation 1. Installing DPS. Date of Publish: 1 Installing DPS Date of Publish: 2018-05-18 http://docs.hortonworks.com Contents DPS Platform support requirements...3 Installation overview...4 Installation prerequisites...5 Setting up the local repository

More information

Hortonworks Data Platform

Hortonworks Data Platform Hortonworks Data Platform Workflow Management (August 31, 2017) docs.hortonworks.com Hortonworks Data Platform: Workflow Management Copyright 2012-2017 Hortonworks, Inc. Some rights reserved. The Hortonworks

More information

VIRTUAL GPU LICENSE SERVER VERSION AND 5.1.0

VIRTUAL GPU LICENSE SERVER VERSION AND 5.1.0 VIRTUAL GPU LICENSE SERVER VERSION 2018.06 AND 5.1.0 DU-07754-001 _v6.0 through 6.2 July 2018 User Guide TABLE OF CONTENTS Chapter 1. Introduction to the NVIDIA vgpu Software License Server... 1 1.1. Overview

More information

Enabling SAS Event Stream Processing Authentication

Enabling SAS Event Stream Processing Authentication Enabling SAS Event Stream Processing Authentication One of the new features of SAS Event Stream Processing 3.2 was the introduction of optional authentication between clients and servers. Authentication

More information

VMware vsphere Big Data Extensions Administrator's and User's Guide

VMware vsphere Big Data Extensions Administrator's and User's Guide VMware vsphere Big Data Extensions Administrator's and User's Guide vsphere Big Data Extensions 1.1 This document supports the version of each product listed and supports all subsequent versions until

More information

IWeb. Installation Guide. v5.16.5

IWeb. Installation Guide. v5.16.5 IWeb Installation Guide v5.16.5 Connect with Us on Social Media Copyrights and Trademarks 2016 by Scientific Technologies Corporation (STC). All rights reserved. This documentation describes the following

More information

About the Tutorial. Audience. Prerequisites. Copyright & Disclaimer. HCatalog

About the Tutorial. Audience. Prerequisites. Copyright & Disclaimer. HCatalog About the Tutorial HCatalog is a table storage management tool for Hadoop that exposes the tabular data of Hive metastore to other Hadoop applications. It enables users with different data processing tools

More information

How to Install and Configure EBF16193 for Hortonworks HDP 2.3 and HotFix 3 Update 2

How to Install and Configure EBF16193 for Hortonworks HDP 2.3 and HotFix 3 Update 2 How to Install and Configure EBF16193 for Hortonworks HDP 2.3 and 9.6.1 HotFix 3 Update 2 1993-2015 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any

More information

Installation of Apache OpenMeetings on Centos 7. This tutorial is made based on fresh installations of. CentOS-7-x86_64-Minimal-1708.

Installation of Apache OpenMeetings on Centos 7. This tutorial is made based on fresh installations of. CentOS-7-x86_64-Minimal-1708. Installation of Apache OpenMeetings 4.0.6 on Centos 7 This tutorial is made based on fresh installations of CentOS-7-x86_64-Minimal-1708.iso It is tested with positive result. We will use the Apache's

More information

CentOS 6.7 with Vault MySQL 5.1

CentOS 6.7 with Vault MySQL 5.1 CentOS 6.7 with Vault MySQL 5.1 OS Middleware Installation Web Server, MySQL and PHP Other Middleware Middleware Setup and Configuration Database PHP NetCommons2 Before Install Preparation Installation

More information

Bitnami Re:dash for Huawei Enterprise Cloud

Bitnami Re:dash for Huawei Enterprise Cloud Bitnami Re:dash for Huawei Enterprise Cloud Description Re:dash is an open source data visualization and collaboration tool. It was designed to allow fast and easy access to billions of records in all

More information

Dell EMC ME4 Series vsphere Client Plug-in

Dell EMC ME4 Series vsphere Client Plug-in Dell EMC ME4 Series vsphere Client Plug-in User's Guide Regulatory Model: E09J, E10J, E11J Regulatory Type: E09J001, E10J001, E11J001 Notes, cautions, and warnings NOTE: A NOTE indicates important information

More information