Informatica Cloud (Version Fall 2016) Qlik Connector Guide

Transcription

1 Informatica Cloud (Version Fall 2016) Qlik Connector Guide

2 Informatica Cloud Qlik Connector Guide Version Fall 2016 November 2016 Copyright Informatica LLC 2016 This software and documentation contain proprietary information of Informatica LLC and are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright law. Reverse engineering of the software is prohibited. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica LLC. This Software may be protected by U.S. and/or international Patents and other Patents Pending. Use, duplication, or disclosure of the Software by the U.S. Government is subject to the restrictions set forth in the applicable software license agreement and as provided in DFARS (a) and (a) (1995), DFARS (1)(ii) (OCT 1988), FAR (a) (1995), FAR , or FAR (ALT III), as applicable. The information in this product or documentation is subject to change without notice. If you find any problems in this product or documentation, please report them to us in writing. Informatica, Informatica Platform, Informatica Data Services, PowerCenter, PowerCenterRT, PowerCenter Connect, PowerCenter Data Analyzer, PowerExchange, PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica B2B Data Exchange Informatica On Demand, Informatica Identity Resolution, Informatica Application Information Lifecycle Management, Informatica Complex Event Processing, Ultra Messaging, Informatica Master Data Management, and Live Data Map are trademarks or registered trademarks of Informatica LLC in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners. Portions of this software and/or documentation are subject to copyright held by third parties, including without limitation: Copyright DataDirect Technologies. All rights reserved. Copyright Sun Microsystems. All rights reserved. Copyright RSA Security Inc. All Rights Reserved. Copyright Ordinal Technology Corp. All rights reserved. Copyright Aandacht c.v. All rights reserved. Copyright Genivia, Inc. All rights reserved. Copyright Isomorphic Software. All rights reserved. Copyright Meta Integration Technology, Inc. All rights reserved. Copyright Intalio. All rights reserved. Copyright Oracle. All rights reserved. Copyright Adobe Systems Incorporated. All rights reserved. Copyright DataArt, Inc. All rights reserved. Copyright ComponentSource. All rights reserved. Copyright Microsoft Corporation. All rights reserved. Copyright Rogue Wave Software, Inc. All rights reserved. Copyright Teradata Corporation. All rights reserved. Copyright Yahoo! Inc. All rights reserved. Copyright Glyph & Cog, LLC. All rights reserved. Copyright Thinkmap, Inc. All rights reserved. Copyright Clearpace Software Limited. All rights reserved. Copyright Information Builders, Inc. All rights reserved. Copyright OSS Nokalva, Inc. All rights reserved. Copyright Edifecs, Inc. All rights reserved. Copyright Cleo Communications, Inc. All rights reserved. Copyright International Organization for Standardization All rights reserved. Copyright ejtechnologies GmbH. All rights reserved. Copyright Jaspersoft Corporation. All rights reserved. Copyright International Business Machines Corporation. All rights reserved. Copyright yworks GmbH. All rights reserved. Copyright Lucent Technologies. All rights reserved. Copyright (c) University of Toronto. All rights reserved. Copyright Daniel Veillard. All rights reserved. Copyright Unicode, Inc. Copyright IBM Corp. All rights reserved. Copyright MicroQuill Software Publishing, Inc. All rights reserved. Copyright PassMark Software Pty Ltd. All rights reserved. Copyright LogiXML, Inc. All rights reserved. Copyright Lorenzi Davide, All rights reserved. Copyright Red Hat, Inc. All rights reserved. Copyright The Board of Trustees of the Leland Stanford Junior University. All rights reserved. Copyright EMC Corporation. All rights reserved. Copyright Flexera Software. All rights reserved. Copyright Jinfonet Software. All rights reserved. Copyright Apple Inc. All rights reserved. Copyright Telerik Inc. All rights reserved. Copyright BEA Systems. All rights reserved. Copyright PDFlib GmbH. All rights reserved. Copyright Orientation in Objects GmbH. All rights reserved. Copyright Tanuki Software, Ltd. All rights reserved. Copyright Ricebridge. All rights reserved. Copyright Sencha, Inc. All rights reserved. Copyright Scalable Systems, Inc. All rights reserved. Copyright jqwidgets. All rights reserved. Copyright Tableau Software, Inc. All rights reserved. Copyright MaxMind, Inc. All Rights Reserved. Copyright TMate Software s.r.o. All rights reserved. Copyright MapR Technologies Inc. All rights reserved. Copyright Amazon Corporate LLC. All rights reserved. Copyright Highsoft. All rights reserved. Copyright Python Software Foundation. All rights reserved. Copyright BeOpen.com. All rights reserved. Copyright CNRI. All rights reserved. This product includes software developed by the Apache Software Foundation ( and/or other software which is licensed under various versions of the Apache License (the "License"). You may obtain a copy of these Licenses at Unless required by applicable law or agreed to in writing, software distributed under these Licenses is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the Licenses for the specific language governing permissions and limitations under the Licenses. This product includes software which was developed by Mozilla ( software copyright The JBoss Group, LLC, all rights reserved; software copyright by Bruno Lowagie and Paulo Soares and other software which is licensed under various versions of the GNU Lesser General Public License Agreement, which may be found at The materials are provided free of charge by Informatica, "as-is", without warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. The product includes ACE(TM) and TAO(TM) software copyrighted by Douglas C. Schmidt and his research group at Washington University, University of California, Irvine, and Vanderbilt University, Copyright ( ) , all rights reserved. This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit (copyright The OpenSSL Project. All Rights Reserved) and redistribution of this software is subject to terms available at and This product includes Curl software which is Copyright , Daniel Stenberg, <daniel@haxx.se>. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at Permission to use, copy, modify, and distribute this software for any purpose with or without fee is hereby granted, provided that the above copyright notice and this permission notice appear in all copies. The product includes software copyright ( ) MetaStuff, Ltd. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at license.html. The product includes software copyright , The Dojo Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at This product includes ICU software which is copyright International Business Machines Corporation and others. All rights reserved. Permissions and limitations regarding this software are subject to terms available at This product includes software copyright Per Bothner. All rights reserved. Your right to use such materials is set forth in the license which may be found at kawa/software-license.html. This product includes OSSP UUID software which is Copyright 2002 Ralf S. Engelschall, Copyright 2002 The OSSP Project Copyright 2002 Cable & Wireless Deutschland. Permissions and limitations regarding this software are subject to terms available at This product includes software developed by Boost ( or under the Boost software license. Permissions and limitations regarding this software are subject to terms available at / This product includes software copyright University of Cambridge. Permissions and limitations regarding this software are subject to terms available at This product includes software copyright 2007 The Eclipse Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at and at

3 This product includes software licensed under the terms at license.html, httpunit.sourceforge.net/doc/ license.html, license.html, license-agreement; /copyright-software ; forge.ow2.org/projects/javaservice/, license.html; protobuf.googlecode.com/svn/trunk/src/google/protobuf/descriptor.proto; current/doc/mitk5license.html; blob/master/license; page=documents&file=license; blueprints/blob/master/license.txt; twbs/bootstrap/blob/master/license; master/license, and This product includes software licensed under the Academic Free License ( the Common Development and Distribution License ( the Common Public License ( the Sun Binary Code License Agreement Supplemental License Terms, the BSD License ( the new BSD License ( licenses/bsd-3-clause), the MIT License ( the Artistic License ( and the Initial Developer s Public License Version 1.0 ( This product includes software copyright Joe WaInes, XStream Committers. All rights reserved. Permissions and limitations regarding this software are subject to terms available at This product includes software developed by the Indiana University Extreme! Lab. For further information please visit This product includes software Copyright (c) 2013 Frank Balluffi and Markus Moeller. All rights reserved. Permissions and limitations regarding this software are subject to terms of the MIT license. See patents at DISCLAIMER: Informatica LLC provides this documentation "as is" without warranty of any kind, either express or implied, including, but not limited to, the implied warranties of noninfringement, merchantability, or use for a particular purpose. Informatica LLC does not warrant that this software or documentation is error free. The information provided in this software or documentation may include technical inaccuracies or typographical errors. The information in this software and documentation is subject to change at any time without notice. NOTICES This Informatica product (the "Software") includes certain drivers (the "DataDirect Drivers") from DataDirect Technologies, an operating company of Progress Software Corporation ("DataDirect") which are subject to the following terms and conditions: 1. THE DATADIRECT DRIVERS ARE PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT. 2. IN NO EVENT WILL DATADIRECT OR ITS THIRD PARTY SUPPLIERS BE LIABLE TO THE END-USER CUSTOMER FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL OR OTHER DAMAGES ARISING OUT OF THE USE OF THE ODBC DRIVERS, WHETHER OR NOT INFORMED OF THE POSSIBILITIES OF DAMAGES IN ADVANCE. THESE LIMITATIONS APPLY TO ALL CAUSES OF ACTION, INCLUDING, WITHOUT LIMITATION, BREACH OF CONTRACT, BREACH OF WARRANTY, NEGLIGENCE, STRICT LIABILITY, MISREPRESENTATION AND OTHER TORTS. Publication Date:

4 Table of Contents Preface Informatica Resources Informatica Documentation Informatica Cloud Web Site Informatica Cloud Communities Informatica Cloud Marketplace Informatica Cloud Connector Documentation Informatica Knowledge Base Informatica Cloud Trust Site Informatica Global Customer Support Chapter 1: Introduction to Qlik Connector Qlik Connector Overview Qlik Connector Task and Object Types Introduction to Qlik Qlikview Data Exchange File Chapter 2: Qlik Connections Qlik Connections Overview Qlik Connection Properties Template File Path Chapter 3: Data Synchronization Tasks with Qlik Qlik Targets in Data Synchronization Tasks Qlik Advanced Target Properties in Data Synchronization Tasks Data Synchronization Example Chapter 4: Mappings and Mapping Configuration Tasks with Qlik Qlik Targets in Mappings Appendix A: Datatype Reference Datatype Reference Overview Qlik and Transformation Datatypes Index Table of Contents

5 Preface The Informatica Cloud Qlik Connector Guide contains information about how to set up and use Qlik Connector. The guide explains how organization administrators and business users can use Qlik Connector to write data to a QVX file so that data can be analyzed and visualized by using Qlik products, such as QlikView and Qlik Sense. Informatica Resources Informatica Documentation To get the latest documentation for your product, browse the Informatica Knowledge Base at If you have questions, comments, or ideas about this documentation, contact the Informatica Documentation team through at infa_documentation@informatica.com. Informatica Cloud Web Site You can access the Informatica Cloud web site at This site contains information about Informatica Cloud editions and applications. Informatica Cloud Communities Use the Informatica Cloud Community to discuss and resolve technical issues in Informatica Cloud. You can also find technical tips, documentation updates, and answers to frequently asked questions. Access the Informatica Cloud Community at: To find resources on using Cloud Application Integration (the Informatica Cloud Real Time service), access the community at: Developers can learn more and share tips at the Cloud Developer community: 5

6 Informatica Cloud Marketplace Visit the Informatica Marketplace to try and buy Informatica Cloud Connectors, Informatica Cloud integration templates, and Data Quality mapplets: Informatica Cloud Connector Documentation You can access documentation for Informatica Cloud Connectors at the Informatica Cloud Community: You can also download individual connector guides: Informatica Knowledge Base Use the Informatica Knowledge Base to search Informatica Network for product resources such as documentation, how-to articles, best practices, and PAMs. To access the Knowledge Base, visit If you have questions, comments, or ideas about the Knowledge Base, contact the Informatica Knowledge Base team at Informatica Cloud Trust Site You can access the Informatica Cloud trust site at This site provides real time information about Informatica Cloud system availability, current and historical data about system performance, and details about Informatica Cloud security policies. Informatica Global Customer Support You can contact a Customer Support Center by telephone or online. For online support, click Submit Support Request in the Informatica Cloud application. You can also use Online Support to log a case. Online Support requires a login. You can request a login at The telephone numbers for Informatica Global Customer Support are available from the Informatica web site at 6 Preface

7 C H A P T E R 1 Introduction to Qlik Connector This chapter includes the following topics: Qlik Connector Overview, 7 Qlik Connector Task and Object Types, 8 Introduction to Qlik, 8 Qlikview Data Exchange File, 8 Qlik Connector Overview You can use Qlik Connector to write data to a Qlikview Data Exchange (QVX) file. You can integrate and transform data from sources, such as flat files, databases, and applications, to write to a QVX output file. You can load the QVX file to Qlik products, such as QlikView or Qlik Sense, to visualize the data and identify patterns and trends. You can use Informatica Cloud to integrate data from multiple sources, filter the data, and perform data transformation. You can use Qlik Connector to make the data available as a QVX file for analysis in Qlik. You can load the QVX file to Qlik Sense to create interactive, real-time dashboards. The visual representation helps you understand the profitability, with views presented by geography, product category, and customer segment. You are a sales analyst in an enterprise and you want to track the overall growth trend in sales, geographic distribution of sales, and top customers, and present a snapshot of the sales distribution to senior executives. You can use Qlik Connector to create a QVX file with sales data. You can load the QVX file in to Qlik Sense and analyze the data. 7

8 Qlik Connector Task and Object Types The following table lists the Qlik object types that you can include in Informatica Cloud tasks: Task Type Source Target Lookup Data Synchronization No Yes No Mapping Configuration No Yes No PowerCenter No No No The following table lists the objects and task operations that Qlik Connector supports: Object Read Insert Update Upsert Delete QVX file No Yes Yes No No Introduction to Qlik Qlik software delivers fast analytics, visualization, and rapid-fire business intelligence. Technical users, such as developers and technical business analysts, can use QlikView to build powerful data visualization and data discovery applications. Business users can use Qlik Sense to create interactive visualizations, reports, and dashboards without the need for programming. Qlikview Data Exchange File A Qlikview Data Exchange (QVX) file contains data extracted from an external data source. The QVX file is a Qlik-specific file format with.qvx extension, which contains individual memory-mapped files for each of the columns in the underlying data source. QVX has a well documented internal structure, optimized for streaming data from a database. You can use the QVX file as input files for Qlik products. 8 Chapter 1: Introduction to Qlik Connector

9 C H A P T E R 2 Qlik Connections This chapter includes the following topics: Qlik Connections Overview, 9 Qlik Connection Properties, 9 Qlik Connections Overview Create a Qlik connection to overwrite or append data to a QVX file. You can write data to a QVX file located in a directory on the machine where you installed the Informatica Cloud runtime. You create a Qlik connection on the Connections page. When you create the Qlik connection, enter the connection attributes that are specific to the QVX file to which you want to connect. Use the Qlik connection when you create a target object in a Data Synchronization task or Mapping Configuration task. Qlik Connection Properties When you set up a Qlik connection, you must configure the connection properties. Connection Property Runtime Environment Template File Path Description The name of the run-time environment where you want to run the tasks. The directory path to a sample QVX file from where the Secure Agent imports the Qlik metadata. Template File Path When you create a Qlik connection, you can specify the directory that contains QVX files. When you configure a Data Synchronization task or Mapping Configuration task, the QVX files that are available in the specified directory appears in the target object list. Select a template QVX file to fetch the metadata from that file. The Secure Agent generates the target object OVX file from the source object based on the data representation in the specified Qlik template file. The path you specify for the template file in the connection properties becomes the default path for the generated target QVX file. 9

10 If you do not use the template file to create a target object, you can create a target by using the Create Target option in a Data Synchronization task or Mapping Configuration task. You need to select the source fields that you want in the target QVX file and provide a name for the target object QVX file. The Secure Agent creates a target QVX file in the specified location. 10 Chapter 2: Qlik Connections

11 C H A P T E R 3 Data Synchronization Tasks with Qlik This chapter includes the following topics: Qlik Targets in Data Synchronization Tasks, 11 Qlik Advanced Target Properties in Data Synchronization Tasks, 11 Data Synchronization Example, 12 Qlik Targets in Data Synchronization Tasks You can specify an insert operation when you create a Qlik target in a Data Synchronization task. You can specify the source data that you want to write to the target QVX file on the Data Synchronization wizard. You configure Qlik target properties on the Target page of the Data Synchronization task wizard. The Secure Agent inserts source data that you specified into the target QVX file. Qlik Advanced Target Properties in Data Synchronization Tasks When you configure a Data Synchronization task, you can configure the advanced target properties. The advanced target properties appear on the Schedule page of the Data Synchronization Task wizard. 11

12 The following table describes the Qlik advanced target properties: Property Write strategy Description The operation type to write data to QVX file. You can choose one of the following operation types to write data to Qlik: append Adds data to an existing QVX file. overwrite Deletes existing data in the QVX file and inserts newly read data. Note: The QVX file to which you want to append data must be created using the Qlik Connector. Target File Directory Target File Name Success File Directory Error File Directory The path to the QVX file to which you want append or overwrite data. Ensure that the directory is located on the machine that hosts the Secure Agent. The name of the QVX file without the.qvx extension. Not applicable. Not applicable. Data Synchronization Example You work in the retail industry, and business analysts in your enterprise need to analyze product sales trends of a particular region. You can use a flat file connection to read the product sales details of a particular region from a flat file. You can use Qlik Connector to append data to the QVX file. Configure a Data Synchronization task with the insert operation to append the product sales details to a QVX file. Source The source for the mapping is a flat file connection that contains the product sales data. The flat file object is a single source in the Data Synchronization task. 12 Chapter 3: Data Synchronization Tasks with Qlik

13 Target Specify the directory of the QVX file to which you want to overwrite or append data. Select the fields from the source object that you want to insert into the target object. Mapping Map the fields of the flat file source to the Qlik target. When you run the Data Synchronization task, the Secure Agent reads from the flat file source and writes to the QVX file based on the fields you mapped. You can load the QVX file to Qlik Sense and analyze the sales trends of a particular region by creating a dashboard and selecting the required filters. Data Synchronization Example 13

14 C H A P T E R 4 Mappings and Mapping Configuration Tasks with Qlik This chapter includes the following topic: Qlik Targets in Mappings, 14 Qlik Targets in Mappings In a mapping, you can configure a Target transformation to represent a single Qlik object. Configure the target and advanced properties for the target object. The following table describes the Qlik target properties that you can configure in a Target transformation: Property Connection Target Type Object Operation Description Name of the connection. Type of the target object. Select Single Object. Name of the target object. Target operation. Select Insert. 14

15 The following table describes the Qlik target advanced properties that you can configure in a Target transformation: Property Write strategy Description The operation type to write data to QVX file. You can choose one of the following operation types to write data to Qlik: append Adds data to an existing QVX file. overwrite Deletes existing data in the QVX file and inserts newly read data. Note: The QVX file to which you want to append data must be created using the Qlik Connector. Target File Directory Target File Name Success File Directory Error File Directory The file path of the existing QVX file to which you want append or overwrite data. Ensure that the directory is located on the machine that hosts the Secure Agent. The name of the QVX file without the.qvx extension. Not applicable. Not applicable. Qlik Targets in Mappings 15

16 A P P E N D I X A Datatype Reference This appendix includes the following topics: Datatype Reference Overview, 16 Qlik and Transformation Datatypes, 17 Datatype Reference Overview Informatica Cloud uses the following datatypes in mappings, Data Synchronization tasks, and Mapping Configuration tasks with Qlik: Qlik native datatypes Qlik data types appear in the Target transformations when you choose to edit metadata for the fields. Transformation datatypes Set of datatypes that appear in the transformations. They are internal datatypes based on ANSI SQL-92 generic datatypes, which the agent uses to move data across platforms. Transformation data types appear in all transformations in a mapping. When Informatica Cloud reads source data, it converts the native data types to the comparable transformation data types before transforming the data. When Informatica Cloud writes to a target, it converts the transformation data types to the comparable native datatypes. 16

17 Qlik and Transformation Datatypes The following table lists the Qlik datatypes that the Data Integration Service supports and the corresponding transformation datatypes: Datatype Transformation Datatype Description UNKOWN String Maximum length of 52,428,800 characters, default length of 255 characters Note: Qlik Connector reads string data from the data source with precision set to 255 characters. Hence, Qlik Connector writes only 255 characters of data read from the data source to the QVX file. ASCII String Maximum length of 52,428,800 characters, default length of 255 characters Note: Qlik Connector reads string data from the data source with precision set to 255 characters. Hence, Qlik Connector writes only 255 characters of data read from the data source to the QVX file. INTEGER Integer(Signed) -2,147,483,648 (-2^31) to 2,147,483,647(inclusive) (2^31-1) Precision of 10 REAL Double Double-precision floating-point numeric value. Precision of 15 FIX Double Double-precision floating-point numeric value. Precision of 15 MONEY Double Double-precision floating-point numeric value. Precision of 15 INTERVAL Double Double-precision floating-point numeric value. Precision of 15 DATE Date Scale of 12 TIME Date Scale of 20 TIMESTAMP Date Scale of 32 Note: When you run a task with the create target option, the last digit is truncated when the source contains one of following datatypes: Real BigInt Decimal Float To resolve this issue, increase the precision by one for the source datatypes by using the Edit Metadata option when you configure the source object. Qlik and Transformation Datatypes 17

18 I n d e x C Cloud Application Integration community URL 5 Cloud Developer community URL 5 I Informatica Cloud Community URL 5 Informatica Cloud web site URL 5 Informatica Global Customer Support contact information 6 T trust site description 6 18