Talend Open Studio for Big Data. Release Notes 6.3.1

Transcription

1 Talend Open Studio for Big Data Release Notes 6.3.1

2 Talend Open Studio for Big Data Adapted for v Supersedes previous releases. Publication date January 19, 2017 Copyleft This documentation is provided under the terms of the Creative Commons Public License (CCPL). For more information about what you can and cannot do with this documentation in accordance with the CCPL, please read: Notices Talend is a trademark of Talend, Inc. All brands, product names, company names, trademarks and service marks are the properties of their respective owners. License Agreement The software described in this documentation is licensed under the Apache License, Version 2.0 (the "License"); you may not use this software except in compliance with the License. You may obtain a copy of the License at Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. This product includes software developed at AOP Alliance (Java/J2EE AOP standards), ASM, Amazon, AntlR, Apache ActiveMQ, Apache Ant, Apache Avro, Apache Axiom, Apache Axis, Apache Axis 2, Apache Batik, Apache CXF, Apache Cassandra, Apache Chemistry, Apache Common Http Client, Apache Common Http Core, Apache Commons, Apache Commons Bcel, Apache Commons JxPath, Apache Commons Lang, Apache Datafu, Apache Derby Database Engine and Embedded JDBC Driver, Apache Geronimo, Apache HCatalog, Apache Hadoop, Apache Hbase, Apache Hive, Apache HttpClient, Apache HttpComponents Client, Apache JAMES, Apache Log4j, Apache Lucene Core, Apache Neethi, Apache Oozie, Apache POI, Apache Parquet, Apache Pig, Apache PiggyBank, Apache ServiceMix, Apache Sqoop, Apache Thrift, Apache Tomcat, Apache Velocity, Apache WSS4J, Apache WebServices Common Utilities, Apache Xml-RPC, Apache Zookeeper, Box Java SDK (V2), CSV Tools, Cloudera HTrace, ConcurrentLinkedHashMap for Java, Couchbase Client, DataNucleus, DataStax Java Driver for Apache Cassandra, Ehcache, Ezmorph, Ganymed SSH-2 for Java, Google APIs Client Library for Java, Google Gson, Groovy, Guava: Google Core Libraries for Java, H2 Embedded Database and JDBC Driver, Hector: A high level Java client for Apache Cassandra, Hibernate BeanValidation API, Hibernate Validator, HighScale Lib, HsqlDB, Ini4j, JClouds, JDO-API, JLine, JSON, JSR 305: Annotations for Software Defect Detection in Java, JUnit, Jackson Java JSON-processor, Java API for RESTful Services, Java Agent for Memory Measurements, Jaxb, Jaxen, JetS3T, Jettison, Jetty, Joda-Time, Json Simple, LZ4: Extremely Fast Compression algorithm, LightCouch, MetaStuff, Metrics API, Metrics Reporter Config, Microsoft Azure SDK for Java, Mondrian, MongoDB Java Driver, Netty, Ning Compression codec for LZF encoding, OpenSAML, Paraccel JDBC Driver, Parboiled, PostgreSQL JDBC Driver, Protocol Buffers - Google's data interchange format, Resty: A simple HTTP REST client for Java, Riak Client, Rocoto, SDSU Java Library, SL4J: Simple Logging Facade for Java, SQLite JDBC Driver, Scala Lang, Simple API for CSS, Snappy for Java a fast compressor/ decompresser, SpyMemCached, SshJ, StAX API, StAXON - JSON via StAX, Super SCV, The Castor Project, The Legion of the Bouncy Castle, Twitter4J, Uuid, W3C, Windows Azure Storage libraries for Java, Woden, Woodstox: High-performance XML processor, Xalan-J, Xerces2, XmlBeans, XmlSchema Core, Xmlsec - Apache Santuario, YAML parser and emitter for Java, Zip4J, atinject, dropbox-sdk-java: Java library for the Dropbox Core API, google-guice. Licensed under their respective license.

3 Table of Contents System Requirements... 1 Big Data: New Features Upgraded support for Hadoop MapR-DB and MapR Streams support Enhanced Kafka support Support of HDFS Encryption AWS instance role and assume role Automatic data type conversion Data type mapping configurations S3 multipart upload Microsoft CRM Other new components Other version upgrades... 4 Big Data: Deprecated Items... 5 Big Data: Bug Fixes / Change Log Bug Fixes... 6 Big Data: Known Issues... 7 Documentation Talend Help Center Videos New documents Revised documents Open issues... 8 Talend Open Studio for Big Data Release Notes

4 System Requirements System Requirements Users should refer to the Talend Installation and Upgrade Guide on the Talend Help Center ( help.talend.com) for more information on Installation and System Requirements. Talend Open Studio for Big Data Release Notes 1

5 Big Data: New Features Big Data: New Features 1. Upgraded support for Hadoop 1. New versions of the following Hadoop distributions are supported: Cloudera CDH V5.8.0 Hortonworks Data Platform V2.5.0 MapR V5.2.0 EMR V MapR-DB and MapR Streams support The Studio now includes MapR-DB and MapR Streams support via the following new components: MapR-DB tmaprdbconnection tmaprdbinput tmaprdboutput tmaprdbclose MapR Streams tmaprstreamsconnection tmaprstreamscommit tmaprstreamscreatestream tmaprstreamsinput tmaprstreamsoutput 3. Enhanced Kafka support The support of Kafka 0.10 has been added with security options. 4. Support of HDFS Encryption The HDFS transparent encryption is now supported. Talend Open Studio for Big Data Release Notes 2

6 Big Data: New Features 5. AWS instance role and assume role The instance role feature, which allows you to load credentials from the Amazon EC2 Instance Metadata Service, and the assume role feature, which allows you to use the AWS Security Token Service to assume a Role and create temporary and short-lived sessions to use for authentication, are now supported in the following components: tdynamodbinput and tdynamodboutput tamazonemrlistinstances, tamazonemrmanage, and tamazonemrresize tamazonredshiftmanage ts3bucketcreate, ts3bucketdelete, ts3bucketexist, ts3bucketlist, ts3connection, ts3copy, ts3delete, ts3get, ts3list, and ts3put 6. Automatic data type conversion In standard data integration Jobs, tmap now supports automatic data type conversion at Job execution to avoid compiling errors caused by type mismatch between input and output data flows. While it can be enabled in tmap in individual Jobs, this feature can also be activated globally in Project Settings so that any tmap component added afterwards will have this feature enabled. The default conversion behavior of tmap can be overridden by adding conversion rules in Project Settings. 7. Data type mapping configurations The configurations of mappings between Talend data types and database data types can now be managed at the project level. 8. S3 multipart upload The ts3put component now supports the multipart upload feature, which allows you to upload a single object as a set of parts. 9. Microsoft CRM The tmicrosoftcrmoutput component can now write the empty lookup string into Microsoft CRM as NULL value instead of empty string. 10. Other new components Amazon SQS support Amazon SQS (Simple Queue Service) is now supported via the following seven new components: Talend Open Studio for Big Data Release Notes 3

7 Big Data: New Features tsqsconnection tsqsinput tsqsoutput tsqsqueuecreate tsqsqueuedelete tsqsqueuelist tsqsqueuepurge FTP connection The new component tftpclose, which allows you to close an active connection to an FTP server, has been created. 11. Other version upgrades Bonita Bonita v7.2.4 is now supported Dropbox The Dropbox API has been upgraded from v1.7.5 to v MS SQL Server Microsft Azure and Microsft SQL Server 2014 and 2016 are now supported Salesforce The Salesforce v37 is now supported ActiveMQ ActiveMQ is now supported. Talend Open Studio for Big Data Release Notes 4

8 Big Data: Deprecated Items Big Data: Deprecated Items The following feature is deprecated in the current release. Deprecated features are no longer recommended for use and may cease to exist in future versions of the product. The talfrescooutput component The HL7 metadata wizard and the thl7input and thl7output components Talend Open Studio for Big Data Release Notes 5

9 Big Data: Bug Fixes / Change Log Big Data: Bug Fixes / Change Log 1. Bug Fixes In addition to the above new features a number of minor improvements within the entire product and significant bug fixes have been made. See the corresponding Change Log on our bug tracking system for more details on the individual issues: Talend Open Studio for Big Data Release Notes 6

10 Big Data: Known Issues Big Data: Known Issues We encourage you to consult the JIRA bug tracking tool for a full list of open issues: Note that this list shows issues from both Talend's Community and Subscription products. Talend Open Studio for Big Data Release Notes 7

11 Documentation Documentation 1. Talend Help Center Find out more about how to get the most out of your Talend products on the Talend Help Center: help.talend.com. 2. Videos From within the Studio, you can directly access the videos hosted in Talend Help Center relating to new features. For components, related videos are available from the F1 help view of this component. For other features, related videos are available in the help view of the wizard for the feature. Note that not every feature has related videos in Talend Help Center and for this reason, not all the features have this type of access. 3. New documents The following new documents have been added in this release: Talend Data Stewardship User Guide and Talend Data Stewardship Getting Started Guide are two new guides that accompany the new product, Talend Data Stewardship. They are both available in PDF format and online at pageid= Revised documents In addition to updates to the content across the documentation set, the following specific documentation changes have been made: In the Talend Software Development Life Cycle Best Practices Guide, major changes have been made to the documentation of the Talend CI Builder, including how to generate sources locally, how to manage POM files, artefact versions, and how to filter executions on specific items. 5. Open issues We encourage you to consult the JIRA bug tracking tool for a full list of open issues: Talend Open Studio for Big Data Release Notes 8