2 Oracle Data Integrator Console Issues and Workarounds

Transcription

1 Oracle Fusio Middleware Release Notes for Oracle Data Itegrator 12c (12.2.1) E October 2015 This documet describes kow issues associated with Oracle Data Itegrator ad icludes iformatio regardig post-istallatio patches. It icludes the followig sectios: Sectio 1, "Oracle Data Itegrator ReadMe File" Sectio 2, "Oracle Data Itegrator Cosole Issues ad Workarouds" Sectio 3, "Cofiguratio Issues ad Workarouds" Sectio 4, "Desig-Time Eviromet Issues ad Workarouds" Sectio 5, "Techologies ad Kowledge Module Issues ad Workarouds" Sectio 6, "Post-istall Patch Iformatio for Oracle Data Itegrator 12c" 1 Oracle Data Itegrator ReadMe File A ReadMe file is icluded i your distributio. It is located i the top level directory of the zip. The ReadMe file icludes iformatio about this release (features, prerequisites, istall/uistall istructios). You must use the ReadMe file to istall ODI Please read the etire ReadMe file before proceedig. 2 Oracle Data Itegrator Cosole Issues ad Workarouds This sectio cotais iformatio o the followig: Sectio 2.1, "Accessibility Settigs are Not Workig" 2.1 Accessibility Settigs are Not Workig Accessibility settigs ca oly be applied to the compoets whose accessibility settigs are ot maaged at the ADF level. [ ] 3 Cofiguratio Issues ad Workarouds This sectio cotais iformatio o the followig issues: Sectio 3.1, "999 is a Prohibited Master Repository ID" Sectio 3.2, "Domai Assisted Schema Upgrade (DASU) Does Not Pre-populate ODI Supervisor Credetials" is a Prohibited Master Repository ID 999 is a prohibited master repository ID ad should ot be used. [ ] 1

2 3.2 Domai Assisted Schema Upgrade (DASU) Does Not Pre-populate ODI Supervisor Credetials I the Oracle Fusio Middleware Upgrade Assistat, whe the All Schemas Used by Domai optio is selected, the Supervisor credetials for ODI are ot pre-populated i the first istace as the domai does ot cotai them. If there are multiple ODI schemas, the Upgrade Assistat populates the user etry usig the first set of credetials. [ ] 4 Desig-Time Eviromet Issues ad Workarouds This sectio cotais iformatio o the followig issues: Sectio 4.1, "Prefereces that are Not Used i Oracle Data Itegrator Appear i ODI Studio" Sectio 4.2, "Attributes are Not Copied whe Duplicatig a New Datastore" Sectio 4.3, "Uable to Geerate a Sceario Usig the Cliet Library Package" Sectio 4.4, "No-ASCII Characters i a Hive Table are Not Displayed Properly" 4.1 Prefereces that are Not Used i Oracle Data Itegrator Appear i ODI Studio Prefereces that are ot used i ODI are gettig picked up from the JDeveloper IDE by default ad these features appear i ODI Studio > Tools > Prefereces. [ ] 4.2 Attributes are Not Copied whe Duplicatig a New Datastore If you attempt to duplicate a ewly created datastore with attributes without first closig the tab of the ewly created datastore, the attributes are ot copied. As a workaroud, save ad close the ewly created datastore with attributes before selectig Duplicate Selectio. [ ] 4.3 Uable to Geerate a Sceario Usig the Cliet Library Package If you attempt to geerate a sceario for a map usig the cliet library package, the followig error is displayed: java.lag.noclassdeffouderror: groovy/lag/bidig As a workaroud, copy MW_HOME/oracle_commo/modules/groovy-all jar locally ad add the jar file to the classpath. [ ] 4.4 No-ASCII Characters i a Hive Table are Not Displayed Properly No-ASCII characters i a Hive table that is based o a utf-8 ecoded file are ot displayed properly. As a workaroud, specify -J-Dfile.ecodig=utf8 ad start ODI Studio to view No-ASCII characters i a Hive table. [ ] 5 Techologies ad Kowledge Module Issues ad Workarouds This sectio cotais iformatio o the followig issues: Sectio 5.1, "LKM Hive to File Direct Fails whe Exportig to HDFS" Sectio 5.2, "Log Files are Deleted Eve i Case of Failure whe Usig the OdiOSCommad o Oozie" Sectio 5.3, "Error Displayed Durig Oozie Iitializatio" 2

3 Sectio 5.4, "SQOOP KMs Fail o Oozie" Sectio 5.5, "Teradata ad SQL Server Do Not Allow ORDER BY i Subqueries" Sectio 5.6, "Pig Does Not Provide Implicit Type Coversio" Sectio 5.7, "Mappig Executio Fails i Pig" Sectio 5.8, "Complex Aggregatio Not Supported by Pig Lati" Sectio 5.9, "Mappig Editor May Not Display All Template IKMs" Sectio 5.10, "Date Compariso May Not Work as Expected if the Date is a Strig Datatype" Sectio 5.11, "LKM File to Oracle (Exteral Table) Limitatio" Sectio 5.12, "XKM SQL Distict Limitatio" Sectio 5.13, "The UNION_DISTINCT Pig Operator Does Not Remove Duplicate Outputs" Sectio 5.14, "Log Level ad Log File Not Displayed i the Complex File Dataserver Properties" Sectio 5.15, "BiaryType Data Type Not Supported i Spark 1.1" Sectio 5.16, "Hive Complex Datatypes Not Supported by LKM Spark to Hive" Sectio 5.17, "Uable to Store Alias Error i Pig" Sectio 5.18, "KMs Replaced Durig Repository Upgrade" Sectio 5.19, "Erroeously Published SDK API Classes Removed from the Javadocs" 5.1 LKM Hive to File Direct Fails whe Exportig to HDFS Whe executig a mappig usig LKM Hive to File Direct, it fails ad the followig error is displayed: ODI-1227: Task Uload Hive data-lkm Hive to File Direct- fails o the source coectio HIVE_DATA_SERVER This is caused due to Hive bugs, HIVE-5672 ad HIVE-6410, which cause the INSERT OVERWRITE statemet to fail whe writig to HDFS. Please ote that these Hive bugs are already fixed ad the issue is resolved whe upgraded to a recet versio of CDH ad Hortoworks. [ ] 5.2 Log Files are Deleted Eve i Case of Failure whe Usig the OdiOSCommad o Oozie May KMs that use OdiOSCommad use the OUT_FILE/ERR_FILE parameters to redirect output ito log files.the directory for such files is based o the KM optio TEMP_DIR, which uses a default value of System.getProperty("java.io.tmpdir"). This causes ODI o Oozie to use a Oozie job temporary directory, which gets cleaed up o job completio, irrespective of whether or ot the job was successful. This results i the log files ot beig available after executio. As a workaroud, whe executig o Oozie, overwrite the KM optio TEMP_DIR to a specific temporary directory. [ ] 5.3 Error Displayed Durig Oozie Iitializatio There is a issue with the OdiLogRetriever.properties file ad the oozie.coord.applicatio.path value does ot get appeded to it ad the followig error is displayed: [ ] E0504: App directory does't exist 3

4 5.4 SQOOP KMs Fail o Oozie KMs usig SQOOP fail whe executed o Oozie o a CDH versio prior to As a workaroud, set KM optio EXTRA_HADOOP_CONF_PROPERTIES to --skip-dist-cache. Aother workaroud for this issue is to upload all SQOOP jars ito HDFS i the directory reported i FileNotFoudExceptio. For example: [ ] hdfs dfs -mkdir -p /opt/cloudera/parcels/cdh cdh5.3.0.p0.30/jars hdfs dfs -copyfromlocal /opt/cloudera/parcels/cdh cdh5.3.0.p0.30/jars/* /opt/cloudera/parcels/cdh cdh5.3.0.p0.30/jars 5.5 Teradata ad SQL Server Do Not Allow ORDER BY i Subqueries Teradata ad SQL Server do ot allow ORDER BY i subqueries. [ , ] 5.6 Pig Does Not Provide Implicit Type Coversio Whe specifyig costat expressios, the datatype for the costat must exactly match the attribute datatype because Pig does ot provide implicit type coversio. For example, if the attribute is defied as DOUBLE, the costat expressio for this attribute should be set to istead of 999. [ ] 5.7 Mappig Executio Fails i Pig Whe a mappig is processed usig Pig ad there is a Aggregate compoet i the Pig stagig area, the Havig clause must be set differetly from similar mappigs for SQL-based techologies. [ ] 5.8 Complex Aggregatio Not Supported by Pig Lati Whe usig the Aggregate compoet i Pig stagig, you caot specify a complex expressio i a aggregate fuctio, for example, SUM(source.col1 + source.col2). This kid of aggregatio is called "complex aggregatio" ad Pig Lati does ot support this. If complex expressio is eeded, the Expressio compoet must be added to the mappig ahead of the Aggregate compoet. [ ] 5.9 Mappig Editor May Not Display All Template IKMs The Mappig Editor may ot correctly list the imported Template IKMs for selectio. To list the imported IKMs, you must chage the Target Itegratio type from its default (Cotrol Apped) to either Icremetal Update or Noe. [ ] 5.10 Date Compariso May Not Work as Expected if the Date is a Strig Datatype I the Spark project, if the source file uses File techology, ODI coverts the Date ito a strig datatype. This may cause the Date compariso to fail. [ ] 5.11 LKM File to Oracle (Exteral Table) Limitatio Whe executig a mappig, it may fail at the Create Work View task ad the followig error may be displayed: ODI-1228: Task Create work view-lkm File to Oracle (EXTERNAL TABLE)- fails o the target coectio SVR2_ ORACLE. Caused By: java.sql.sqlsytaxerrorexceptio: ORA-00955: ame is already used by a existig object 4

5 This happes whe the work table ame is trucated to meet the maximum legth specified i Oracle DB. To resolve this issue, check the Use uique Temporary Object Names optio i the Physical Mappig tab. [ ] 5.12 XKM SQL Distict Limitatio Whe a mappig is created with Oracle as source ad Oracle as target usig a Distict compoet ad the XKM SQL Distict is selected i the DISTINCT ode, the mappig fails ad the followig error is displayed: The physical ode DISTINCT_ caot be supported by techology Oracle o executio uit src_unit of mappig Mappig New_Mappig[11] owig folder=odiogg.first Folder To resolve this issue, upgrade the topology iformatio so Support Distict Operator is set to True. [ ] 5.13 The UNION_DISTINCT Pig Operator Does Not Remove Duplicate Outputs The UNION Pig operator uses the followig modifiers to specify the uiqueess characteristic: [ ] uspecified Perform a DISTINCT operatio o output DISTINCT Perform a DISTINCT operatio o iput, but ot output ALL Do ot perform a DISTINCT operatio o iput or output 5.14 Log Level ad Log File Not Displayed i the Complex File Dataserver Properties Whe creatig a Complex File dataserver, the log level (ll) ad log file (lf) properties are ot displayed i the Properties tab. [ ] 5.15 BiaryType Data Type Not Supported i Spark 1.1 The Hive datatype, BiaryType, is ot supported i Spark 1.1. Whe usig LKM Hive to Spark with Spark 1.1 the followig error is displayed i the Spark executio log: [ , ] HIVE ValueError: ot supported type: <type 'bytearray'> 5.16 Hive Complex Datatypes Not Supported by LKM Spark to Hive The followig Hive complex datatypes are ot supported: MapType UioType ArrayType Usig these complex datatypes causes a ukow issue. [ , ] 5.17 Uable to Store Alias Error i Pig If the mappig executio i Pig fails ad the Uable to store alias error is displayed, the pig.optimizer.rules.disabled property for the Pig server should be set to FilterLogicExpressioSimplifier. [ ] 5.18 KMs Replaced Durig Repository Upgrade By default, all loaded KMs i the repository are replaced durig repository upgrade, irrespective of whether they are modified or ot. Do ot upgrade the KMs durig repository upgrade. 5

6 The followig are the workarouds to upgrade the KMs: If you have SAP KMs, you must ot upgrade the KMs durig repository upgrade. The ew SAP KMs require ew ODI SAP compoets. Usig ew SAP KMs with old ODI SAP compoets causes ay SAP mappigs to fail. As a workaroud, ucheck Replace KMs with Madatory Updates whe upgradig the ODI repositories. To upgrade SAP KMs, follow the upgrade istructios give i the Applicatio Adapters Guide for Oracle Data Itegrator for the respective ODI SAP adapter. If you have ay custom KMs, the customizatios are lost if you upgrade the KMs durig repository upgrade. As a workaroud, ucheck Replace KMs with Madatory Updates whe upgradig the ODI repositories. After you upgrade the repositories, maually replace oly those KMs that you wat to upgrade Erroeously Published SDK API Classes Removed from the Javadocs Due to a bug i Javadoc geeratio, 41 iteral classes were erroeously published i the , , ad public SDK API Javadocs. These classes were iteded for iteral use ad have bee removed from the public SDK APIs. The classes removed from the Javadocs are listed below ad if you are usig ay of these classes i your program, correct your program ad remove their usage: [ ] AdapterExceptio CompoetDefiitioParser CompoetRegistryHelper ExecutioUit.GeeratioType FCONamedObject FCOPropertyOwer FCORoot IMapRefereceOwer IMappigObject.SycState IModelObjectChage IModelObjectChage.ChageType IObjectAdapterFactory LocatioAdapterBase MapAttribute.CoectioTypeIfo MapAttribute.CoectioTypeSelector MapAttribute.DefaultCoectioTypeSelector MapCompoet MapCompoetOwer MapCompoetType.uidef MapPhysicalDesig.CotextualCompoetTreeNode MapPhysicalDesig.ExecutioUitCofiguratio MapPhysicalDesig.ExecutioUitGraph MapPhysicalDesig.ExecutioUitGraphNode 6

7 MapPhysicalDesig.MapPhysicalDesigCofig MapPhysicalDesig.NodeCofiguratio MapPhysicalDesig.PushDirectio MapPhysicalNode.RMCStackPropertyMaager MapRootCotaier MappigGeericTechology.MappigLaguage MappigGeericTechology.MappigLaguageElemet MappigGeericTechology.MappigSubLaguage NamedObject OdiCompoet OdiIterface.IPersisteceComparable PropertyOwer ResourceLoader ResourceLoader.ResourceCadidate ReusableMappigCompoet.RMCCoectorPoitDelegate Root RootIssue.TextPos TargetLoadOrderExceptio 6 Post-istall Patch Iformatio for Oracle Data Itegrator 12c After istallig Oracle Data Itegrator 12c (12.2.1) you should preform the followig: 1. Make a backup of your ODI repository schema. 2. Upgrade all ODI repositories associated with the istallatio usig the Upgrade Assistat. See your Upgrade documetatio for detailed upgrade istructios. Warig: Oce the ODI repository is upgraded it caot be reverted back eve if you remove the patch. So make sure you make a proper backup of your existig ODI repository so that it ca be restored if you remove this patch i the future for ay reaso. 3. For settig up ew domais with this patch, follow the istructios i Oracle Fusio Middleware Istallig ad Cofigurig Oracle Data Itegrator. 4. Clearig of the JDev cache is required for all istallatios where the ODI Cliet is to be lauched: For Uix platforms Locate system i your Home directory ad remove it. For example: rm -rf $HOME/.odi/system For Widows platforms: Locate system i your Home directory ad remove it. 7

8 For example: delete C:\Users\<userame>\AppData\Roamig\odi 5. Start ODI Studio. 6. Depedig upo the istallatio type, start Stadaloe Aget or all servers (AdmiServer ad all Maaged server(s)). 7 Documetatio Accessibility For iformatio about Oracle's commitmet to accessibility, visit the Oracle Accessibility Program website at Access to Oracle Support Oracle customers that have purchased support have access to electroic support through My Oracle Support. For iformatio, visit or visit if you are hearig impaired. Oracle Fusio Middleware Release Notes for Oracle Data Itegrator, 12c (12.2.1) E Copyright 2010, 2015, Oracle ad/or its affiliates. All rights reserved. This software ad related documetatio are provided uder a licese agreemet cotaiig restrictios o use ad disclosure ad are protected by itellectual property laws. Except as expressly permitted i your licese agreemet or allowed by law, you may ot use, copy, reproduce, traslate, broadcast, modify, licese, trasmit, distribute, exhibit, perform, publish, or display ay part, i ay form, or by ay meas. Reverse egieerig, disassembly, or decompilatio of this software, uless required by law for iteroperability, is prohibited. The iformatio cotaied herei is subject to chage without otice ad is ot warrated to be error-free. If you fid ay errors, please report them to us i writig. If this is software or related documetatio that is delivered to the U.S. Govermet or ayoe licesig it o behalf of the U.S. Govermet, the the followig otice is applicable: U.S. GOVERNMENT END USERS: Oracle programs, icludig ay operatig system, itegrated software, ay programs istalled o the hardware, ad/or documetatio, delivered to U.S. Govermet ed users are "commercial computer software" pursuat to the applicable Federal Acquisitio Regulatio ad agecy-specific supplemetal regulatios. As such, use, duplicatio, disclosure, modificatio, ad adaptatio of the programs, icludig ay operatig system, itegrated software, ay programs istalled o the hardware, ad/or documetatio, shall be subject to licese terms ad licese restrictios applicable to the programs. No other rights are grated to the U.S. Govermet. This software or hardware is developed for geeral use i a variety of iformatio maagemet applicatios. It is ot developed or iteded for use i ay iheretly dagerous applicatios, icludig applicatios that may create a risk of persoal ijury. If you use this software or hardware i dagerous applicatios, the you shall be resposible to take all appropriate fail-safe, backup, redudacy, ad other measures to esure its safe use. Oracle Corporatio ad its affiliates disclaim ay liability for ay damages caused by use of this software or hardware i dagerous applicatios. Oracle ad Java are registered trademarks of Oracle ad/or its affiliates. Other ames may be trademarks of their respective owers. Itel ad Itel Xeo are trademarks or registered trademarks of Itel Corporatio. All SPARC trademarks are used uder licese ad are trademarks or registered trademarks of SPARC Iteratioal, Ic. AMD, Optero, the AMD logo, ad the AMD Optero logo are trademarks or registered trademarks of Advaced Micro Devices. UNIX is a registered trademark of The Ope Group. This software or hardware ad documetatio may provide access to or iformatio about cotet, products, ad services from third parties. Oracle Corporatio ad its affiliates are ot resposible for ad expressly disclaim all warraties of ay kid with respect to third-party cotet, products, ad services uless otherwise set forth i a applicable agreemet betwee you ad Oracle. Oracle Corporatio ad its affiliates will ot be resposible for ay loss, costs, or damages icurred due to your access to or use of third-party cotet, products, or services, except as set forth i a applicable agreemet betwee you ad Oracle. 8