Loading Data from Oracle to Hive using TDCH-TPT

Tools
Enthusiast

Loading Data from Oracle to Hive using TDCH-TPT

Hi, We have TPT 15.10.xx.xx and TDCH as 1.4. We have TPT installed in Linux (CentOS release 6.8). We are running tbuild command from Hadoop edge node where TPT is installed. When we are loading data from Teradata to Hive using TDCH-TPT, we are having success and we are able to load data to Hive table. But now, we want to read data from Oracle source (using ODBC operator) and write to Hive table (using DATACONNECTOR CONSUMER). In DATACONNECTOR operator, we are using HadoopHost, HadoopJobType (Hive), HadoopFileFormat (ORCFile), HadoopTargetDatabase, HadoopTargetTable, HadoopUser variables. 1) Is it possible to read data from Oracle and writing the same to Hive table? 2) While running the job, we are getting below error: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 17/06/16 02:53:01 INFO processor.IDataStreamInputProcessor: input preprocessor com.teradata.connector.idatastream.processor.IDataStreamInputProcessor starts at: 1497595981229 17/06/16 02:53:01 INFO processor.IDataStreamInputProcessor: the teradata connector for hadoop version is: 1.4.1 17/06/16 02:53:01 WARN tool.ConnectorJobRunner: com.teradata.connector.common.exception.ConnectorException: The output post processor returns 1 17/06/16 02:53:01 INFO tool.ConnectorImportTool: com.teradata.connector.common.exception.ConnectorException: One or more of the types defined in the IDataStream schema are currently unsupported by the IDataStream plugin at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:140) at com.teradata.connector.common.tool.ConnectorImportTool.run(ConnectorImportTool.java:67) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90) at com.teradata.connector.common.tool.ConnectorImportTool.main(ConnectorImportTool.java:745) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 17/06/16 02:53:01 INFO tool.ConnectorImportTool: job completed with exit code 60005 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Can someone help us on this issue? Thanks & Regards, Arpan.
Tags (5)
1 REPLY
Enthusiast

Re: Loading Data from Oracle to Hive using TDCH-TPT

Hi All, Can some one please help us on this? Thanks & Regards, Arpan.