teradata.connector.plugins.xml

Hadoop

teradata.connector.plugins.xml

Hi, 

I am trying to import data to hive (HDP 2.4) from teradata 14.10 using TDCH. 

TDCH ver is 1.3.4 as for 1.4.1 the hadoop jar .... command gives invalid jar file error. here is command i am using. 


export HADOOP_HOME=/usr/hdp/current/hadoop-client/

export HIVE_HOME=/usr/hdp/current/hive-client/

export HCAT_HOME=/usr/hdp/current/hive-webhcat/

export USERLIBTDCH=/usr/lib/tdch/1.3/lib/teradata-connector-1.3.4.jar

export LIB_JARS=/usr/hdp/2.4.0.0-169/sqoop/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/sqoop/lib/avro-mapred-1.7.5-hadoop2.jar,$HIVE_HOME/conf,$HIVE_HOME/lib/antlr-runtime-3.4.jar,$HIVE_HOME/lib/commons-dbcp-1.4.jar,$HIVE_HOME/lib/commons-pool-1.5.4.jar,$HIVE_HOME/lib/datanucleus-api-jdo-3.2.6.jar,$HIVE_HOME/lib/datanucleus-core-3.2.10.jar,$HIVE_HOME/lib/datanucleus-rdbms-3.2.9.jar,$HIVE_HOME/lib/hive-cli.jar,$HIVE_HOME/lib/hive-exec.jar,$HIVE_HOME/lib/hive-jdbc.jar,$HIVE_HOME/lib/hive-metastore.jar,$HIVE_HOME/lib/jdo-api-3.0.1.jar,$HIVE_HOME/lib/libfb303-0.9.2.jar,$HIVE_HOME/lib/libthrift-0.9.2.jar,$HCAT_HOME/share/hcatalog/hive-hcatalog-core.jar,/usr/lib/ambari-agent/DBConnectionVerification.jar



yarn jar $USERLIBTDCH com.teradata.connector.common.tool.ConnectorImportTool -libjars $LIB_JARS \

-url jdbc:teradata://ipaddress/database=db1 -username user1 -password pwd1 \

-jobtype hive -fileformat rcfile -sourcetable ITEM_GROUP_TYPE  -nummappers 1 \

-targettable ITEM_GROUP_TYPE

when i run above command. following error is returned

16/07/30 21:33:46 INFO tool.ConnectorImportTool: ConnectorImportTool starts at 1469914426192

16/07/30 21:33:49 INFO common.ConnectorPlugin: load plugins in file:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/hadoop-unjar561556663592675147/teradata.connector.plugins.xml

16/07/30 21:33:50 INFO tool.ConnectorImportTool: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/metastore/api/NoSuchObjectException

        at com.teradata.connector.common.tool.ConnectorImportTool.processArgs(ConnectorImportTool.java:607)

        at com.teradata.connector.common.tool.ConnectorImportTool.run(ConnectorImportTool.java:57)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)

        at com.teradata.connector.common.tool.ConnectorImportTool.main(ConnectorImportTool.java:721)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.metastore.api.NoSuchObjectException

there is no such file created /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/hadoop-unjar561556663592675147/teradata.connector.plugins.xml

am i missing something in commadn line or do i need to install any pluging explicity?

Thanks