TPT-TDCH - Error : TPT19618 The version of Hadoop installed is not recent enough

Tools
Teradata Employee

TPT-TDCH - Error : TPT19618 The version of Hadoop installed is not recent enough

Hi

 

The following error happend when I try to use TPT-TDCH to load data from TD to HDP.

"TPT19618 The version of Hadoop installed is not recent enough.  Please upgrade to at least 1.2."

 

The version of Hortonwork Hadoop I have is 2.7 as the image shows:

HDP_version.PNG

 

And this is the TPT log:

Teradata Parallel Transporter Version 15.10.00.03 64-Bit
-2.outg: /opt/teradata/client/15.10/tbuild/logs/PTS00032
-2, running on TD-EXPRESS
Teradata Parallel Transporter DataConnector Operator Version 15.10.00.03
Teradata Parallel Transporter Export Operator Version 15.10.00.03
$EXPORT: private log not specified
$DATACONNECTOR_CONSUMER[1]: Instance 1 directing private log report to 'dtacop-root-16170-1'.
$EXPORT: connecting sessions
$DATACONNECTOR_CONSUMER[1]: DataConnector Consumer operator Instances: 1
$DATACONNECTOR_CONSUMER[1]: ECI operator ID: '$DATACONNECTOR_CONSUMER-16170'
$DATACONNECTOR_CONSUMER[1]: Operator instance 1 processing file 'Account_Type_2_2'.
sh: hadoop: command not found
$DATACONNECTOR_CONSUMER[1]: TPT19618 The version of Hadoop installed is not recent enough. Please upgrade to at least 1.2.
$DATACONNECTOR_CONSUMER[1]: TPT19015 TPT Exit code set to 12.
$DATACONNECTOR_CONSUMER[1]: TPT19609 After 60 seconds, all clients have not connected; a timeout has occurred.
$DATACONNECTOR_CONSUMER[1]: TPT19434 pmGetPos failed. General failure (34): 'Unknown Access Module failure'
$DATACONNECTOR_CONSUMER[1]: TPT19307 Fatal error checkpointing data.
$DATACONNECTOR_CONSUMER[1]: TPT19610 A failure occurred while writing to the Hadoop client. See log TDCH-TPT_log_16170.txt in TPT logs directory for details.
$EXPORT: disconnecting sessions
$DATACONNECTOR_CONSUMER[1]: Total files processed: 0.
$EXPORT: Total processor time used = '0.09 Second(s)'
$EXPORT: Start : Fri Jun 9 13:28:11 2017
$EXPORT: End : Fri Jun 9 13:29:14 2017
Job step MAIN_STEP terminated (status 12)
terminated (status 12)
Job start: Fri Jun 9 13:28:09 2017
Job end: Fri Jun 9 13:29:14 2017

 

But I've allready load data with TD Studio successfuly.

 

Did anyone have this error? Any Suggestion?

 

Thanks!!

 

4 REPLIES
Enthusiast

Re: TPT-TDCH - Error : TPT19618 The version of Hadoop installed is not recent enough

Hi, Are you running the job from edge node of the Hadoop cluster or some other node outside Hadoop cluster? Please try to run from any edge node of the Hadoop Cluster (although TPT is a client tool and can be run from any other node other than edge node).
Teradata Employee

Re: TPT-TDCH - Error : TPT19618 The version of Hadoop installed is not recent enough

No before, but now yes.
But TPT doesn't run in the edge node because the HADOOP environment variables don't exist in Hortonworks VM.

 

Do you know which variables are necessary to set?

Teradata Employee

Re: TPT-TDCH - Error : TPT19618 The version of Hadoop installed is not recent enough

The TPT documentation will describe which environment variables need to be set, and which operator attributes need to be set.

 

-- SteveF
Teradata Employee

Re: TPT-TDCH - Error : TPT19618 The version of Hadoop installed is not recent enough

Hi

 

I've already set all the variables, but now I'm getting the following error:

 

TPT log:

Teradata Parallel Transporter Version 15.10.00.04 64-Bit
Job log: /opt/teradata/client/15.10/tbuild/logs/PTS00032-12.out
Job id is PTS00032-12, running on sandbox.hortonworks.com
Found CheckPoint file: /opt/teradata/client/15.10/tbuild/checkpoint/PTS00032LVCP
This is a restart job; it restarts at step MAIN_STEP.
Teradata Parallel Transporter Export Operator Version 15.10.00.04
$EXPORT: private log not specified
Teradata Parallel Transporter DataConnector Operator Version 15.10.00.04
$DATACONNECTOR_CONSUMER[1]: Instance 1 directing private log report to 'dtacop-root-19665-1'.
$DATACONNECTOR_CONSUMER[1]: DataConnector Consumer operator Instances: 1
$DATACONNECTOR_CONSUMER[1]: ECI operator ID: '$DATACONNECTOR_CONSUMER-19665'
$DATACONNECTOR_CONSUMER[1]: Operator instance 1 processing file 'Account_Type_2_2'.
$EXPORT: connecting sessions
$DATACONNECTOR_CONSUMER[1]: TPT19603 Failed to launch TDCH client. See log TDCH-TPT_log_19665.txt in TPT logs directory for details.
$DATACONNECTOR_CONSUMER[1]: TPT19015 TPT Exit code set to 12.
$DATACONNECTOR_CONSUMER[1]: TPT19434 pmGetPos failed. General failure (34): 'Unknown Access Module failure'
$DATACONNECTOR_CONSUMER[1]: TPT19307 Fatal error checkpointing data.
$EXPORT: disconnecting sessions
$DATACONNECTOR_CONSUMER[1]: Total files processed: 0.
$EXPORT: Total processor time used = '0.06 Second(s)'
$EXPORT: Start : Wed Jun 28 11:48:05 2017
$EXPORT: End : Wed Jun 28 11:48:07 2017
Job step MAIN_STEP terminated (status 12)
Job PTS00032 terminated (status 12)
Job start: Wed Jun 28 11:48:03 2017
Job end: Wed Jun 28 11:48:07 2017

 

And this is the TDCH-TPT_log_19665.txt file:

 

WARNING: Use "yarn jar" to launch YARN applications.
17/06/28 11:48:06 INFO tool.ConnectorImportTool: ConnectorImportTool starts at 1498650486373
17/06/28 11:48:06 INFO tool.ConnectorImportTool: java.io.FileNotFoundException: File /usr/hdp/current/hive-client/lib/ojdbc6.jar does not exist.
at org.apache.hadoop.util.GenericOptionsParser.validateFiles(GenericOptionsParser.java:405)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:299)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.teradata.connector.common.tool.ConnectorImportTool.main(ConnectorImportTool.java:721)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

17/06/28 11:48:06 INFO tool.ConnectorImportTool: job completed with exit code 10000

 

Could you tell me if the error is because of the Warning (I think that has something to do with HCATALOG) or is because of the ojdbc6.jar file (It's weird since the file exists in the directory)?

 

Thanks.