TPT Script - Import from TD into HDFS.

Tools
Enthusiast

TPT Script - Import from TD into HDFS.

I've been searching for this in documentation all day, maybe someone knows this already.

I have read that since version 15.0, it's possible to go from a TPT script directly into HDFS. Right now my script creates the file in local, then uploads it, then deletes it. Anyway to to this more efficiently? Maybe a code sample I can reverse engineer?

5 REPLIES
Teradata Employee

Re: TPT Script - Import from TD into HDFS.

As with any other TD-to-flat-file TPT scenario, you can use the Export-operator-to-DC-operator scenario.

This will export data from Teradata and write to HDFS.

Just provide the information for the proper DC operator attributes to talk to HDFS.

It is all documented.

-- SteveF
Enthusiast

Re: TPT Script - Import from TD into HDFS.

Is it possible to ask for an example of this code? I am not finding it in the documentation anywhere and I've been looking. Please and thank you!

Teradata Employee

Re: TPT Script - Import from TD into HDFS.

TPT provides samples in a "samples" directory where TPT is installed.

Look in the directory called "userguide" inside "samples". 

PTS00029 shows an example of reading from HDFS and loading into Teradata.

Going the other way around is pretty simple and inuititive.

The documentation does provide the information for the needed attributes.

Reading from HDFS and writing to HDFS is exactly the same as reading/writing from/to flat files on a local filesystem except with HDFS you provide us with the HadoopHost hostname or IP address.

It is that simple.

-- SteveF
Enthusiast

Re: TPT Script - Import from TD into HDFS.

Thanks, I got it. Just gotta put HadoopHost = 'default' in the target attributes and use the HDFS:://server in the FileName!

Enthusiast

Re: TPT Script - Import from TD into HDFS.

I keep hitting file not found error with absolute path/relative path for the file. Also assigned value for HadoopHost with default and host IP address.

I am not running on sandbox instead I am using my application server(linux).

Any thing am missing here. Could you pls sugget.