Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Tools
Tools covers the tools and utilities you use to work with Teradata and its supporting ecosystem. You'll find information on everything from the Teradata Eclipse plug-in to load/extract tools.
Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Should TPT run faster than the legacy utilities(considering we use 1 reader instance, 1 writer instance) just because one is 64 bit technology and another is 32 bit technology?

Regards,

Suhail

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Hi All

I am trying to run a TPT script to load data from the oracle environment to my teradata environment.But on executing the script am getting the following errror:

Teradata Parallel Transporter Version 13.10.00.12

Job log: /ngs/app/tbuild/teradata/client/13.10/tbuild/logs/slsaudd-10446.out

Job id is slsaudd-10446, running on abc

Found CheckPoint file: /ngs/app/tbuild/teradata/client/13.10/tbuild/checkpoint/slsauddLVCP

This is a restart job; it restarts at step MAIN_STEP.

TPT_INFRA: TPT02192: Error: Cannot load shared library    

           dlopen error:        0509-022 Cannot load module /ngs/app/tbuild/teradata/client/13.10/tbuild/lib/libodbcop.so.

        0509-150   Dependent module libodbc.a(odbc.so) could not be loaded.

        0509-022 Cannot load module libodbc.a(odbc.so).

        0509-026 System error: A file or directory in the path name does not exist.

        0509-022 Cannot load module /ngs/app/tbuild/teradata/client/13.10/tbuild/lib/libodbcop.so.

        0509-150   Dependent module /ngs/app/tbuild/teradata/client/13.10/tbuild/lib/libodbcop.so could not be loaded.

TPT_INFRA: TPT02109: Cannot open shared library libodbcop.so, status = Open Error

TPT_INFRA: TPT02240: Error: Cannot create operator object, status = Operator Error

TPT_INFRA: TPT02103: Executor unable to set up its table object

Job step MAIN_STEP terminated (status 8)

Job slsaudd terminated (status 8)

In refrence to the above post "

TPT offers an ODBC operator which allows the copying of data from Oracle to Teradata without the need to land or stage the data in between.

We only certify with the ODBC drivers from DataDirect, and those must be purchased separately. We do not bundle ODBC drivers with TPT.

As for an AXSMOD, we will support any user-written AXSMOD as long as it conforms to the Access Module API. We do not supply an access module that reads from Oracle."

I want to know do we need some additional driver to perform loading from the oracle environment?

Please suggest...




Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Suhail,

The bit-ness should not have anything to do with performance. The performance should be similar.

Highlighted
Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Make sure the DataDirect library path is in the library path environment variable.

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Hi Tony,

We are getting below error for the same type of script. We are using exporter & load operators.

Please let me know which file it is going to write & where.

====================

Teradata Parallel Transporter Version 13.10.00.12

TPT_INFRA: TPT02022: Error: Writing to file 'temporary file':

 "No space left on device" (error code 28)

Job script preprocessing failed.

Job terminated with status 12.

===================

Thanks,

ABhijeet

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

++ Adding in previous comment

As you updated us TPT won't land any data to filesystem, but here we can see cleary something is going to write on temporary file.

I am not sure what is the use this temporty file.

When I used another fs this TPT script loaded data into table successfully.

SO Please can you elaborate whats happening here.

Thanks,

Abhijeet

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

I am trying to do a TPT from Oracle to Teradata  using ODBC operator and getting below error.(Unix environment)

OBBC_OPERATOR: connecting sessions

OBBC_OPERATOR: TPT17122: Error: unable to connect to data source

OBBC_OPERATOR: TPT17101: Fatal error received from ODBC driver:

              STATE=81, CODE=0,

              MSG='523 80'

I have set odbc.ini  in .profile file 

My odbcinst.ini says

DataDirect 6.1 Oracle Wire Protocol=Installed

[DataDirect 6.1 Oracle Wire Protocol]

Driver=/usr/lib/DWora25.so

APILevel=0

ConnectFunctions=YYY

DriverODBCVer=3.52

FileUsage=0

Setup=/usr/lib/DWora25.so

SQLLevel=0

And I am refering this lib file in my odbc.ini.

Am I missing something fundamentally wrong?


Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

What is the exact error message from the driver?  There are so many reasons that can cause the failure in connecting a session.

Is the user account info correct?  Is the DSN set up correctly?  Is the library path set up correctly for the ODBC driver libraries?

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Thanks Tony for helping me on this.

I am getting the below issue now.

OBBC_OPERATOR: TPT17122: Error: unable to connect to data source

OBBC_OPERATOR: TPT17101: Fatal error received from ODBC driver:

              STATE=IM003, CODE=0,

            MSG='[DataDirect][ODBC lib] Specified driver could not be loaded'

I have set .odbc.ini in PATH as ODBCINI .Also I have set  /informatica/Informatica/PowerCenter91/ODBC6.1/lib in LD_LIBRARY_PATH and PATH

The below is .odbc.ini

[ODBC]

InstallDir=/informatica/Informatica/PowerCenter91/ODBC6.1

Trace=1

TraceDll=/td/teradata/client/13.10/odbc_32/lib/odbctrac.so

TraceFile=/u/poongs/trace.log

#TraceAutoStop=0

[ODBC Data Sources]

Oracle Wire Protocol=DataDirect 6.1 Oracle Wire Protocol

default=DWora25.so

MYDATASOURCE=DWora25.so

[MYDATASOURCE]

Driver=/informatica/Informatica/PowerCenter91/ODBC6.1/lib/DWora25.so

APILevel=0

ConnectFunctions=YYY

DriverODBCVer=3.52

FileUsage=0

HelpRootDirectory=/informatica/Informatica/PowerCenter91/ODBC6.1/help

Setup=/informatica/Informatica/PowerCenter91/ODBC6.1/lib/DWora25.so

SQLLevel=0

and ldd command says

warning: ldd: /informatica/Informatica/PowerCenter91/ODBC6.1/lib/DWora25.so: is not executable

        libDWicu25.so =>         /informatica/Informatica/PowerCenter91/ODBC6.1/lib/libDWicu25.so

        libodbcinst.so =>        /informatica/Informatica/PowerCenter91/ODBC6.1/lib/libodbcinst.so

        libsocket.so.1 =>        /usr/lib/sparcv9/libsocket.so.1

        libdl.so.1 =>    /usr/lib/sparcv9/libdl.so.1

        libCrun.so.1 =>  /usr/lib/sparcv9/libCrun.so.1

        libnsl.so.1 =>   /usr/lib/sparcv9/libnsl.so.1

        librt.so.1 =>    /usr/lib/sparcv9/librt.so.1

        libm.so.1 =>     /usr/lib/sparcv9/libm.so.1

        libc.so.1 =>     /lib/64/libc.so.1

        libmp.so.2 =>    /lib/64/libmp.so.2

        libmd.so.1 =>    /lib/64/libmd.so.1

        libscf.so.1 =>   /lib/64/libscf.so.1

        libaio.so.1 =>   /lib/64/libaio.so.1

        libdoor.so.1 =>  /lib/64/libdoor.so.1

        libuutil.so.1 =>         /lib/64/libuutil.so.1

        libgen.so.1 =>   /lib/64/libgen.so.1

        libm.so.2 =>     /lib/64/libm.so.2

Is it pertaining to 32 or 64 bit related issue . I dont have no clue how to find this oracle DataDirect driver is right version or not .

My OS version is Solaris 10 64-bit sparcv9 kernel modules .

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Hi Tony,

We are using named pipe as input file, when i tried loading the 8 named pipe in parallel i am getting the below error.

File_Loader: entering Acquisition Phase

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

TPT_INFRA: TPT02610: Error: Could not allocate a data message of size 65028

TPT_INFRA: TPT02284: Error: Cannot create data buffer, Data Stream status = 3

Can you please provide your sugestion.