Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Tools
Tools covers the tools and utilities you use to work with Teradata and its supporting ecosystem. You'll find information on everything from the Teradata Eclipse plug-in to load/extract tools.
Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Use the DataDirect ODBC driver because TPT is certified with the DataDirect ODBC driver.

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Hello

I have two systems

Table Source: 5555H

Table Target: 2690

The two systems are interconnected to a server with 4 1GbE links

Teradata Parallel Transporter Load Operator Version 13.10.00.04

Teradata Parallel Transporter Export Operator Version 13.10.00.06

Teradata Database Version: 13.10


- Test 1

Table source: 80,000,000 rows

Performance: Ok (30 seconds to export and import)

- Test 2

Table source: 507 million rows

Performance: Very very slow!

After 40 minutes the step "SELECT request sending" continues processing...

Why?

(In the source table no locks)

Regards,

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

This is the output of the job:

This is the output of the job

Almost an hour processing!

How I can improve permformance?

Teradata Parallel Transporter Version 13.10.00.16

Job log: /opt/teradata/client/13.10/tbuild/logs/root-70.out

Job id is root-70, running on GALICIABAR

Teradata Parallel Transporter SQL DDL Operator Version 13.10.00.16

DDL_TVA: private log specified: /opt/teradata/client/13.10/teradata/client/13.10/tbuild/logs/exportoper_privatelog.log

DDL_TVA: connecting sessions

DDL_TVA: sending SQL requests

DDL_TVA: Rows Deleted:  0

DDL_TVA: disconnecting sessions

DDL_TVA: Total processor time used = '0.02 Second(s)'

DDL_TVA: Start : Mon Dec  2 16:34:10 2013

DDL_TVA: End   : Mon Dec  2 16:34:10 2013

Job step DDL_TVA_DELETE completed successfully

Teradata Parallel Transporter Load Operator Version 13.10.00.04

Teradata Parallel Transporter Export Operator Version 13.10.00.06

LOD_P_MKT_TABLES_ING_FINANCIEROS: private log specified: /opt/teradata/client/13.10/tbuild/logs/loadoper_privatelog.log

EXP_P_MKT_TABLES_ING_FINANCIEROS: private log specified: /opt/teradata/client/13.10/tbuild/logs/exportoper_privatelog.log

LOD_P_MKT_TABLES_ING_FINANCIEROS: connecting sessions

EXP_P_MKT_TABLES_ING_FINANCIEROS: connecting sessions

LOD_P_MKT_TABLES_ING_FINANCIEROS: preparing target table

LOD_P_MKT_TABLES_ING_FINANCIEROS: entering Acquisition Phase

EXP_P_MKT_TABLES_ING_FINANCIEROS: sending SELECT request

EXP_P_MKT_TABLES_ING_FINANCIEROS: entering End Export Phase

EXP_P_MKT_TABLES_ING_FINANCIEROS: Total Rows Exported:  570020103

LOD_P_MKT_TABLES_ING_FINANCIEROS: entering Application Phase

LOD_P_MKT_TABLES_ING_FINANCIEROS: Statistics for Target Table:  'RESTORE_STG.ING_FINANCIEROS'

LOD_P_MKT_TABLES_ING_FINANCIEROS: Total Rows Sent To RDBMS:      570020103

LOD_P_MKT_TABLES_ING_FINANCIEROS: Total Rows Applied:            570020103

LOD_P_MKT_TABLES_ING_FINANCIEROS: disconnecting sessions

EXP_P_MKT_TABLES_ING_FINANCIEROS: disconnecting sessions

LOD_P_MKT_TABLES_ING_FINANCIEROS: Total processor time used = '89.7 Second(s)'

LOD_P_MKT_TABLES_ING_FINANCIEROS: Start : Mon Dec  2 16:34:14 2013

LOD_P_MKT_TABLES_ING_FINANCIEROS: End   : Mon Dec  2 17:29:34 2013

EXP_P_MKT_TABLES_ING_FINANCIEROS: Total processor time used = '123.38 Second(s)'

EXP_P_MKT_TABLES_ING_FINANCIEROS: Start : Mon Dec  2 16:34:14 2013

EXP_P_MKT_TABLES_ING_FINANCIEROS: End   : Mon Dec  2 17:29:35 2013

Job step P_MKT_TABLES_ING_FINANCIEROS completed successfully

Job root completed successfully

Highlighted
Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Can you provide the TPT job's private logs?

You can use this sample command to retrieve the TPT private logs:

tlogview -j root-70 -f "*" -g -o tpt_privatelogs.txt

Run the command on the GALICIABAR system.

The TPT private logs will be saved in the tpt_privatelogs.txt file.

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Where can i dowload the DataDirect ODBC driver? is it included in ttu 14.0.0??

how can i configured the driver for odbc in the file odbc.ini???

thanks for all

Enthusiast

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Hi TonyL

How do I attach the file?

How do I send the file?

file = tpt_privatelogs.txt

Regards,

Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Pablo,

You can send me the tpt_privatelogs.txt file.

My email address is:

TL122451@teradata.com

Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

The DataDirect ODBC driver is not on the TTU media.

You can download the DataDirect ODBC driver and the installation/configuration guide from this link:

http://www.datadirect.com/products/datadirect-connect/odbc-drivers

DT
Teradata Employee

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Requires to use the data direct for a data extraction  from Oracle tpt to Teradata, or I can use the Oracle ODBC native.

Not applicable

Re: Use Teradata Parallel Transporter to Move Data Without Landing the Data to Disk

Hi Tony,

I am executing few TPT scripts.

Many of the scripts are facing following issue.

"Missing concatenation operator -- '||' -- between adjacent tokens. "

and many of them are running fine, I have writtenn all in same manner...

Can you please guide me?