I have one script which is transferring data from one table on Teradata server A to another same structured table on Teradata server B using querygrid. The script is working fine but its taking too long to trasnfer the data.
I have to reduce the timing of the script. I tried using TPT (instead of querygrid) and used export and load operator in the same script to trasnfer the data as mentioned in the below link but that too is taking too long. I have like 70 million rows in a table to transfer.
Can anyone suggest any faster way to acheive this.
A couple of things comes to mind which may help, but first can you provide some details.
How long is this process currently taking and what is your target time?
Is that target time a realistic target for your environment?
Which TPT operators are you currently using?
I'll assume you're using Export for the data extract and either Load/Update for the load. These are typically the fastest TPT operators for this type of processing.
You might be able to utilise multiple instances of a one/both of the operators in use.
Currently, the querygrid is taking around one hour for approx 50 million rows.
Yes I am using export and load operator. The target is to reduce the time as much as we can.
Have you tried using multiple instances of one/both operators?
Look at TPT Apply clause for ideas. Look for the 'instancecount' information.
You have to take the network in your calculation.
How close (in network terms) are your Teradata servers ?
When using TPT, the computer location running the TPT is also very important, because datas will move via this computer even with direct export to load operators.