I need to ingest huge volume of data from Teradata systems to flat files in Unix System.I would to know if TPT would provide better performance over Fast Export utility and also whether TPT Export operator would offer any advantage/disadvantage compared to Fast Export?
Well, not exactly.
Yes, TPT is the product that everyone should be using going forward.
We are not adding any features to FastExport, and that utility will also most likely not support new DBS features going forward.
TPT is the client load/unload product going forward.
But TPT offers parallelism on the client load server, plus a whole slew of advanced features.
For example, just for your particular scenario, if you want to export the rows from a single table into multiple files, FastExport cannot do that, but TPT can.
FastExport will process the blocks in order.
TPT Export can have multiple processes, each process controlling multiple data sessions, and thus you can get parallelism extracting the data from Teradata. Plus you can achieve parallelism by writing data to multiple smaller files instead of a large single file (depends on how you want your data written out, and what you will be doing with the data after it is written to files).
does TPT support case below
100,000 records from one single table, and when doing export, automatically split 100,000 records into mutiple files, say into 10 files, each file contains 10000 records.
If TPT support this, could anybody give one detail example on this.
Yes, TPT supports the writing of data to multiple files.
Just use the Export operator to extract the data from Teradata.
Use the DataConnector operator as the file writer.
Specify how many instances you want to use (each instance will write to its own file).
Make sure to use the -C (uppercase) command line option to round robin the data to the instances of the DC operator.
The rows will not be perfectly distributed to each file, but it will be close.
The data from the Export operator to the DC operator in blocks and each block can have a different number of rows (depending on whether VARCHAR data is being extracted, where the size of each row could be different).