How to fetch packets of records and process them in Teradata

UDA
Fan

How to fetch packets of records and process them in Teradata

Hi,

I have a very urgent requirement.

There are some millions of records in one of my Teradata tables.Now I need to process these records by fetching 10000 records at a time.
For example- say in the first pass I pick up 10000 records and put them in a flat file,process it. Then in second pass pick next 10000 records put in a flat files process it and so on until all my records in the table gets processed.

Any solution to this problem would be really helpful.

Thanks,
Ashish.
1 REPLY
Enthusiast

Re: How to fetch packets of records and process them in Teradata

on UNIX I would use something like 'fastexport < your_fe_script | split'
or even better, just 'fastexport < your_fe_script | your_programm', provided your programm supports pipes.

otherwise you could do a

select your_row_num,*
from your_table
where your_row_num between 1 and 100000

select your_row_num,*
from your_table
where your_row_num between 100000 and 200000

and so on... but you need a numeric you_row_num column present in your table,
instead you could use 'qualify row_number() over (order by some_other_unique_field ) between 1 and 100001'