Data conversions/validations in mload or bteq?

UDA
Junior Supporter

Data conversions/validations in mload or bteq?

Hi all:

I'm in a project where we must import information from flat files. We do it in two phases:
·First we multiload the files into (staging) temporary tables.
·Then we load the target tables from the temporary tables via bteq scripts.

Mi question is:

Is it better to multiload into temp tables in a raw fashion (the temp tables with all the columns type CHAR) and then 'massage' the data with the bteq scripts to perform the data conversions/validations or is it better the other way (conversions/validations inside the multiload)?

Thanks in advance.

Cheers.

Carlos.
1 REPLY
SN
Enthusiast

Re: Data conversions/validations in mload or bteq?

hi,

Its better to do the conversions/validations duinrg MLoad - and if you use INMOD then it will be fast to do these priliminary data conditioning before you apply the data from temp to target where you may have to run thru lot of business logic.

having the data as in same format as in target will improve your bteq script performance and reduce the run time.

HTH,