Multi Language Character Set in Teradata

Database
Enthusiast

Multi Language Character Set in Teradata

Hi All,

I am new in this forum. I am working in a data warehouse project where we are using Teradata database. We were sourcing data from a sql server db into teradata. Recently I am facing an issue in loading multi language character from sql server into teradata. previously column type was like below 

CREATE MULTISET TABLE DEV_GP_PACA_STAGE.STG_CUST_TXT ,NO FALLBACK ,

     NO BEFORE JOURNAL,

     NO AFTER JOURNAL,

     CHECKSUM = DEFAULT,

     DEFAULT MERGEBLOCKRATIO

     (

      CUSTOMER VARCHAR(50) CHARACTER SET LATIN NOT CASESPECIFIC,

      MEDIUM_DESCRIPTION VARCHAR(50) CHARACTER SET LATIN NOT CASESPECIFIC,

      BW_ROW_COUNT DECIMAL(18,4),

      BATCH_ID VARCHAR(50) CHARACTER SET LATIN NOT CASESPECIFIC,

      LOADING_TIMESTAMP TIMESTAMP(0))

PRIMARY INDEX STG_CUST_TXT_PI ( CUSTOMER );

 

But the above table was not supporting multi language. It was storing data like something ???? Then I changed into as below:

 

CREATE MULTISET TABLE DEV_GP_PACA_STAGE.STG_CUST_TXT ,NO FALLBACK ,

     NO BEFORE JOURNAL,

     NO AFTER JOURNAL,

     CHECKSUM = DEFAULT,

     DEFAULT MERGEBLOCKRATIO

     (

      CUSTOMER VARCHAR(50) CHARACTER SET LATIN NOT CASESPECIFIC,

      MEDIUM_DESCRIPTION VARCHAR(50) CHARACTER SET UNICODE NOT CASESPECIFIC,

      BW_ROW_COUNT DECIMAL(18,4),

      BATCH_ID VARCHAR(50) CHARACTER SET LATIN NOT CASESPECIFIC,

      LOADING_TIMESTAMP TIMESTAMP(0))

PRIMARY INDEX STG_CUST_TXT_PI ( CUSTOMER );

 

Now, the data is coming in multi language format but different than source. source it was greek but in teradata its showing like romanian.

 

Can anybody help on this

5 REPLIES
Teradata Employee

Re: Multi Language Character Set in Teradata

Both loading and querying need to use something other than the driver default ASCII (i.e. LATIN) session character set, e.g. UTF8 or UTF16.

Enthusiast

Re: Multi Language Character Set in Teradata

Thanks Fred for your reply.

Can you please help me how to set this character set while loading?

 

Regards,

Rokan

Enthusiast

Re: Multi Language Character Set in Teradata

Fred,

To be noted: We are using SAP BODS tool with mload loader for writing in a one to one mapping for writing data from sql server to teradata.

 

Thanks

Teradata Employee

Re: Multi Language Character Set in Teradata

There should be a Character Set attribute in the Bulk Loader Options.

Is it really MLoad? If so, consider upgrading to TPT (Parallel Transporter) UPDATE operator.

Enthusiast

Re: Multi Language Character Set in Teradata

Hi Fred,

Thank you for your suggestion. We got the solution and its working now. We have changed character set property to utf-8 at SAP BODS area.