TPT stream (source:utf-8/target:latin) character length limit ?

Database
Teradata Employee

TPT stream (source:utf-8/target:latin) character length limit ?

Hi,

 

I'm working on a a case of streaming data from UTF-8 source to LATIN column.( LATIN is fine with the data).

 

Tpt script looks like this:

USING CHARACTER SET UTF-8 -- declares source encoding

..

  DEFINE SCHEMA PRODUCT_SOURCE_SCHEMA
  DESCRIPTION 'PRODUCT INFORMATION SCHEMA'
  (
      MESSAGE_TXT VARCHAR(32000) -- limited to 32k due to stream and UTF-8 (?)
  );
...
APPLY
..INSERT
CAST(:MESSAGE_TXT AS JSON)
..

 

 

Thing is I'd like to extend the schema length from 32k to 64k (streaming longer texts).

Using character set ASCII , ascii extended characters are wrongly converted so i'd like to reconvert data from utf8 to latin column.

 

Before asking installation of UTK, will something like work out :

TRANSLATE(udf_utf8to16(mycolumn) USING UNICODE_TO_LATIN)

?

 

or is there something more simple?

 

 

 

hope i'm clear... thank you.