TPT stream (source:utf-8/target:latin) character length limit ?
I'm working on a a case of streaming data from UTF-8 source to LATIN column.( LATIN is fine with the data).
Tpt script looks like this:
USING CHARACTER SET UTF-8 -- declares source encoding
DEFINE SCHEMA PRODUCT_SOURCE_SCHEMA
DESCRIPTION 'PRODUCT INFORMATION SCHEMA'
MESSAGE_TXT VARCHAR(32000) -- limited to 32k due to stream and UTF-8 (?)
CAST(:MESSAGE_TXT AS JSON)
Thing is I'd like to extend the schema length from 32k to 64k (streaming longer texts).
Using character set ASCII , ascii extended characters are wrongly converted so i'd like to reconvert data from utf8 to latin column.
Before asking installation of UTK, will something like work out :
TRANSLATE(udf_utf8to16(mycolumn) USING UNICODE_TO_LATIN)