Problems with multibyte tdload / TPT19134 !ERROR!

Tools

Problems with multibyte tdload / TPT19134 !ERROR!

[1] $FILE_READER[1]: TPT19134 !ERROR! Fatal data error processing file 'input_import.csv'. Delimited Data Parsing error: Invalid multi-byte character in row 221, col 1.

[2] freetext VARCHAR(4000) CHARACTER SET UNICODE NOT CASESPECIFIC

[3] tdload -f input_import.csv  -u xxxxx -p xxxx -c UTF8 -h dwhprod01 -t input_import -d "|" --TargetWorkingDatabase db_prod_one_input

Hi everyone,

I'm facing an issue with tdload and multibyte problems. I want to load a free text field from users, where they sometimes input emoticons.

The error I get is [1]

My field in teradata is [2]

Import command [3]

Teradata v. 14.0

What I've already tried:

  • Setting tdload -c UTF16
  • Convert csv into other formats first (but I dont want to loose any data emoticons)

Any help and idea would be appreciated. Thank you!

Tags (2)
3 REPLIES

Re: Problems with multibyte tdload / TPT19134 !ERROR!

I'm sorry, I don't know how to edit my previous post.

Teradata is v. 15.10

Teradata Employee

Re: Problems with multibyte tdload / TPT19134 !ERROR!

Do you happen to know if that character is a 4-byte UTF8 character?

-- SteveF

Re: Problems with multibyte tdload / TPT19134 !ERROR!

UTF-8 (hex) 0xF0 0x9F 0x91 0x8D (f09f918d) 
UTF-8 (binary) 11110000:10011111:10010001:10001101

It was the character above, also called "thumbs up". Just google for "unicode character thumbs up".

As a workaround I created a script that removes all characters above latin-1. But it would be nicer to just import all the data.