Semi structured and unstructured data in teradata aster

Aster
Enthusiast

Semi structured and unstructured data in teradata aster

Hi,

Can we store the unstrurtured data like logs and semi structured data like xml json in aster database as file without creating any table? In general is it  possible to store any data in aster database without creating table, like we do in HDFS(hadoop)?

Pradi

3 REPLIES
Teradata Employee

Re: Semi structured and unstructured data in teradata aster

A few thing here:

  • You can store files on the Aster environment as it is at its core a Linux platform. However, files that you just store in the Aster file system you can't necessarly access from something like a SQL MR call
  • In 6.0, Aster has released Aster File System. This is in a sense an HDFS platform incorporated with Aster.
  • What I'd reccomend for storing JSON would be to simply store the string in a single column in a table. Or, you could run it through a parser and then store the output into an Aster table
Enthusiast

Re: Semi structured and unstructured data in teradata aster

Thanks a lot ewan,

You can store raw data in AFS but it can't be accessed by SQL/SQL-MR call right?

Enthusiast

Re: Semi structured and unstructured data in teradata aster

Hi,

Does anyone has some insight about INPUT_FORMAT and SERDE specifications in table_from_Afs().  Aster manual does list some of supported specifications but  does not exactly tell scenarios where each one could  be used.

Regards,

Ravi