Connection between Aster and Hadoop

Aster

Connection between Aster and Hadoop

Hi Everybody,

If I have a Hadoop with 900 TB and Aster with 100 TB and I run  a query using function load from hadoop, the data will be copied to Aster cluster or the query will run in Hadoop cluster?

If it run in Aster, how is the mechanism to copy a big quantity of data into Aster Cluster?

Thanks and happy new year :)

Kobi

2 REPLIES

Re: Connection between Aster and Hadoop

pl specify the exact MR  function you are using .

Re: Connection between Aster and Hadoop

According to my understanding, if you do not use any filters, the whole table will be copied to Aster. The ONLY exception to this is if your table on Hive is Partitioned and you used partition elimination where ONLY the partition(s) are copied over to Aster.