Apache Hadoop is a framework that allows for the distributed processing of large data sets across clusters of computers. It is designed to scale up from single servers to thousands of machines. The library itself is designed to detect and handle failures at the application layer, so delivering a ...

learn more… | top users | synonyms

1
vote
1answer
26 views

select two tables and print the columns side by side with matching key in hive

I have the below tables: table_1 name_1 id_1 value_1 avi 1 21 adi 2 X table_2 name_2 id_2 value_2 avi 1 21 adi 2 22 metadata_info: can be read ...
0
votes
1answer
62 views

Slow select from one billion rows GreenPlum DB

I've created the following table on GreenPlum: CREATE TABLE data."CDR" ( mcc text, mnc text, lac text, cell text, from_number text, to_number text, cdr_time timestamp ...
0
votes
1answer
81 views

Fastest way to sync (or keep import) 3.5TB data from hadoop to sharded mongodb cluster

There are 3.5TB data in our hadoop cluster(yes on hdfs). And we have newly built a sharded mongodb cluster(the latest 3.x) with 3 mongos, 3 configdb and 3 shards(each shard has 1 primary and 2 ...
2
votes
0answers
74 views

incremental update in HBase using sqoop

i am working on a POC where i need to implement same like SSIS for sql to hadoop. out DW are in SQL Server and we want to create a HBase at central location where all the data from diff DW will be ...
2
votes
0answers
80 views

Options for copying data out of continuously updating tables

I work with a pretty large (O(10^1) TB) DB2 (LUW, v. 9.7) database. It's got data coming in on a continuous basis via Golden Gate replication from another DB2 database. It's used for business ...
2
votes
0answers
120 views

Exporting an HBase table which is larger than the available HDFS space?

I have a 1TB hbase table which I need to export. Unfortunately I only have 600GB free in HDFS, so I was hoping to export it to a mounted file share. I've learned that the hbase export can only export ...
2
votes
0answers
195 views

Alternatives for storing 365TB of info

I need to upload daily CSV dumps to a blackbox of my choice, and it should be possible to run queries or create filters over the uploaded data. Daily dumps weight around 1TB and are basically id, ...
1
vote
0answers
173 views

Can we query Accumulo data from Apache Drill

Accumulo uses HDFS where as HBase also works on top of HDFS. We can query HBase data through Drill. So can we query Accumulo data also from Apache Drill ?
1
vote
0answers
460 views

Enabling JMX For Hadoop HDFS & Also MapReduce

I'm having a hard time figuring out how to enable JMX to submit metrics for HDFS and MapReduce jobs in Hadoop (CDH4). I've seen several links and read through 'The Definitive Guide' and 'Hadoop ...
0
votes
0answers
14 views

Export data from Hive to Postgres

I would like to save data that I fetch via Hive on a remote Hadoop cluster to my local machine in a Postgres database. I am currently downloading the data as files but I have no idea on how to ...
0
votes
0answers
33 views

How to add complex calculations to Elastic Search

I'm using elastic search to index large amounts of sensor data for analytics purposes. The table has 4 million + rows and growing fast - expecting 40 million within the next year. This makes Elastic ...
0
votes
0answers
65 views

Backup MYSQL data to HIVE

I have some very large tables in Mysql which I want to backup to Hive. I am using Sqoop for it and it works pretty well. But now, if I have to make any changes in mysql table's schema, I have to ...
0
votes
0answers
14 views

sqoop dir not found in hortronworks virtualbox

when trying to copy sqljdbc driver to /usr/lib/sqoop/lib it gives error cannot create regular file 'usr/lib/sqoop/lib/' No such File or Directory exist any idea what is missing? downloaded ...
0
votes
0answers
77 views

Can we swap out SQL Server with HBase on our .Net application?

In a current application we use SQL Server. The data flow consists of using TVPs for better-than-bulk-insert performance by passing in DataTables. As part of the data addition process, old records ...