0

There are 3.5TB of data in our Hadoop cluster(yes on hdfs). And we have newly built a sharded MongoDB cluster(the latest 3.x) with 3 mongos, 3 configdb and 3 shards(each shard has 1 primary and 2 secondary nodes)

We are looking for the best/fastest way to import these data from Hadoop/hdfs to our newly built sharded MongoDB cluster.

All these data will be into shared collections in the MongoDB cluster.

We don't have much experience with this and have no clue how to do this in the fastest way in our environment.

Appreciate it if anyone can give a clue or the tools we can leverage. open source tools or commercials are both ok to us.

Joe

Improve this question

1 Answer 1

Reset to default
0

Why would you want to copy TB's of data from one environment to another system. There are rich projects available such as Apache Drill (to name few) which can seamlessly access Mongo for querying requirements. Have you explored that option?

When you say you have TB's of data in HDFS, what is the format of the data because this is a critical question to be aware of

Improve this answer

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.