There are 3.5TB of data in our Hadoop cluster(yes on hdfs). And we have newly built a sharded MongoDB cluster(the latest 3.x) with 3 mongos, 3 configdb and 3 shards(each shard has 1 primary and 2 secondary nodes)
We are looking for the best/fastest way to import these data from Hadoop/hdfs to our newly built sharded MongoDB cluster.
All these data will be into shared collections in the MongoDB cluster.
We don't have much experience with this and have no clue how to do this in the fastest way in our environment.
Appreciate it if anyone can give a clue or the tools we can leverage. open source tools or commercials are both ok to us.