can i create Hadoop mapfile with multiple indexing?

This is for Hadoop eco system like HDFS, Map reduce, Hive, Hbase, Pig, sqoop,sqoop2, Avro, solr, hcatalog, impala, Oozie, Zoo Keeper and Hadoop distribution like Cloudera, Hortonwork etc.
ramverma
Posts: 435
Joined: Sat Aug 23, 2014 5:34 pm
Contact:

can i create Hadoop mapfile with multiple indexing?

Postby ramverma » Sat Aug 23, 2014 6:49 pm

i have dataset input format Text1 and Text2. i would like to have the same data folder with different index files.

can i use the single hadoop MapFile to provide indexing (binary search support) on the first column Text1 and on the second one Text2 ?


Guest

Re: can i create Hadoop mapfile with multiple indexing?

Postby Guest » Wed Sep 17, 2014 8:45 pm

As i know Hadoop sort everything by key and don't need indexing on your Map file.

To put indexing may overhead input/output in hadoop, if not implemented properly.


Return to “Hadoop and Big Data”

Who is online

Users browsing this forum: No registered users and 1 guest