How to rename the hadoop output file?

This is for Hadoop eco system like HDFS, Map reduce, Hive, Hbase, Pig, sqoop,sqoop2, Avro, solr, hcatalog, impala, Oozie, Zoo Keeper and Hadoop distribution like Cloudera, Hortonwork etc.
dharama123
Posts: 125
Joined: Wed Aug 27, 2014 1:10 am
Contact:

How to rename the hadoop output file?

Postby dharama123 » Thu Sep 18, 2014 6:33 pm

How to rename the hadoop output file? Is it possible to rename the hadoop output file in Hadoop?


Guest

Re: How to rename the hadoop output file?

Postby Guest » Fri Sep 19, 2014 1:45 am

Using a Java class that derives from MultipleOutputFormat as the jobs output format allows control of the output file names. http://hadoop.apache.org/core/docs/curr ... ormat.html

When using Hadoop Streaming, since only one JAR is supported you actually have to fork the streaming jar and put your new output format classes in it for streaming jobs to be able to reference it...


Return to “Hadoop and Big Data”

Who is online

Users browsing this forum: No registered users and 3 guests