Scheduling job

This is for Hadoop eco system like HDFS, Map reduce, Hive, Hbase, Pig, sqoop,sqoop2, Avro, solr, hcatalog, impala, Oozie, Zoo Keeper and Hadoop distribution like Cloudera, Hortonwork etc.
user123
Posts: 91
Joined: Sun Aug 30, 2015 7:57 am
Contact:

Scheduling job

Postby user123 » Wed Sep 30, 2015 10:47 pm

Hi,

My requiremnt is to schedule a flow of jobs , like
HDFS --> Hive Table --> Appying transformations --> Pig Scripting --> HBase Table --> Loading into RDBMS Table

I want to schudule the flow hourly/ Daily/weekly based on my requiremnt.

what is the best way to scheduling the flow.
Is it a good pratice to call the hadoop commands in shell script and shedule them??

Kindly suggest me the best way of scheduling.

Thanks in Advance


Return to “Hadoop and Big Data”

Who is online

Users browsing this forum: No registered users and 4 guests