Home > other >  How to realize the communication between a hadoop cluster and job scheduling?
How to realize the communication between a hadoop cluster and job scheduling?

Time:09-27

Have multiple hadoop cluster, the cluster of hadoop version is consistent, it may a few hadoop cluster distribution in different regions,
1, can be in one of the cluster management side see other cluster node information, such as HDFS file directory information, such as
2, the requirements in which any node issued by MR (or hive, spark), the data in the cluster to perform this MR (or hive, spark) homework, job execution in the data in the cluster,
Please help to provide some Suggestions or solution, thank you!

CodePudding user response:

Consider the federation of hadoop, make appropriate configuration changes,
  • Related