Single map run mapTask memory to 4 g from the mysql database import HDFS
CDH cluster server memory is 128 g,
Could you tell me what reason be cause

CodePudding user response:

CodePudding user response:

Don't need to import all can try incremental import, and filter the data

CodePudding user response:

Hello, single map run, parallelism is lower, even more resources available, will slowly,
Suggestions to improve the number of the map, thus increasing the parallelism can improve the speed of import data,
Solved, please listen, if you still cannot solve, please direct messages me,