Home > other >  Huge amounts of data, through a simple judgment to increase the new column, what is the recommended
Huge amounts of data, through a simple judgment to increase the new column, what is the recommended

Time:10-17

Simple scenario of mass data tagging, is there any more suitable tools or frameworks, such as I have 100 million data, each data have A - B - C - D - E five fields, you first need to based on the value of the A - B Group into more child table, then in each child table, according to the C - D - the value of E, and F - with A formula of G value, was made from HBase + Spark RDD, but this scene demand is too simple, don't know do you have any other better strategy

CodePudding user response:

Open the window function to use? Did you solve this problem
  • Related