Home > other >  The spark computationally intensive
The spark computationally intensive

Time:09-30

Asked everyone a great god, now have a program, probably thought is: I now have a bunch of Numbers, each number has its influence generates a series of new Numbers, then the number of these new were calculated a string of data, the final of the second generation of all sort, according to the sorting of the third generation number written to a file, I now spark process is said above, do you have any good idea can greatly improve speed?

Example: for example, at first only a number: 1 (there can be more digits), then the number of generated a series of new number: 5,2,6, about 5,2,6 calculated respectively, such as 2, generates an array of 1.3, 4.5; 5 generates an array of 5.5, 3.7; 6 generates an array of 2.3, 6.7; Then prioritize, 5,2,6 to write the number of generated file, the result is: 1.3, 4.5, 5.5, 3.7, 2.3, 6.7

Pray god help me ~ ~ ~
  • Related