On ec2 testing spark graphx figure handle scalability (scalability), in 1,2,4,8 and 16 nodes (workers) test, found no reflect speed (speed up), if anyone has experience in this field, please? Pagerank algorithm using graphx,

http://ask.csdn.net/questions/233980

CodePudding user response:

More nodes, partition number also set a big?

CodePudding user response:

reference 1st floor coding_hello response:

node, set partition number is big?

Graphx no interface is responsible for the partition!!!!! ?????

CodePudding user response:

En, it is not repartition, forget,,,

//Change the partitioning heuristic============================================================
Def partitionBy (partitionStrategy: partitionStrategy) : Graph [VD, ED]

Can also change a adjustments to make it a try