Home > other >  After jar package submitted to spark cluster mapPartition and mapPartitionWithIndex take less than t
After jar package submitted to spark cluster mapPartition and mapPartitionWithIndex take less than t

Time:09-23

In local setMaster [" local "[*]] mode, can go to mapPartition and mapPartitionWithIndex method, can also take to the inside of the data,
But into the jar package after the operation is not submitted to spark cluster into mapPartition and mapPartitionWithIndex, also can't get the data inside,
What a great god know what this is? To help solve the thank!

CodePudding user response:

Top one, six to the length of the string

CodePudding user response:

Does anyone know???????

CodePudding user response:

You didn't this contextual can't help you... I can only try guessing you read data in the right way. You are a local mode is read a local file, cluster pattern is HDFS or remote file is read?
Why don't you post code come out to see?
  • Related