Home > other >  New to spark encountered a problem that how to use the spark job server to spark the RDD out
New to spark encountered a problem that how to use the spark job server to spark the RDD out

Time:09-23

Hypothesis has been the spark program running now want to use the spark job server to submit a jar to spark the RDD inside out and then converted to dataframe
RDD conversion dataframe now I know how to do is to spark the job server how to get the inside of the spark RDD eyebrow idea if all the job is the job server submitted to go up and running with naming RDD can take each other to RDD if is two spark program can draw RDD each other? Jobserver can take to a spark inside of RDD should not in the same sparkcontext cannot do
First does not consider the RDD first save to the file system for jobserver consider to read directly from memory to get do not know to have a great god under the guidance has also recently has been looking for information

CodePudding user response:

What is this,,, it is good to save RDD/dataframe,,, what a wide around
  • Related