Dateframe have two columns of data is in the list type, need to do to each line of the two columns of data clustering analysis, I use df foreachPartition (f) through each line, but prompt error RDD cannot nested RDD, don't know how to deal with, hope everyone to discuss,

CodePudding user response:

Want to become a (latitude and longtitude),,,,,,,, more latitude and longitude data, you get after each line, deal directly with the list of combination not line, you want to turn the list into RDD, then are combined, not sure,