I'm sparksubmit set up four executor each 3 gb of memory, a core, but running only two excutor, sometimes suddenly become 3

CodePudding user response:

Resources if the spark on yarn, yarn Settings, you can only give you two executor * 3 g, for example, one still AM, resources enough, will give you a again, not enough resources, see affirmation is not equal to set on a page,