Home > other >  How to understand the Spark is based on the application of the working set this sentence?
How to understand the Spark is based on the application of the working set this sentence?

Time:10-12

At the same time, how to understand MR is based on data stream this sentence?

CodePudding user response:

My understanding is that the working set is refers to the physical memory part of the process has been mapping (namely the memory block in physical memory, and CPU can directly access), part of this is not in the working set of virtual memory may be included in the list transformation (CPU cannot be accessed through the virtual address, Windows after mapping is needed to access), and part of the page file on the disk, the spark here working set is based on memory; And MR is frequent interaction with disk data, also can saying is based on the disk data flow, hope to continue to have a better answer,
  • Related