Big Data Technology Architecture
Apr 27, 2019 · Big Data
Understanding Spark Memory Management: On‑Heap and Off‑Heap Planning and Allocation
This article explains Spark's memory management architecture, covering on‑heap and off‑heap memory planning, the MemoryManager interface, static versus unified memory allocation strategies, and how dynamic borrowing improves resource utilization for Spark executors.
Big DataOff-heapOn-Heap
0 likes · 11 min read