Big Data Technology Architecture
Aug 19, 2019 · Big Data
Understanding Spark Unified Memory Management and Dynamic Allocation
This article explains Apache Spark's memory architecture, covering the shift from static to unified memory management, the roles of on‑heap and off‑heap memory, configurable parameters, dynamic memory sharing between execution and storage, and the legacy mode introduced in Spark 1.6.
Apache SparkExecutorOff-heap
0 likes · 7 min read