Tencent Cloud Developer
Nov 13, 2020 · Big Data
Apache Spark Core: Architecture, Components, and Execution Flow
Apache Spark Core is a high‑performance, fault‑tolerant engine that abstracts distributed computation through SparkContext, DAG and Task schedulers, supports in‑memory and disk storage, runs on various cluster managers (YARN, Kubernetes, etc.), and unifies batch, streaming, ML and graph processing via its rich ecosystem.
Apache SparkBig DataDAG Scheduler
0 likes · 17 min read