Tag

Cluster Scheduling

1 views collected around this technical thread.

DataFunSummit
DataFunSummit
Sep 2, 2023 · Big Data

Practical Experience of Bilibili's Big Data Cluster Mixed Deployment Architecture

This article details Bilibili's offline big‑data cluster challenges, the mixed‑deployment architecture that combines offline and online resources, the Amiya service's over‑commit and eviction mechanisms, performance optimizations, monitoring strategies, and future plans to further improve resource utilization and scheduling.

AmiyaBig DataBilibili
0 likes · 14 min read
Practical Experience of Bilibili's Big Data Cluster Mixed Deployment Architecture
Java Architect Essentials
Java Architect Essentials
Aug 20, 2020 · Cloud Native

Borg’s Resource Management, Isolation, and Lessons for Cloud‑Native Systems

This article examines Borg’s strategies for efficient machine utilization, fine‑grained resource allocation, and isolation—including cell compaction, resource reclamation, and performance isolation—provides experimental results and comparisons, and distills lessons learned to inform the design of cloud‑native systems such as Kubernetes.

BorgCluster SchedulingKubernetes
0 likes · 27 min read
Borg’s Resource Management, Isolation, and Lessons for Cloud‑Native Systems
Qunar Tech Salon
Qunar Tech Salon
May 14, 2015 · Operations

Key Takeaways from Google’s Borg Paper: Resource Management and Scheduling Insights

The article reviews Google’s Borg paper, highlighting how Borg distinguishes production and non‑production tasks, manages jobs and containers, improves utilization through mixed‑workload scheduling, enforces isolation via overload and over‑commitment controls, and compares Borg’s approach to other cluster managers.

BorgCluster SchedulingOperations
0 likes · 8 min read
Key Takeaways from Google’s Borg Paper: Resource Management and Scheduling Insights