Tag

Unified Storage

0 views collected around this technical thread.

iQIYI Technical Product Team
iQIYI Technical Product Team
Oct 24, 2024 · Big Data

iQIYI Multi-AZ Unified Scheduling Architecture for Big Data

iQIYI’s Multi‑AZ unified scheduling architecture combines a unified storage layer (QBFS), an abstracted compute scheduler (QBCS), and a federated metadata service (Waggle Dance) to seamlessly route data and jobs across availability zones, cut storage costs up to 65 %, reduce overall big‑data workload expenses by more than 35 %, and lay the groundwork for future hybrid‑cloud expansion.

Big DataUnified Storagecompute scheduling
0 likes · 15 min read
iQIYI Multi-AZ Unified Scheduling Architecture for Big Data
DataFunTalk
DataFunTalk
Feb 18, 2024 · Cloud Computing

Research on the Unified Storage Platform for the Supercomputing Internet

This article presents a comprehensive overview of the challenges, key technologies, and future applications of a unified storage platform built on Alluxio for China's national supercomputing internet, detailing its architecture, data flow strategies, deployment status, and industry use cases across multiple sectors.

AlluxioData FlowHigh Performance Computing
0 likes · 13 min read
Research on the Unified Storage Platform for the Supercomputing Internet