Aug 30, 2023 · Big Data

Design and Implementation of Baidu Cloud Block Storage EC System for Large‑Scale Data

This article presents Baidu Cloud's block storage architecture, comparing replication and erasure‑coding fault‑tolerance methods, detailing the challenges of applying EC to mutable block data, and describing a two‑layer append‑engine solution with selective 3‑replica caching, cost‑benefit compaction, and performance optimizations for low‑cost, high‑throughput storage.

Big DataStorage Architectureappend engine

0 likes · 14 min read

Design and Implementation of Baidu Cloud Block Storage EC System for Large‑Scale Data

Baidu Intelligent Cloud Tech Hub

Aug 22, 2023 · Fundamentals

How Baidu’s CDS Uses Erasure Coding to Cut Storage Costs and I/O Amplification

This article explains Baidu Intelligent Cloud's block storage (CDS) architecture, comparing fault‑tolerance methods, detailing the challenges of large‑scale erasure‑coded storage, and describing Baidu's two‑layer append‑engine solution that reduces I/O amplification while keeping costs low.

I/O amplificationStorage Optimizationappend engine

0 likes · 15 min read

How Baidu’s CDS Uses Erasure Coding to Cut Storage Costs and I/O Amplification