Tag

cross-IDC

0 views collected around this technical thread.

Kuaishou Big Data
Kuaishou Big Data
Oct 28, 2021 · Big Data

How Kuaishou Cut Object Storage Costs by 50% with LRC Erasure Coding

Kuaishou reduced half of its massive object storage expenses by redesigning its architecture to use HBase indexing, HDFS large‑file storage, MemoryCache, and a cross‑IDC LRC erasure‑coding warm layer that maintains disaster‑recovery while dynamically moving data from hot to warm to cold tiers.

Erasure CodingKuaishouLRC
0 likes · 12 min read
How Kuaishou Cut Object Storage Costs by 50% with LRC Erasure Coding
360 Tech Engineering
360 Tech Engineering
Aug 25, 2021 · Big Data

Cross‑IDC Kafka Hot‑Standby with MirrorMaker 2: Architecture, Design, and Productization

This article explains how 360 Commercialization implements cross‑IDC hot‑standby for Kafka using MirrorMaker 2, covering MM2 fundamentals, architecture, internal topics, deployment on Kubernetes, design goals, solution details, challenges such as dynamic configuration and offset reverse‑mapping, and productized risk mitigation.

Hot-StandbyMirrorMaker2Operational Resilience
0 likes · 11 min read
Cross‑IDC Kafka Hot‑Standby with MirrorMaker 2: Architecture, Design, and Productization
Tencent Music Tech Team
Tencent Music Tech Team
May 27, 2016 · Databases

Cross‑IDC Disaster Recovery Solution for KV Storage via a Proxy Layer

The article proposes a cross‑IDC disaster‑recovery architecture for key‑value stores that uses a storage proxy layer to record write logs in the primary data center, forward them to a read‑only backup center for replay, and route reads via load‑balancing, while noting current limitations such as complex configuration, low synchronization concurrency, and lack of multi‑write support.

DatabaseHigh AvailabilityKV storage
0 likes · 4 min read
Cross‑IDC Disaster Recovery Solution for KV Storage via a Proxy Layer