BestHub
Sign in
Tag

KV storage

1 views collected around this technical thread.

Ximalaya Technology Team
Ximalaya Technology Team
Jul 13, 2023 · Databases

Evolution of Ximalaya KV Storage and XCache Architecture

Ximalaya’s KV storage progressed from a simple Redis master‑slave setup to client‑side sharding, then adopted Codis clustering for elastic scaling, integrated Pika’s disk‑based store with cold‑hot separation, introduced KV‑blob separation, fast‑slow command pools, second‑level expansion, ehash fields, large‑key circuit breaking, multi‑active data‑center replication, and now targets cloud‑native deployment, advanced features, and AI‑driven operations.

CodisHigh AvailabilityKV storage
0 likes · 19 min read
Evolution of Ximalaya KV Storage and XCache Architecture
Baidu App Technology
Baidu App Technology
Jul 5, 2023 · Mobile Development

Baidu App Android Startup Performance Optimization: Theory, Tools, and Practical Implementations

Baidu dramatically accelerated its Android app’s launch by dissecting the cold‑start sequence, applying full‑path analysis, leveraging tracing tools, introducing a priority‑aware task‑scheduling framework, replacing SharedPreferences with the binary UniKV store, eliminating lock contention, and tightening thread, I/O, and library loading, which together cut ANR rates and boosted user retention.

ANRAndroidKV storage
0 likes · 24 min read
Baidu App Android Startup Performance Optimization: Theory, Tools, and Practical Implementations
DataFunSummit
DataFunSummit
Jun 21, 2023 · Databases

Forum on Building Ultra‑Scale Storage Systems: Insights from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud

The forum gathers senior experts from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud to share practical experiences and future trends on constructing ultra‑large‑scale file, block, KV and NoSQL storage systems, focusing on low‑cost, high‑performance solutions and architectural challenges.

Distributed SystemsKV storageLarge Scale
0 likes · 8 min read
Forum on Building Ultra‑Scale Storage Systems: Insights from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud
DataFunSummit
DataFunSummit
Mar 15, 2023 · Databases

Abase: ByteDance’s Large‑Scale Online KV Storage System – Architecture, High Availability, and Key Technologies

This article introduces Abase, ByteDance’s massive online KV storage system, detailing its evolution from a single‑cluster KV service to a multi‑region, multi‑tenant platform, and explains the high‑availability challenges and the leaderless multi‑write architecture, hybrid logical clocks, quorum settings, and performance optimizations that enable hundred‑billion QPS and sub‑10 ms latency.

AbaseByteDanceDistributed Systems
0 likes · 19 min read
Abase: ByteDance’s Large‑Scale Online KV Storage System – Architecture, High Availability, and Key Technologies
Architect
Architect
Jan 18, 2023 · Databases

Design and Architecture of Bilibili's High‑Performance KV Storage System

This article presents the background, overall architecture, partitioning strategies, raft‑based replication, binlog support, multi‑active deployment, bulk‑load mechanisms, storage‑engine optimizations, load‑balancing policies, and failure‑detection & recovery techniques of a high‑reliability, high‑throughput key‑value store used at Bilibili.

Bulk LoadDistributed SystemsKV storage
0 likes · 22 min read
Design and Architecture of Bilibili's High‑Performance KV Storage System
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Nov 11, 2022 · Mobile Development

Advanced Android Componentization: Component Splitting, Multi‑UI Strategies, KV Storage, and Routing Best Practices

This article explains how to split Android components based on business functionality, handle strong and weak component dependencies, configure multiple UI themes, manage key‑value storage safely with MMKV‑KTX, and use routing frameworks judiciously to keep modular apps maintainable and scalable.

AndroidKV storageKotlin
0 likes · 22 min read
Advanced Android Componentization: Component Splitting, Multi‑UI Strategies, KV Storage, and Routing Best Practices
Xianyu Technology
Xianyu Technology
Apr 13, 2022 · Big Data

Real-time Multi-system Data Aggregation for Fan Tag System

The Xianyu fan‑tag system solves the challenge of displaying full‑history purchase counts with real‑time updates and low‑latency, high‑throughput queries by daily exporting multi‑system data to a LevelDB‑based KV store, converting schemas, and applying real‑time compensation from transaction and follow‑change messages, merging offline and live data to produce sorted fan lists at ~10 k QPS.

KV storageReal-time Processingdata aggregation
0 likes · 6 min read
Real-time Multi-system Data Aggregation for Fan Tag System
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Mar 16, 2022 · Databases

RDB: Cloud Music's Customized Algorithm Feature KV Storage System Based on RocksDB

To meet Cloud Music’s massive algorithm‑feature KV storage needs, the team built RDB—a RocksDB‑based engine within Tair—adding bulk‑load, dual‑version imports, KV‑separation, in‑place sequence appends and protobuf field updates, cutting storage cost, write amplification and latency while scaling to billions of records and millions of QPS.

Algorithm FeaturesBulkloadCompaction
0 likes · 16 min read
RDB: Cloud Music's Customized Algorithm Feature KV Storage System Based on RocksDB
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Oct 27, 2021 · Databases

Why Pika Beats Redis for Large-Scale KV Storage: Advantages, Ops, and Real-World Use

This article explains how Pika, a disk‑based Redis‑compatible KV store, overcomes Redis’s memory limits with larger capacity, faster backup, and comparable performance, and describes its deployment, management, monitoring, and migration workflows within 360’s HULK cloud platform.

Database OperationsHULK platformKV storage
0 likes · 9 min read
Why Pika Beats Redis for Large-Scale KV Storage: Advantages, Ops, and Real-World Use
High Availability Architecture
High Availability Architecture
Oct 9, 2021 · Databases

Building a High‑Performance Cloud‑Native KV Storage System at Baidu

This article describes Baidu's design and implementation of a cloud‑native, high‑performance KV storage platform—UNDB—covering the performance and cloud‑native challenges, engine optimizations, dynamic management, multi‑model architecture, and the resulting cost and reliability improvements for massive search and feed workloads.

BaiduDistributed SystemsKV storage
0 likes · 19 min read
Building a High‑Performance Cloud‑Native KV Storage System at Baidu
Baidu Geek Talk
Baidu Geek Talk
Sep 27, 2021 · Databases

Baidu's High-Performance KV Storage System Practice: Cloud-Native Optimization and Software-Hardware Co-Design

Baidu’s UNDB KV storage system, built with cloud‑native containerization and software‑hardware co‑design, separates key‑value processing to cut write amplification below 1.5×, leverages an OpenChannel SSD engine for over 30% performance gains, scales to 10,000+ servers and 100 PB, handles more than a trillion daily requests across search and feed, and cuts operating costs by nearly half.

Distributed StorageKV storageNoSQL
0 likes · 19 min read
Baidu's High-Performance KV Storage System Practice: Cloud-Native Optimization and Software-Hardware Co-Design
Trip Tech Team
Trip Tech Team
Aug 12, 2021 · Databases

Unlocking HTAP: Inside TiDB, TiKV, RocksDB, and LevelDB Architecture

This article introduces TiDB’s hybrid transactional‑analytical processing capabilities, explains TiKV’s region‑based storage built on RocksDB, and provides a detailed overview of RocksDB and LevelDB architectures, including their data structures, write‑read flows, and key optimizations for modern distributed database systems.

Distributed DatabaseHTAPKV storage
0 likes · 16 min read
Unlocking HTAP: Inside TiDB, TiKV, RocksDB, and LevelDB Architecture
Tencent Cloud Developer
Tencent Cloud Developer
Mar 31, 2021 · Backend Development

Design and Implementation of a Distributed Timer Service at Tencent

The article details Tencent’s design and implementation of a distributed timer service—using a multi‑level time‑wheel stored in a KV system, a scheduler daemon, broker, and notifier—to support reliable, low‑latency delayed tasks such as order closure and SMS activation, while addressing isolation, rate limiting, disaster recovery, and delivery guarantees.

Backend DevelopmentHigh AvailabilityKV storage
0 likes · 15 min read
Design and Implementation of a Distributed Timer Service at Tencent
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
May 2, 2017 · Databases

Choosing the Right KV Store: Redis vs Redis Cluster vs Pika for High‑Scale 360 Applications

This article examines 360’s explosive KV storage demand and compares three solutions—Redis, Redis Cluster, and Pika—detailing their features, performance, persistence options, eviction policies, architectures, migration tools, and ideal usage scenarios for high‑traffic, large‑scale applications.

DatabaseKV storagePika
0 likes · 17 min read
Choosing the Right KV Store: Redis vs Redis Cluster vs Pika for High‑Scale 360 Applications
Tencent Music Tech Team
Tencent Music Tech Team
May 27, 2016 · Databases

Cross‑IDC Disaster Recovery Solution for KV Storage via a Proxy Layer

The article proposes a cross‑IDC disaster‑recovery architecture for key‑value stores that uses a storage proxy layer to record write logs in the primary data center, forward them to a read‑only backup center for replay, and route reads via load‑balancing, while noting current limitations such as complex configuration, low synchronization concurrency, and lack of multi‑write support.

DatabaseHigh AvailabilityKV storage
0 likes · 4 min read
Cross‑IDC Disaster Recovery Solution for KV Storage via a Proxy Layer