How Baidu’s Open-Channel SSD Boosts KV Store Performance and Cuts Write Amplification

Current KV Limitations

Key‑Value (KV) storage is widely adopted for its simplicity and high access efficiency, but it suffers from several drawbacks: extremely high write amplification caused by WAL and compaction, read amplification when cache misses require multiple disk reads, mismatched business performance due to compaction consuming I/O bandwidth, and very low space utilization because a large portion of the device holds invalid data.

Baidu’s Open-Channel KV Implementation

Open‑Channel SSD is a white‑box NVMe SSD that exposes flash management functions (address mapping, garbage collection, wear leveling, error handling) to the host. Baidu’s KV engine treats the SSD not as a block device but as a KV service, writing each key‑value pair directly to a physical NAND address and recording the mapping in memory. This eliminates file‑system and block‑layer overhead, resulting in:

Minimal write amplification (≈1.05) because new data is always written to a fresh physical location and old data becomes invalid without extra copying.

No read amplification; every key contains the physical address of its value, so a single NAND read retrieves the data.

Full hardware utilization; without compaction, all SSD bandwidth serves actual business I/O, doubling usable bandwidth.

Significantly higher space utilization (≈70% of device capacity versus ~30% for traditional KV on SSD).

Greatly improved QoS due to the removal of write‑repeat and read‑wait mechanisms.

Performance tests show the Open‑Channel KV outperforms traditional solutions in both throughput and latency.

Open-Channel Platform Capabilities

Standard NVMe controller with custom Open‑Channel firmware, offering off‑the‑shelf hardware availability.

Efficient read/write/erase interface and comprehensive error reporting, giving developers full control over hardware performance.

Controller Memory Buffer (CMB) provides a non‑volatile high‑speed buffer, enabling log storage without double writes and accelerating KV writes smaller than 4 KB by several times.

Automatic data protection at page/block level, allowing developers to focus on business logic while the platform ensures reliability.

Conclusion

Baidu’s Open‑Channel KV has been integrated into several critical services, delivering performance gains that neither pure software optimizations nor conventional SSD‑based KV stores can achieve. The success validates the reliability of the Open‑Channel platform and points to further innovations that will bring high‑efficiency, high‑reliability storage solutions to a broader range of applications.