Sohu Tech Products
Nov 1, 2023 · Databases
Engineering Practices of Douyin's Vector Database: From Retrieval Challenges to Cloud‑Native Solutions
Douyin tackled vector‑retrieval challenges by optimizing HNSW and creating a high‑performance IVF algorithm, implementing custom scalar quantization, SIMD acceleration, and a DSL‑driven engine that merges filtering with search, then built a cloud‑native, storage‑compute‑separated vector database (VikingDB) delivering sub‑10 ms latency, real‑time updates, multi‑tenant support, and secure, scalable retrieval for LLM‑driven applications.
ANNLLM integrationcloud-native
0 likes · 18 min read