vivo Internet Technology
Mar 30, 2022 · Backend Development
Design of a Bloom Filter‑Based Video Recommendation Deduplication Service for Short Video Platforms
The paper proposes a Bloom‑filter‑based deduplication service for short‑video recommendation that moves three‑month playback histories to disk‑backed Bloom filters while keeping the latest 100 served IDs in Redis, employing write batching, sharding, expiration policies, and an incremental migration strategy to replace memory‑intensive Redis ZSets and dramatically reduce storage costs.
Bloom FilterDeduplicationRedis
0 likes · 21 min read