Tencent Cloud Developer
Jul 16, 2019 · Big Data
Design and Challenges of Tencent iData Analysis Center Backend: Bitmap Storage and MapReduce Architecture
Tencent’s iData Analysis Center rebuilt its backend as TGMars, replacing a rigid row‑oriented bitmap store and single‑node MapReduce pipeline with a more extensible architecture that shards user behavior bitmaps, eliminates shuffle overhead, and adds columnar storage, iterative processing and SQL‑like capabilities using Spark to overcome scalability and flexibility limitations.
Big DataMapReduceOLAP
0 likes · 10 min read