Tag

transparent compression

1 views collected around this technical thread.

DataFunTalk
DataFunTalk
May 29, 2018 · Big Data

Design, Challenges, and Evolution of Lianjia's Big Data Platform Architecture (0 → 1.0 → 2.0)

This article details the evolution of Lianjia's massive‑data platform from its initial 0 version through 1.0 and 2.0, describing architectural challenges, a three‑layer redesign, data‑engine selection (ROLAP, MOLAP, Kylin), transparent compression techniques, and practical lessons for large‑scale data systems.

HadoopKylinOLAP
0 likes · 14 min read
Design, Challenges, and Evolution of Lianjia's Big Data Platform Architecture (0 → 1.0 → 2.0)
Beike Product & Technology
Beike Product & Technology
Mar 9, 2018 · Big Data

Design and Implementation of Transparent Compression for Hadoop Using ZFS

The article presents a comprehensive solution for reducing Hadoop cluster storage consumption by applying ZFS‑based transparent compression and data‑governance techniques, detailing the technical background, design choices, implementation steps, performance optimizations, and observed storage savings.

HadoopZFSbig data
0 likes · 12 min read
Design and Implementation of Transparent Compression for Hadoop Using ZFS