BestHub
Sign in
Tag

Shuttle

1 views collected around this technical thread.

DataFunSummit
DataFunSummit
Apr 20, 2024 · Big Data

OPPO Public Cloud Big Data Cost Optimization: Architecture, Challenges, and Results

This article presents OPPO's CloudCamel solution for big data cost optimization on public cloud, detailing domestic and overseas architectures, elastic redesigns, component innovations, migration considerations, performance metrics, and future technical and operational directions.

Big DataEKSOPPO
0 likes · 11 min read
OPPO Public Cloud Big Data Cost Optimization: Architecture, Challenges, and Results
DataFunTalk
DataFunTalk
May 3, 2023 · Big Data

Shuttle2.0: Enhancing Spark and Flink Shuffle with Distributed Sorting and Adaptive Broadcast

Shuttle2.0 extends OPPO's open‑source high‑availability Spark Remote Shuffle Service to support Flink, introduces a unified stream‑batch data model, pipelines shuffle with distributed sorting, and provides an Adaptive BroadcastJoin solution that dramatically improves performance and stability for large‑scale big‑data workloads.

Adaptive BroadcastBig DataDistributed Sorting
0 likes · 11 min read
Shuttle2.0: Enhancing Spark and Flink Shuffle with Distributed Sorting and Adaptive Broadcast