StreamingSQL | BestHub

Liulishuo Tech Team

Jan 12, 2021 · Big Data

Design and Implementation of CDC‑Based Real‑Time Data Ingestion with Delta Lake on Alibaba Cloud EMR

This article describes how FluentSpeak replaced a DataX master‑slave pipeline with a CDC‑plus‑Delta Lake solution on Alibaba Cloud EMR, detailing architecture choices, streaming SQL merge logic, monitoring, challenges, and the resulting cost and latency improvements.

CDCDelta LakeEMR

0 likes · 17 min read

Design and Implementation of CDC‑Based Real‑Time Data Ingestion with Delta Lake on Alibaba Cloud EMR

DataFunTalk

Jul 22, 2020 · Big Data

Building a Real-Time Computing Platform with Apache Flink at iQIYI: Architecture, Improvements, and Business Cases

iQIYI’s senior data engineer shares the evolution of its big‑data services from Hadoop to a Flink‑based real‑time computing platform, detailing architecture, monitoring improvements, StreamingSQL capabilities, business use cases like recommendation and deep‑learning data generation, and future plans for unified stream‑batch processing.

Apache FlinkFlinkStreamingSQL

0 likes · 11 min read

Building a Real-Time Computing Platform with Apache Flink at iQIYI: Architecture, Improvements, and Business Cases