Optimistic Concurrency Control

DataFunTalk

Dec 27, 2022 · Big Data

Multi‑Stream Join and Concurrency Control in Apache Hudi: Design, Implementation, and Usage

This article presents a comprehensive solution for multi‑stream joins in Apache Hudi, detailing the challenges of dimension and multi‑stream joins, the novel storage‑layer join approach, timeline‑based concurrency control, marker mechanisms, early conflict detection, payload customization, and practical usage with Flink and Spark, along with performance benefits and future directions.

Apache HudiData LakeFlink

0 likes · 31 min read

Multi‑Stream Join and Concurrency Control in Apache Hudi: Design, Implementation, and Usage

AntTech

Aug 7, 2018 · Databases

A Timeline Review of Optimistic Concurrency Control (OCC) from Theory to Production Systems

This article presents a chronological overview of Optimistic Concurrency Control (OCC), covering its early theoretical foundations, key research papers, prototype implementations such as MVCC+OCC+2PC and Hekaton, and its adoption in modern distributed NewSQL databases like Megastore, F1, and MaaT, highlighting both advantages and challenges.

Database TransactionsDistributed SystemsNewSQL

0 likes · 33 min read

A Timeline Review of Optimistic Concurrency Control (OCC) from Theory to Production Systems