partition-assignor

Architect

Jun 12, 2016 · Backend Development

Understanding Kafka Consumer Rebalancing and Partition Assignment in Scala

This article explains how Kafka's high‑level consumer rebalancing works, detailing the PartitionAssignor logic, assignment context creation, fetcher management, and the challenges such as herd effect and split‑brain, with Scala code examples illustrating each step.