Topic

producer

Collection size
56 articles
Page 3 of 3
Architect
Architect
Dec 18, 2015 · Big Data

Understanding Apache Kafka’s High‑Throughput Architecture and Performance Optimizations

This article explains Apache Kafka’s core concepts, high‑throughput design choices such as sequential I/O, PageCache, Sendfile, and partitioning, and provides practical performance tips and configuration recommendations for brokers, producers, and consumers in large‑scale data pipelines.

ConsumerDistributed MessagingKafka
0 likes · 16 min read
Understanding Apache Kafka’s High‑Throughput Architecture and Performance Optimizations
Top Architect
Top Architect
Jul 21, 2022 · Big Data

Kafka Components and Architecture Explained

This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication strategies, and how they work together within a Kafka cluster to ensure reliable, scalable message streaming.

BrokerConsumerDistributed
0 likes · 8 min read
Kafka Components and Architecture Explained
Top Architect
Top Architect
Jun 25, 2022 · Big Data

Kafka Core Concepts: Basics, Producers & Consumers, Topics, Partitions, and Architecture

This article provides a visual and textual overview of Kafka's fundamental concepts—including its role as a streaming/message queue system, the producer‑consumer model, topics and partitions, consumer groups, and the cluster architecture managed by ZooKeeper—while also noting promotional offers and community links.

ConsumerKafkaMessage Queue
0 likes · 9 min read
Kafka Core Concepts: Basics, Producers & Consumers, Topics, Partitions, and Architecture
Top Architect
Top Architect
Nov 14, 2021 · Big Data

Kafka Core Concepts Illustrated: Basics, Producers/Consumers, Topics, Partitions, and Architecture

This article provides a visual walkthrough of Kafka's fundamental concepts—including its basic architecture, producer‑consumer model, topics, partitions, and cluster design—offering clear explanations and diagrams to help readers grasp how Kafka enables reliable, scalable message streaming in modern systems.

ConsumerKafkaMessage Streaming
0 likes · 5 min read
Kafka Core Concepts Illustrated: Basics, Producers/Consumers, Topics, Partitions, and Architecture
Top Architect
Top Architect
May 26, 2021 · Big Data

Comprehensive Introduction to Apache Kafka: Concepts, Architecture, Installation, and Usage

This article provides a comprehensive guide to Apache Kafka, covering its core concepts, architecture, key APIs, topics and partitions, deployment steps, multi‑broker clustering, fault tolerance, and data integration using Kafka Connect, with detailed command‑line examples.

ConsumerDistributed StreamingInstallation
0 likes · 26 min read
Comprehensive Introduction to Apache Kafka: Concepts, Architecture, Installation, and Usage
Top Architect
Top Architect
May 14, 2020 · Big Data

Kafka Overview, Architecture, Installation, and Operational Guide

This article provides a comprehensive introduction to Kafka, covering its definition, message queue concepts, architecture components, installation steps, configuration details, startup procedures, operational commands, producer and consumer mechanisms, reliability guarantees, partition strategies, offset management, and performance optimizations.

ConsumerInstallationKafka
0 likes · 22 min read
Kafka Overview, Architecture, Installation, and Operational Guide
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 6, 2021 · Fundamentals

Kafka Basics: Terminology, Architecture, and Configuration Overview

This article provides a comprehensive introduction to Apache Kafka, covering its core concepts, terminology, data flow, configuration options such as compression and partitioning, producer and consumer behavior, replication, consumer groups, offset management, and log retention strategies.

ConsumerKafkaMessaging
0 likes · 14 min read
Kafka Basics: Terminology, Architecture, and Configuration Overview
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 4, 2021 · Backend Development

Ensuring Reliable Kafka Messaging: Handling Message Loss, Producer, Broker, and Consumer Configurations

This article explains how Kafka can suffer message loss and duplication, and provides practical configurations for the producer, broker, and consumer—including acks, retries, replication factor, min.insync.replicas, and manual offset commits—to achieve reliable, idempotent message processing.

ConsumerIdempotencyKafka
0 likes · 9 min read
Ensuring Reliable Kafka Messaging: Handling Message Loss, Producer, Broker, and Consumer Configurations
Full-Stack Internet Architecture
Full-Stack Internet Architecture
May 25, 2021 · Big Data

Deep Dive into Kafka Producer Configuration Parameters and Performance Tuning

This article provides a comprehensive overview of Kafka Producer configuration properties, categorizing them into basic and performance‑related parameters, explains their impact on producer behavior, and offers practical guidance for tuning throughput, latency, and reliability in real‑world deployments.

ConfigurationKafkaPerformance Tuning
0 likes · 13 min read
Deep Dive into Kafka Producer Configuration Parameters and Performance Tuning
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Apr 8, 2021 · Backend Development

Kafka Interview Guide: Concepts, Architecture, Configuration, and Performance

This article provides a comprehensive overview of Kafka, covering its role as a distributed messaging middleware, core concepts, architecture components, common interview questions, command‑line tools, producer and consumer configurations, high‑availability mechanisms, delivery semantics, and performance optimizations for backend developers.

ConsumerDistributed MessagingKafka
0 likes · 20 min read
Kafka Interview Guide: Concepts, Architecture, Configuration, and Performance
Architect's Tech Stack
Architect's Tech Stack
May 31, 2019 · Big Data

Kafka Architecture Overview: Producers, Consumers, Partitions, Replication, and Transactions

This article provides a comprehensive overview of Apache Kafka's architecture, covering topics such as producer and consumer workflows, partition and replica management, leader election, offset handling, message delivery semantics, transaction support, and file organization, illustrating how Kafka achieves high performance and scalability.

ConsumerKafkaMessage Queue
0 likes · 18 min read
Kafka Architecture Overview: Producers, Consumers, Partitions, Replication, and Transactions
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 27, 2018 · Backend Development

Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models

This article explains the core concepts, components, design considerations, and common models of message queues—including point‑to‑point and publish/subscribe—while covering ordering, acknowledgment, transaction support, persistence, high availability, and practical selection guidance for high‑concurrency systems.

BackendBrokerConsumer
0 likes · 8 min read
Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models
Selected Java Interview Questions
Selected Java Interview Questions
Jul 19, 2021 · Backend Development

Message Queue Concepts and Consumption Scenarios

This article explains the core concepts of message queues—including producers, consumers, messages, brokers, and push/pull delivery—and analyzes three consumption scenarios: at‑most‑once, at‑least‑once, and exactly‑once, detailing the required producer, broker, and consumer behaviors for each.

ConsumerMessage BrokerMessage Queue
0 likes · 6 min read
Message Queue Concepts and Consumption Scenarios
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Sep 4, 2021 · Backend Development

Master Kafka Topic Management and Message Production on CentOS

Learn how to set up Kafka on CentOS, create and manage topics, adjust partitions, produce and consume messages using command‑line tools and Java code, and explore related utilities such as consumer groups, log inspection, and configuration tips for remote access.

CentOSConsumerJava
0 likes · 9 min read
Master Kafka Topic Management and Message Production on CentOS
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Apr 12, 2021 · Big Data

Master Kafka’s Delivery Guarantees: At‑Most, At‑Least, and Exactly‑Once Explained

This article explains Kafka’s three delivery semantics—At most once, At least once, and Exactly once—from both producer and consumer perspectives, details the required configuration settings, and discusses how Kafka ensures idempotence, transaction support, and prevents data loss, duplication, and ordering issues.

ConsumerKafkadelivery guarantees
0 likes · 23 min read
Master Kafka’s Delivery Guarantees: At‑Most, At‑Least, and Exactly‑Once Explained