producer | BestHub

Collection size

56 articles

Page 2 of 3

vivo Internet Technology

Jun 4, 2025 · Cloud Native

Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning

This article provides a comprehensive analysis of Apache Pulsar's Producer component, detailing its message-sending workflow, key design principles, configuration parameters, and practical performance tuning techniques to improve throughput, reduce latency, and lower resource consumption in large‑scale cloud‑native messaging systems.

Apache PulsarCloud NativeMessaging

0 likes · 26 min read

Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning

Tencent Cloud Developer

Jan 11, 2022 · Cloud Native

Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage

Apache Pulsar is a cloud‑native distributed messaging system that combines stateless brokers, a BookKeeper storage cluster, and ZooKeeper metadata to route messages from producers to consumers across scalable partitioned or non‑partitioned topics, supporting multiple subscription models, producer access modes, routing strategies, batching, acknowledgments, delayed delivery, and deduplication.

Apache PulsarBookKeeperCloud Native

0 likes · 26 min read

Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage

Tencent Cloud Developer

Nov 19, 2020 · Backend Development

Kafka Message Queue Reliability Design and Implementation

The article thoroughly explains Kafka’s message‑queue reliability design and implementation, covering use‑case scenarios, core concepts, storage format, producer acknowledgment settings, broker replication mechanisms (ISR, HW, LEO), consumer delivery semantics, the epoch solution for synchronization, and practical configuration guidelines for various consistency and availability requirements.

BrokerConsumerKafka

0 likes · 15 min read

Kafka Message Queue Reliability Design and Implementation

vivo Internet Technology

Mar 30, 2022 · Backend Development

Load Balancing Mechanism in RocketMQ Producer and Consumer

The article explains RocketMQ’s load‑balancing for producers and consumers, detailing how producers obtain routing info from the NameServer, select MessageQueues via round‑robin while avoiding failed brokers, and how consumers periodically rebalance queue allocation using strategies such as AllocateMessageQueueAveragely to ensure even distribution and customizable assignment.

ConsumerJavaMessage Queue

0 likes · 22 min read

Load Balancing Mechanism in RocketMQ Producer and Consumer

vivo Internet Technology

Jan 13, 2021 · Big Data

An Introduction to Apache Kafka: Architecture, Concepts, and Operations

Apache Kafka is a distributed, fault‑tolerant streaming platform that uses broker clusters, topic partitions, and replicated logs to provide publish/subscribe and queue messaging, configurable retention, strong ordering within partitions, producer acknowledgments, consumer groups, and performance optimizations such as batching and zero‑copy for real‑time data pipelines.

Apache KafkaConsumerDistributed Streaming

0 likes · 26 min read

An Introduction to Apache Kafka: Architecture, Concepts, and Operations

Qunar Tech Salon

Mar 10, 2015 · Big Data

Kafka Overview: Architecture, Core Concepts, and Comparison with Other Message Queues

This article provides a comprehensive overview of Kafka, covering its background, design goals, architecture, key terminology, message routing, consumer groups, delivery guarantees, and a comparison with other popular message queue systems such as RabbitMQ, Redis, ZeroMQ, and ActiveMQ.

ConsumerKafkaMessage Queue

0 likes · 21 min read

Kafka Overview: Architecture, Core Concepts, and Comparison with Other Message Queues

360 Quality & Efficiency

Jul 23, 2021 · Big Data

Introduction to Apache Kafka: Architecture, APIs, Code Examples, and Optimization

This article provides a comprehensive overview of Apache Kafka, covering its definition, architecture, command‑line API usage, Java producer and consumer examples, core principles such as high availability and message ordering, configuration tuning, and a summary of its advantages as a high‑throughput, fault‑tolerant streaming platform.

ConfigurationConsumerKafka

0 likes · 12 min read

Introduction to Apache Kafka: Architecture, APIs, Code Examples, and Optimization

Big Data Technology Architecture

Apr 22, 2020 · Big Data

Key Kafka Producer Configuration Parameters and Tuning Recommendations

This article explains the most important Kafka producer configuration parameters—such as acks, max.request.size, retries, compression.type, buffer.memory, batch.size, linger.ms, request.timeout.ms, and max.in.fight.requests.per.connection—provides practical tuning advice, and presents a recommended setup to achieve high throughput without message loss.

ConfigurationKafkaMessage Reliability

0 likes · 9 min read

Key Kafka Producer Configuration Parameters and Tuning Recommendations

Big Data Technology Architecture

Apr 13, 2020 · Backend Development

Understanding Kafka Producer: Architecture, Data Structures, Serialization, Partitioning, and Buffering

This article provides a comprehensive overview of Kafka's Producer side, covering its architecture, the ProducerRecord data structure, serialization mechanisms, partitioning logic, and the accumulator buffer, while comparing old and new Producer clients and illustrating key configurations with code examples.

AccumulatorKafkaSerialization

0 likes · 9 min read

Understanding Kafka Producer: Architecture, Data Structures, Serialization, Partitioning, and Buffering

IT Architects Alliance

Jul 21, 2022 · Big Data

Explanation of Kafka Components and Architecture

This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, log structures, replication mechanisms, and the system’s architecture, supplemented with practical visual illustrative diagrams.

ConsumerKafkaMessaging

0 likes · 8 min read

Explanation of Kafka Components and Architecture

IT Architects Alliance

Jun 1, 2022 · Big Data

Kafka Core Concepts: Producers, Consumers, Topics, Partitions, and Architecture

This article explains the fundamental concepts of Apache Kafka, covering its role as a streaming platform, the producer‑consumer model, how topics and partitions work, consumer groups for load balancing, message ordering, replication with leaders and followers, and the coordination role of ZooKeeper.

ConsumerKafkaMessage Queue

0 likes · 5 min read

Kafka Core Concepts: Producers, Consumers, Topics, Partitions, and Architecture

Java Architect Essentials

Jun 15, 2021 · Big Data

Comprehensive Guide to Apache Kafka: Concepts, Installation, Configuration, and Usage

This article provides a thorough overview of Apache Kafka, covering its core streaming concepts, key components such as topics, partitions, producers and consumers, common use cases, step‑by‑step installation and multi‑broker configuration, fault‑tolerance testing, and an introduction to Kafka Connect for data import/export.

ConfigurationConsumerDistributed Streaming

0 likes · 24 min read

Comprehensive Guide to Apache Kafka: Concepts, Installation, Configuration, and Usage

Architecture Digest

Jun 15, 2022 · Backend Development

Understanding RocketMQ Producer and Consumer Load Balancing Mechanisms

This article explains RocketMQ’s overall architecture and details how producers and consumers achieve load balancing through routing synchronization, queue selection, and rebalance strategies, illustrated with code examples and a case study of assigning consumption to a specific machine.

ConsumerJavaMessage Queue

0 likes · 20 min read

Understanding RocketMQ Producer and Consumer Load Balancing Mechanisms

Architecture Digest

Mar 14, 2021 · Big Data

Understanding Kafka Message Loss: Causes and Mitigation in Broker, Producer, and Consumer

This article explains why Kafka can lose messages at the broker, producer, and consumer levels, describes the underlying mechanisms such as page cache flushing and acknowledgment settings, and provides practical code examples and mitigation strategies to improve reliability.

AckBrokerConsumer

0 likes · 12 min read

Understanding Kafka Message Loss: Causes and Mitigation in Broker, Producer, and Consumer

Architecture Digest

May 16, 2020 · Backend Development

RocketMQ Producer and Consumer Best Practices and Configuration Guide

This article provides a comprehensive guide to using RocketMQ, covering producer and consumer message handling, tag and key usage, logging, failure retry strategies, oneway sending, broker roles, name server addressing, client configuration, JVM and Linux kernel tuning, and practical code examples.

BackendConfigurationConsumer

0 likes · 19 min read

RocketMQ Producer and Consumer Best Practices and Configuration Guide

Architecture Digest

May 3, 2020 · Big Data

Kafka Concept Overview

This article provides a comprehensive introduction to Kafka, covering its definition, message‑queue models, architecture components, installation steps, configuration details, producer and consumer mechanisms, reliability guarantees, partition assignment strategies, offset management, and high‑performance read/write techniques.

ConsumerKafkaMessage Queue

0 likes · 20 min read

Architecture Digest

Aug 7, 2018 · Big Data

Apache Kafka Overview, Architecture, and Sample Producer/Consumer Code

This article provides a comprehensive overview of Apache Kafka, comparing it with ActiveMQ, explaining its distributed architecture, topics, partitions, consumption models, high‑availability mechanisms, exactly‑once semantics, and includes detailed Java producer and consumer code examples for practical implementation.

ConsumerDistributed MessagingKafka

0 likes · 22 min read

Architect

Feb 12, 2022 · Big Data

In-Depth Overview of Apache Kafka Architecture and Core Concepts

This article provides a comprehensive introduction to Apache Kafka, covering its distributed streaming platform features, message queue patterns, topic and partition design, broker and cluster roles, producer and consumer mechanics, partition assignment strategies, data storage, reliability guarantees, and performance optimizations such as zero‑copy and batch processing.

ConsumerKafkaMessage Queue

0 likes · 23 min read

Architect

Jan 22, 2021 · Big Data

Understanding Kafka Topic Partitions, Producer Partitioning Strategies, and Consumer Assignment

This article explains how Kafka producers decide which partition to send messages to, how topic partition counts are configured, and how consumer groups assign partitions to instances using default range and round‑robin strategies, with code examples for illustration.

AssignmentConsumerKafka

0 likes · 17 min read

Understanding Kafka Topic Partitions, Producer Partitioning Strategies, and Consumer Assignment

Architect

May 4, 2016 · Big Data

Kafka Main Configuration Parameters – Broker, Producer, Consumer, and Topic Settings

This article provides a comprehensive overview of Kafka's core configuration options, detailing default values and descriptions for broker, producer, consumer, and topic‑level settings to help administrators fine‑tune performance, reliability, and resource usage.

BrokerConfigurationConsumer

0 likes · 23 min read

Kafka Main Configuration Parameters – Broker, Producer, Consumer, and Topic Settings