producer | BestHub

vivo Internet Technology

Jun 4, 2025 · Cloud Native

Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning

This article provides a comprehensive analysis of Apache Pulsar's Producer component, detailing its message-sending workflow, key design principles, configuration parameters, and practical performance tuning techniques to improve throughput, reduce latency, and lower resource consumption in large‑scale cloud‑native messaging systems.

Apache PulsarMessagingPerformance Tuning

0 likes · 26 min read

Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning

Java Captain

May 23, 2025 · Backend Development

Common Causes of Kafka Message Loss and Mitigation Strategies

This article examines the typical reasons Kafka messages are lost across producers, brokers, and consumers, and provides detailed configuration recommendations and best‑practice solutions to significantly reduce the risk of data loss in distributed streaming systems.

BrokerConfigurationConsumer

0 likes · 15 min read

Common Causes of Kafka Message Loss and Mitigation Strategies

Mike Chen's Internet Architecture

May 22, 2025 · Big Data

Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency

This article details practical techniques for boosting Kafka producer throughput, covering batch sending optimization, linger.ms tuning, asynchronous send handling, compression options, and concurrent sending strategies, while providing code examples and performance considerations for high‑throughput streaming applications.

BatchingHigh ThroughputKafka

0 likes · 4 min read

Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency

DaTaobao Tech

Aug 14, 2024 · Backend Development

Deep Dive into RocketMQ Architecture and Core Components

The article thoroughly explains RocketMQ’s architecture—including stateless NameServers for routing, master‑slave Brokers with sequential CommitLog storage, stateless Producers and pull‑or‑push Consumers, message flow, indexing, and synchronous double‑write reliability—showing how these components deliver high‑throughput, scalable, fault‑tolerant messaging for distributed systems.

BrokerConsumerDistributed Systems

0 likes · 20 min read

Deep Dive into RocketMQ Architecture and Core Components

Rare Earth Juejin Tech Community

Jul 22, 2024 · Big Data

Comprehensive Guide to Kafka: Architecture, Core Concepts, and Configuration

This article provides an in‑depth overview of Apache Kafka, covering its use cases, comparison with other message queues, versioning, performance mechanisms, core concepts such as topics, partitions, offsets, consumer groups, rebalancing, replication, leader election, idempotence, transactions, compression, interceptors, request handling, and practical configuration tips for reliable streaming applications.

Big DataConsumerKafka

0 likes · 25 min read

Comprehensive Guide to Kafka: Architecture, Core Concepts, and Configuration

Code Ape Tech Column

Jul 4, 2023 · Backend Development

Guide to Using Apache Pulsar Java Client with Spring Boot

This tutorial explains how to deploy a single‑node Pulsar cluster with Docker, configure the Java client in a Spring Boot application, and create producers and consumers with detailed code examples and parameter explanations.

Apache PulsarConsumerDocker

0 likes · 11 min read

Guide to Using Apache Pulsar Java Client with Spring Boot

Architect's Guide

Jun 6, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

This article provides a comprehensive overview of Kafka, covering its core value for decoupling and asynchronous processing, fundamental concepts such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, detailed resource evaluation for CPU, memory, disk and network, operational tools, consumer‑group rebalance strategies, LEO/HW offsets, controller management, and delayed‑task scheduling.

Cluster PlanningConsumer GroupKafka

0 likes · 29 min read

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

FunTester

May 25, 2023 · Backend Development

Using the Sarama Go Library for Kafka: Configuration, Producer & Consumer Samples, and Simple Performance Testing

This article demonstrates how to use the Go Sarama library to configure Kafka producers and consumers, provides sample code for sending and receiving messages, and includes a lightweight performance test that repeatedly publishes messages to evaluate throughput and latency.

ConsumerGoKafka

0 likes · 11 min read

Using the Sarama Go Library for Kafka: Configuration, Producer & Consumer Samples, and Simple Performance Testing

FunTester

May 5, 2023 · Big Data

Kafka Client API Performance Testing with Producer and Consumer Examples

This article introduces Kafka, a high‑performance distributed messaging system, and provides step‑by‑step Java/Groovy examples for configuring a producer and consumer, demonstrating how to benchmark their throughput using the FunQpsConcurrent framework, along with necessary Gradle dependencies and server setup instructions.

ConsumerDistributed MessagingJava

0 likes · 8 min read

Kafka Client API Performance Testing with Producer and Consumer Examples

Top Architect

Mar 30, 2023 · Backend Development

Understanding Kafka Idempotent Producer and How to Prevent Message Duplicates

This article explains why message duplication occurs in Kafka, describes the three delivery semantics, and provides practical solutions—including idempotent producers, transactions, and consumer-side idempotence—along with configuration tips and code examples to achieve exactly‑once delivery.

ConfigurationJavaKafka

0 likes · 11 min read

Understanding Kafka Idempotent Producer and How to Prevent Message Duplicates

Top Architect

Mar 27, 2023 · Big Data

Kafka Architecture, Performance Optimization, and Production Deployment Guide

This article provides a comprehensive overview of Kafka’s core concepts, high‑performance design, cluster planning, resource evaluation, deployment steps, producer and consumer configurations, fault‑tolerance mechanisms, and operational tools, offering practical guidance for building and managing a high‑throughput Kafka production environment.

ConsumerDistributed SystemsJava

0 likes · 31 min read

Kafka Architecture, Performance Optimization, and Production Deployment Guide

Architecture Digest

Feb 9, 2023 · Big Data

Understanding Kafka Messages, Topics, Partitions, and Consumers

This article explains Kafka's core concepts—including messages as byte arrays, optional keys for partition control, topic and partition organization, producer and consumer roles, offsets, consumer groups, and broker clusters—providing a concise technical overview for developers learning Kafka.

ConsumerKafkaMessage

0 likes · 6 min read

Understanding Kafka Messages, Topics, Partitions, and Consumers

Tencent Cloud Developer

Sep 26, 2022 · Big Data

Kafka Architecture Overview and Core Concepts

Kafka’s architecture consists of brokers forming clusters, producers publishing to topics split into partitions with replicas, consumers organized in groups pulling messages by offset, ZooKeeper managing metadata, and log‑based storage using append‑only files, indexes, and zero‑copy, while configurable acknowledgment, batching, and replication ensure high throughput and fault‑tolerant reliability.

ConsumerDistributed SystemsKafka

0 likes · 18 min read

Kafka Architecture Overview and Core Concepts

Wukong Talks Architecture

Sep 2, 2022 · Big Data

Preventing Data Loss in Kafka: Message Semantics, Failure Scenarios, and Reliability Solutions

This article explains Kafka's message delivery semantics, analyzes potential data‑loss scenarios across producer, broker, and consumer components, and provides concrete configuration and coding practices—such as idempotent producers, proper ACK settings, replication factors, and manual offset commits—to maximize message durability and reliability.

BrokerConsumerData Loss

0 likes · 18 min read

Preventing Data Loss in Kafka: Message Semantics, Failure Scenarios, and Reliability Solutions

Top Architect

Aug 31, 2022 · Big Data

Kafka Components and Architecture Overview

This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication, leader/follower dynamics, and architectural diagrams, while also highlighting configuration details and operational considerations for building reliable distributed streaming systems.

ArchitectureBrokerConsumer

0 likes · 9 min read

Kafka Components and Architecture Overview

Mike Chen's Internet Architecture

Aug 21, 2022 · Backend Development

12 Core Principles of Message Queues (MQ) – A Comprehensive Summary

This article provides a detailed overview of message queue fundamentals, covering producers, consumers, brokers, queue and topic models, delivery guarantees, acknowledgment mechanisms, ordering, persistence, high availability, and selection criteria, helping readers quickly grasp essential MQ concepts for distributed systems.

BrokerConsumerMessage Queue

0 likes · 9 min read

12 Core Principles of Message Queues (MQ) – A Comprehensive Summary

Wukong Talks Architecture

Aug 9, 2022 · Big Data

Kafka Basics: 15 Key Questions and In‑Depth Answers

This comprehensive guide covers Kafka’s core concepts, architecture, Zookeeper role, producer sending modes, partitioning strategies, replica types, message deletion, performance optimizations, consumer models, offset management, and best‑practice recommendations for scaling and ensuring ordered delivery in distributed streaming systems.

Big DataConsumerDistributed Systems

0 likes · 31 min read

Kafka Basics: 15 Key Questions and In‑Depth Answers

Selected Java Interview Questions

Aug 7, 2022 · Backend Development

Ensuring Message Reliability in RocketMQ: Producer, Broker, and Consumer Strategies

This article explains how RocketMQ reduces message loss and duplicate consumption through synchronous sending, retry mechanisms, multi‑master brokers, synchronous disk flushing, master‑slave replication, at‑least‑once delivery, and idempotent processing techniques.

BrokerConsumerDuplicate Consumption

0 likes · 10 min read

Ensuring Message Reliability in RocketMQ: Producer, Broker, and Consumer Strategies

IT Architects Alliance

Aug 4, 2022 · Big Data

Explanation of Kafka Components and Architecture

This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, how they interact within a Kafka cluster, and illustrating the architecture with diagrams while also noting recent version changes and related disclaimer information.

ArchitectureBrokerConsumer

0 likes · 7 min read

Explanation of Kafka Components and Architecture

IT Architects Alliance

Aug 3, 2022 · Big Data

Kafka Producer: Overview, Detailed Process, Key Challenges, and Configuration

This article provides a comprehensive English guide to Kafka's producer component, covering its end‑to‑end workflow, detailed steps such as record creation, serialization, partitioning, batching, sender thread, custom data structures, send modes, common exceptions, and essential configuration parameters for optimal performance.

AVROConfigurationJava

0 likes · 16 min read

Kafka Producer: Overview, Detailed Process, Key Challenges, and Configuration