BestHub
Sign in
Tag

high throughput

0 views collected around this technical thread.

Raymond Ops
Raymond Ops
Jun 1, 2025 · Backend Development

RocketMQ vs Others: Key Features, Reliability, and Performance

RocketMQ, an Apache‑licensed distributed message queue from Alibaba, offers low latency, high reliability, and high throughput through features like distributed architecture, synchronous disk flushing, master‑slave replication, and flexible messaging models, and it compares favorably against Kafka, RabbitMQ, and ActiveMQ in various scenarios.

Message Queuedistributed architecturehigh reliability
0 likes · 11 min read
RocketMQ vs Others: Key Features, Reliability, and Performance
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 22, 2025 · Big Data

Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency

This article details practical techniques for boosting Kafka producer throughput, covering batch sending optimization, linger.ms tuning, asynchronous send handling, compression options, and concurrent sending strategies, while providing code examples and performance considerations for high‑throughput streaming applications.

BatchingKafkaasynchronous
0 likes · 4 min read
Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Apr 17, 2024 · Backend Development

In-Depth Analysis of Apache RocketMQ Architecture, Operation Principles, and High‑Throughput Mechanisms

This article provides a comprehensive overview of Apache RocketMQ, detailing its core components, producer and consumer workflows, storage strategies, master‑slave synchronization, Raft‑based half‑write and leader election mechanisms, and best‑practice recommendations for high‑throughput, fault‑tolerant messaging systems.

Backend DevelopmentMessage QueueRaft
0 likes · 22 min read
In-Depth Analysis of Apache RocketMQ Architecture, Operation Principles, and High‑Throughput Mechanisms
Bilibili Tech
Bilibili Tech
Apr 12, 2024 · Backend Development

Design and Optimization of a High‑Throughput Long‑Connection Service for Live Streaming

The article details a Golang‑based high‑throughput long‑connection service for live‑streaming, describing its five‑layer architecture, multi‑protocol support, load‑balancing, message‑queue decoupling, aggregation with brotli compression, multi‑region deployment, priority channels, and future enhancements for observability and intelligent endpoint selection.

Load BalancingLong ConnectionStreaming
0 likes · 16 min read
Design and Optimization of a High‑Throughput Long‑Connection Service for Live Streaming
JD Tech
JD Tech
Jun 15, 2023 · Big Data

Event Bus: Architecture, Technical Challenges, and Solutions for High‑Throughput Data Standardization

This article introduces the event bus as a data pipeline for risk insight, explains its source‑transform‑sink architecture, outlines key technical challenges such as data heterogeneity and high‑throughput parsing, and presents solutions including standardized data models, plugin extensibility, low‑code hot‑loading, dynamic grouping, one‑click degradation, and traffic monitoring.

Plugin ArchitectureStandardizationdata pipeline
0 likes · 14 min read
Event Bus: Architecture, Technical Challenges, and Solutions for High‑Throughput Data Standardization
JD Tech
JD Tech
May 19, 2023 · Databases

Evolution and Architecture of JD VOP Message Warehouse: From V1.0 to V3.0

This article details the design, scaling challenges, and successive upgrades of JD's VOP message warehouse—from early V1.0 bottlenecks through V2.0 sharding to the current V3.0 MongoDB‑based architecture—highlighting performance improvements, traffic governance, cost reduction, and future outlook for handling billions of daily messages.

Message QueueMongoDBOperational Efficiency
0 likes · 16 min read
Evolution and Architecture of JD VOP Message Warehouse: From V1.0 to V3.0
58 Tech
58 Tech
Aug 11, 2022 · Backend Development

WLock: High‑Reliability, High‑Throughput Distributed Lock Service Based on WPaxos

WLock is an open‑source distributed lock service built on the WPaxos consensus algorithm and RocksDB storage, offering multiple lock types, flexible acquisition modes, high concurrency optimizations, and strong reliability and throughput for coordinating shared resources in distributed systems.

Distributed LockReliabilityRocksDB
0 likes · 12 min read
WLock: High‑Reliability, High‑Throughput Distributed Lock Service Based on WPaxos
Laravel Tech Community
Laravel Tech Community
Apr 21, 2022 · Fundamentals

What Is Wi‑Fi 7? Features, Speeds, Frequencies, and Release Timeline

Wi‑Fi 7 (802.11be) is a forthcoming wireless standard that promises peak speeds over 40 Gbps—up to four times faster than Wi‑Fi 6—by using wider 320 MHz channels, 4096‑QAM, multi‑link operation, and advanced OFDMA and MU‑MIMO technologies across 2.4 GHz, 5 GHz, and 6 GHz bands, with devices expected to appear by late 2023 or early 2024.

802.11beMLOWi-Fi 7
0 likes · 6 min read
What Is Wi‑Fi 7? Features, Speeds, Frequencies, and Release Timeline
JD Tech
JD Tech
Apr 8, 2022 · Big Data

Designing a High‑Throughput Log Collection System with ClickHouse, UDP and Compression

The article analyses the massive cost and performance challenges of traditional log‑storage pipelines at JD.com, then proposes a streamlined architecture that eliminates disk and MQ stages, uses in‑memory buffering, UDP transport, Snappy/ZSTD compression, and ClickHouse storage to achieve multi‑gigabyte per‑second throughput with over 70% hardware cost reduction.

ClickHouseLog Collectioncompression
0 likes · 15 min read
Designing a High‑Throughput Log Collection System with ClickHouse, UDP and Compression
JD Retail Technology
JD Retail Technology
Nov 22, 2021 · Backend Development

Designing a High‑Performance Log Collection System with UDP, Compression, and ClickHouse

The article analyzes the high cost and scalability challenges of traditional log collection pipelines and proposes a streamlined architecture that uses in‑memory buffering, UDP transport, aggressive compression, and ClickHouse storage to achieve massive throughput while drastically reducing hardware and operational expenses.

ClickHouseLog CollectionMonitoring
0 likes · 15 min read
Designing a High‑Performance Log Collection System with UDP, Compression, and ClickHouse
macrozheng
macrozheng
Dec 15, 2020 · Big Data

How Kafka Achieves Million‑TPS Through Sequential I/O, MMAP, and Zero‑Copy

Kafka can sustain millions of transactions per second by writing data sequentially to disk, leveraging memory‑mapped files, employing zero‑copy DMA transfers, and batching messages, each technique reducing I/O overhead and CPU involvement, which together enable its high‑throughput performance in big‑data pipelines.

Big DataKafkaMMAP
0 likes · 11 min read
How Kafka Achieves Million‑TPS Through Sequential I/O, MMAP, and Zero‑Copy
Architecture Digest
Architecture Digest
Jan 19, 2020 · Big Data

Why Kafka Is So Fast: Sequential Writes, Memory‑Mapped Files, and Zero‑Copy

This article explains how Kafka achieves high throughput by using sequential disk writes, memory‑mapped files, batch compression, and zero‑copy sendfile for reads, while also covering data retention policies and the role of offsets in consumer processing.

Big DataKafkaMemory-Mapped Files
0 likes · 10 min read
Why Kafka Is So Fast: Sequential Writes, Memory‑Mapped Files, and Zero‑Copy
Big Data Technology Architecture
Big Data Technology Architecture
Aug 3, 2019 · Big Data

Kafka Architecture: Design Principles for High Throughput and Reliability

This article explains Kafka's design background, persistence mechanisms, disk sequential I/O optimizations, network and compression strategies, and stability features such as partitioning, replication, and ISR, illustrating how these techniques enable high‑throughput, low‑latency real‑time log processing in big‑data environments.

Big DataDisk I/OKafka
0 likes · 9 min read
Kafka Architecture: Design Principles for High Throughput and Reliability
Architecture Digest
Architecture Digest
Aug 2, 2019 · Backend Development

Design and Implementation of a High‑Throughput WeChat Red‑Envelope System Simulating 10 Billion Requests

This article describes how a single‑machine prototype was built in Go to simulate a WeChat red‑envelope service capable of handling up to 6 × 10⁴ QPS, supporting one million concurrent connections, and processing 10 billion shake‑red‑envelope requests through careful load‑balancing, monitoring, and performance analysis.

Performancebackenddistributed systems
0 likes · 17 min read
Design and Implementation of a High‑Throughput WeChat Red‑Envelope System Simulating 10 Billion Requests
Big Data Technology Architecture
Big Data Technology Architecture
Jul 9, 2019 · Big Data

Kafka Best Practices for High Throughput: 20 Recommendations

This article presents New Relic's 20 best‑practice recommendations for operating Apache Kafka at high throughput, covering partitions, consumers, producers, and brokers, and explains key concepts, configuration tuning, monitoring, and architectural considerations to ensure reliable, scalable streaming pipelines.

BrokersConsumersKafka
0 likes · 14 min read
Kafka Best Practices for High Throughput: 20 Recommendations
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Aug 29, 2018 · Artificial Intelligence

Alibaba's FPGA-Based Ultra‑Low Latency, High‑Throughput Machine Learning Processor

Alibaba unveiled an FPGA‑designed machine‑learning accelerator that achieves sub‑millisecond inference latency and thousands of frames‑per‑second throughput, demonstrating how integrated hardware‑software optimizations can deliver real‑time AI performance surpassing conventional GPU and ASIC solutions.

AI acceleratorFPGAResNet18
0 likes · 5 min read
Alibaba's FPGA-Based Ultra‑Low Latency, High‑Throughput Machine Learning Processor
Architects' Tech Alliance
Architects' Tech Alliance
Jul 6, 2017 · Fundamentals

Understanding RDMA: Principles, Advantages, and Implementation Details

The article provides a comprehensive overview of RDMA technology, explaining its low‑latency, high‑throughput benefits, origins in InfiniBand, extensions like RoCE and iWARP, the Verbs API, communication models, and why it is poised for broader adoption in modern networking and storage systems.

InfiniBandRDMARoCE
0 likes · 9 min read
Understanding RDMA: Principles, Advantages, and Implementation Details
Architecture Digest
Architecture Digest
Apr 11, 2017 · Backend Development

Design and Practice of a High‑Throughput Spring Festival Red‑Packet System Supporting One Million Connections

This article describes how to design, implement, and evaluate a backend system that simulates the Spring Festival red‑packet service, achieving up to 6 × 10⁴ QPS on a single server while handling one million concurrent connections, and discusses the hardware, software, architecture, and performance results.

QPSbackenddistributed systems
0 likes · 18 min read
Design and Practice of a High‑Throughput Spring Festival Red‑Packet System Supporting One Million Connections
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Nov 17, 2015 · Backend Development

Alipay Sets Record 85,900 Transactions per Second During 2015 Double‑11, Leveraging OceanBase and Hybrid Cloud Architecture

During the 2015 Double‑11 shopping festival, Alipay processed a peak of 85,900 transactions per second—more than double the previous year and surpassing Visa—thanks to its self‑developed OceanBase database, multi‑active data‑center deployment, and hybrid cloud infrastructure, showcasing China’s leading payment‑system technology.

AlipayOceanBasecloud computing
0 likes · 7 min read
Alipay Sets Record 85,900 Transactions per Second During 2015 Double‑11, Leveraging OceanBase and Hybrid Cloud Architecture