BestHub
Sign in
Tagged articles
2124 articles
Page 7 of 22
DataFunTalk
DataFunTalk
Jan 3, 2023 · Big Data

Tencent Unified Big Data Scheduling Platform – Architecture, Design, and Operations

The article presents an in‑depth overview of Tencent's self‑developed Unified Scheduling Platform, detailing its system architecture, design challenges, performance optimizations, resource‑fair scheduling mechanisms, operational metrics, future roadmap, and a Q&A session that together illustrate how the platform enables massive offline data processing at scale.

Big DataDistributed SystemsPerformance Optimization
0 likes · 18 min read
Tencent Unified Big Data Scheduling Platform – Architecture, Design, and Operations
Top Architect
Top Architect
Jan 2, 2023 · Big Data

Optimizing Kafka at Meituan: Challenges and Solutions for a Large‑Scale Data Platform

This article details Meituan's use of Kafka as a unified data cache and distribution layer, outlines the challenges of massive scale and latency, and presents comprehensive optimizations across application, system, and cluster management layers, including disk balancing, migration acceleration, fetcher isolation, and full‑link monitoring.

Big DataDistributed SystemsKafka
0 likes · 22 min read
Optimizing Kafka at Meituan: Challenges and Solutions for a Large‑Scale Data Platform
Architecture & Thinking
Architecture & Thinking
Dec 28, 2022 · Backend Development

Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging

This article explains the concept of idempotency, illustrates why repeated operations must yield identical results, and details how RocketMQ’s components—NameServer, Broker, Producer, and Consumer—can be designed with unique message IDs and acknowledgment mechanisms to achieve reliable, duplicate‑free messaging in backend systems.

Distributed SystemsIdempotencyMessage Queue
0 likes · 10 min read
Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging
Selected Java Interview Questions
Selected Java Interview Questions
Dec 23, 2022 · Backend Development

Effective Cache Strategies for Large Distributed Systems

This article explains how to design and use client‑side, CDN, and server‑side caches—including Redis data structures, consistency patterns, and mitigation techniques for cache breakdown, penetration, and avalanche—to achieve high performance and reliability in billion‑user distributed applications.

Cache ConsistencyDistributed Systemscache-penetration
0 likes · 23 min read
Effective Cache Strategies for Large Distributed Systems
Programmer DD
Programmer DD
Dec 21, 2022 · Cloud Native

Spring Cloud 2022.0.0 Released: New Features, Modules, and Java 17 Support

Spring Cloud 2022.0.0, built on Spring Framework 6.x and Spring Boot 3.x, introduces a suite of updated modules, full Jakarta EE compatibility, mandatory Java 17 support, and marks OpenFeign as feature‑complete, offering developers a comprehensive toolkit for modern distributed systems.

Distributed SystemsSpring Boot 3java-17
0 likes · 3 min read
Spring Cloud 2022.0.0 Released: New Features, Modules, and Java 17 Support
Architect
Architect
Dec 14, 2022 · Backend Development

Service Rate Limiting, Degradation, and Caching Strategies for High-Concurrency E‑Commerce Systems

This article discusses how to handle sudden traffic spikes in e‑commerce APIs by employing caching, rate‑limiting (leaky bucket, token bucket, sliding window), Nginx and Java Semaphore limits, distributed queue buffering, service degradation, and cache‑consistency techniques to ensure system stability.

Distributed SystemsRate Limitingservice degradation
0 likes · 8 min read
Service Rate Limiting, Degradation, and Caching Strategies for High-Concurrency E‑Commerce Systems
Java High-Performance Architecture
Java High-Performance Architecture
Dec 12, 2022 · Backend Development

Java Rate Limiting: Fixed, Sliding, Leaky & Token Bucket Algorithms Explained

This article introduces the concept of rate limiting, explains three core algorithms—fixed window, sliding window, and leaky bucket—along with the token bucket approach, provides Java code examples for each, discusses their principles, advantages, and pitfalls, and outlines practical implementation considerations.

Distributed SystemsJavaRate Limiting
0 likes · 15 min read
Java Rate Limiting: Fixed, Sliding, Leaky & Token Bucket Algorithms Explained
Architect
Architect
Dec 10, 2022 · Backend Development

Rate Limiting: Concepts, Common Algorithms, and Practical Implementation Strategies

This article explains the fundamentals of rate limiting, describes widely used algorithms such as token bucket, leaky bucket, and sliding window, and details practical implementation methods ranging from single‑machine tools like Guava and Tomcat to distributed solutions using Nginx, Redis, and Sentinel.

Distributed SystemsRate LimitingSliding Window
0 likes · 17 min read
Rate Limiting: Concepts, Common Algorithms, and Practical Implementation Strategies
Thoughts on Knowledge and Action
Thoughts on Knowledge and Action
Dec 10, 2022 · Fundamentals

How Raft Guarantees Consistent Log Replication and Leader Election

This article explains the Raft consensus algorithm, detailing how it breaks consistency into leader election, log replication, and safety, and describes the roles, term handling, election rules, log matching, snapshotting, and the RPC mechanisms that ensure a reliable distributed state machine.

Consensus AlgorithmDistributed SystemsLog Replication
0 likes · 12 min read
How Raft Guarantees Consistent Log Replication and Leader Election
Selected Java Interview Questions
Selected Java Interview Questions
Dec 9, 2022 · Backend Development

Design and Implementation of BetterGateway for Centralized Error‑Code Management in Distributed Systems

This article describes the background, design, configuration, code implementation, and testing of BetterGateway—a Spring Cloud Alibaba‑based gateway that centralizes error‑code management using Nacos and dynamic refresh to enable fast, accurate exception tracing across micro‑services and third‑party interfaces.

Distributed SystemsError HandlingNacos
0 likes · 15 min read
Design and Implementation of BetterGateway for Centralized Error‑Code Management in Distributed Systems
php Courses
php Courses
Dec 8, 2022 · Backend Development

Session Sharing Solutions in Distributed Environments: Nginx ip_hash, Tomcat Replication, Redis Cache, and Cookie

To prevent repeated logins in distributed microservice systems, this article explains four session‑sharing solutions—Nginx ip_hash load balancing, Tomcat session replication, Redis‑based session caching, and cookie‑based storage—detailing their principles, configuration examples, and advantages and disadvantages.

Distributed SystemsTomcatnginx
0 likes · 5 min read
Session Sharing Solutions in Distributed Environments: Nginx ip_hash, Tomcat Replication, Redis Cache, and Cookie
High Availability Architecture
High Availability Architecture
Dec 1, 2022 · Fundamentals

Extending Paxos with Partially Ordered rnd Values for Transactional Mutual Exclusion

The article explains how Paxos can be generalized by defining its round number (rnd) over any partially ordered set, enabling both forced and non‑forced conflict exclusion mechanisms similar to 2PC, and showing how this expands Paxos’s applicability to multi‑dimensional transaction ordering and simplifies distributed database architectures.

2PCConsensusDistributed Systems
0 likes · 4 min read
Extending Paxos with Partially Ordered rnd Values for Transactional Mutual Exclusion
Architecture Digest
Architecture Digest
Nov 30, 2022 · Backend Development

Meituan Kafka at Scale: Challenges and Optimizations for Latency, Cluster Management, and Reliability

This article details Meituan's large‑scale Kafka deployment—over 15,000 machines and petabyte‑level daily traffic—its operational challenges such as slow nodes, load imbalance, and resource contention, and the comprehensive read/write latency, system‑level, and cluster‑management optimizations implemented to improve performance and reliability.

Cluster ManagementDistributed SystemsKafka
0 likes · 22 min read
Meituan Kafka at Scale: Challenges and Optimizations for Latency, Cluster Management, and Reliability
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Nov 28, 2022 · Cloud Computing

How Baidu’s ARIES Powers Exabyte-Scale Cloud Storage for Baidu Netdisk

This article presents a comprehensive overview of Baidu’s ARIES storage platform, detailing its design philosophy, architecture, key concepts, and engineering challenges, and explains how it underpins Baidu Netdisk’s massive data‑plane storage with high availability, cost‑performance trade‑offs, and robust monitoring.

Distributed SystemsResource Managementcloud storage
0 likes · 36 min read
How Baidu’s ARIES Powers Exabyte-Scale Cloud Storage for Baidu Netdisk
Java Architect Essentials
Java Architect Essentials
Nov 27, 2022 · Backend Development

Service Rate Limiting, Degradation, and Caching Strategies for High‑Concurrency E‑commerce Interfaces

The article explains how to protect a suddenly hot product API in an e‑commerce system by applying caching, various rate‑limiting algorithms, service degradation techniques, and distributed caching patterns, providing concrete Java code and architectural recommendations for backend developers.

CachingDistributed SystemsJava
0 likes · 9 min read
Service Rate Limiting, Degradation, and Caching Strategies for High‑Concurrency E‑commerce Interfaces
Top Architect
Top Architect
Nov 26, 2022 · Backend Development

Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Features, and Best Practices

This article provides an in-depth comparison of RabbitMQ, RocketMQ, and Kafka, detailing their core components, exchange types, message durability, acknowledgment mechanisms, TTL, dead‑letter queues, load balancing, ordering, transaction handling, high‑availability configurations, and practical solutions for common messaging challenges.

Distributed SystemsKafkaRabbitMQ
0 likes · 33 min read
Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Features, and Best Practices
Top Architect
Top Architect
Nov 25, 2022 · Backend Development

Comprehensive Guide to RocketMQ Message Types, Production, and Consumption

This article provides an in‑depth tutorial on RocketMQ, covering normal, ordered, delayed, transactional, and batch messages, their production and consumption patterns, retry mechanisms, message filtering, and dead‑letter handling, complete with Java code examples for each scenario.

Backend DevelopmentDistributed SystemsJava
0 likes · 36 min read
Comprehensive Guide to RocketMQ Message Types, Production, and Consumption
21CTO
21CTO
Nov 22, 2022 · Fundamentals

Key Distributed System Techniques: Bloom Filter, Consistent Hashing, Quorum

This article explains fundamental distributed‑system mechanisms—including Bloom filters for space‑efficient membership tests, consistent hashing for scalable data placement, quorum requirements for operation safety, leader‑follower coordination, heartbeats, fencing, write‑ahead logging, log segmentation, high‑water marks, leases, gossip protocols, failure detection, split‑brain resolution, checksums, CAP and PACELC theorems, hinted handoff, read repair, and Merkle trees—providing a comprehensive overview for engineers.

ConsistencyDistributed SystemsScalability
0 likes · 13 min read
Key Distributed System Techniques: Bloom Filter, Consistent Hashing, Quorum
Selected Java Interview Questions
Selected Java Interview Questions
Nov 20, 2022 · Backend Development

Understanding Interface Idempotency and Implementation Strategies

This article explains what API idempotency is, why it is needed, which interfaces should be idempotent, and presents various implementation methods such as frontend interception, database unique indexes, optimistic and pessimistic locks, JVM locks, distributed locks, and token‑based approaches.

Distributed SystemsIdempotencyapi-design
0 likes · 10 min read
Understanding Interface Idempotency and Implementation Strategies
Tencent Cloud Developer
Tencent Cloud Developer
Nov 18, 2022 · Backend Development

Cache Consistency Strategies and Best Practices

The article explains how using a Redis cache can boost read performance but introduces consistency challenges, compares four cache‑aside write strategies, and recommends the reliable “update database then delete cache” approach combined with short expiration times and asynchronous message‑queue invalidation to keep data fresh.

ConsistencyDistributed SystemsMySQL
0 likes · 20 min read
Cache Consistency Strategies and Best Practices
21CTO
21CTO
Nov 17, 2022 · Operations

Mastering Load Balancing: Common Algorithms and Their Implementations

This article explains what load balancing technology is, reviews common load balancing algorithms such as Round Robin, Weighted Round Robin, Least Connections, and Consistent Hash, and demonstrates their implementations with code examples, while also covering extensions like service discovery, health checks, and slow start mechanisms.

AlgorithmsDistributed Systemshealth check
0 likes · 21 min read
Mastering Load Balancing: Common Algorithms and Their Implementations
NetEase Media Technology Team
NetEase Media Technology Team
Nov 17, 2022 · Backend Development

Design and Evolution of NetEase Advertising Engine Platform

NetEase’s advertising engine platform evolved from a monolithic, high‑concurrency system handling over a billion daily requests into a layered, distributed architecture that unifies indexing, billing, user‑tagging, and monitoring services, leverages Elasticsearch and custom extensions for fast retrieval, and plans further upgrades such as a custom retrieval kernel and Go‑based services.

Backend ArchitectureDistributed SystemsIndexing Service
0 likes · 21 min read
Design and Evolution of NetEase Advertising Engine Platform
Selected Java Interview Questions
Selected Java Interview Questions
Nov 15, 2022 · Backend Development

Comprehensive Guide to Rate Limiting: Concepts, Algorithms, and Implementation Strategies

This article explains the fundamental concepts of rate limiting, compares common algorithms such as token bucket, leaky bucket and sliding window, and details practical implementations using Nginx, Tomcat, Redis, Guava, and Sentinel for both single‑node and distributed backend systems.

Distributed SystemsRate Limitingalgorithm
0 likes · 17 min read
Comprehensive Guide to Rate Limiting: Concepts, Algorithms, and Implementation Strategies
Architect's Guide
Architect's Guide
Nov 15, 2022 · Backend Development

RocketMQ Message Types, Sending Modes, Ordering, Delayed, Transactional, Batch, Filtering, Retry and Dead‑Letter Queues

This article provides a comprehensive overview of RocketMQ messaging concepts—including synchronous, asynchronous and one‑way sending, ordered and delayed messages, transaction handling, batch processing, tag/SQL filtering, retry mechanisms, and dead‑letter queue management—accompanied by Java code examples for each scenario.

Distributed SystemsJavaMessage Queue
0 likes · 36 min read
RocketMQ Message Types, Sending Modes, Ordering, Delayed, Transactional, Batch, Filtering, Retry and Dead‑Letter Queues
Huolala Tech
Huolala Tech
Nov 11, 2022 · Big Data

How Huolala Boosted Offline Scheduling Performance: Strategies & Lessons

Huolala’s big‑data offline platform, built from scratch, faced escalating scheduling delays as task instances grew, prompting a series of short‑ and mid‑term optimizations—including zombie task cleanup, retention policies, memory caching, algorithmic tweaks, and high‑availability enhancements—to dramatically reduce dependency computation time and sustain million‑scale daily workloads.

Big DataDistributed Systemsoffline scheduling
0 likes · 12 min read
How Huolala Boosted Offline Scheduling Performance: Strategies & Lessons
21CTO
21CTO
Nov 9, 2022 · Operations

How Ctrip Handles Billions of Logs Daily: Real‑Time Monitoring, Clog, CAT & TSDB

This article details Ctrip’s large‑scale log monitoring architecture, covering the overall Overview, the Clog log system, the CAT tracing platform, and the internal TSDB solution, explaining how billions of logs are processed in real time with low latency, high reliability, and efficient querying.

Big DataDistributed SystemsLog Monitoring
0 likes · 12 min read
How Ctrip Handles Billions of Logs Daily: Real‑Time Monitoring, Clog, CAT & TSDB
dbaplus Community
dbaplus Community
Nov 3, 2022 · Big Data

Why Kafka Stores Data the Way It Does: A Deep Dive into Its Log Architecture

This article thoroughly examines Kafka's storage system, explaining why it uses sequential log writes combined with sparse indexing, how different log formats evolved, and the mechanisms for log retention and compaction that enable high‑throughput, fault‑tolerant streaming at massive scale.

Big DataDistributed SystemsKafka
0 likes · 22 min read
Why Kafka Stores Data the Way It Does: A Deep Dive into Its Log Architecture
Sohu Tech Products
Sohu Tech Products
Nov 2, 2022 · Fundamentals

Understanding ULID: Features, Specification, and Python Usage

This article explains ULID (Universally Unique Lexicographically Sortable Identifier), compares it with UUID, outlines its technical specifications, lists its advantages and typical application scenarios, and provides detailed Python examples for generating and manipulating ULIDs.

Distributed SystemsPythonULID
0 likes · 6 min read
Understanding ULID: Features, Specification, and Python Usage
ShiZhen AI
ShiZhen AI
Nov 2, 2022 · Operations

How to Quickly Scale Kafka Topic Replicas with Know Streaming

This guide explains how Know Streaming adds a non‑native Kafka feature that lets users batch‑scale replicas for one or multiple topics, customize target brokers, preview and edit the reassignment plan, and throttle the operation to minimize impact on the cluster.

Distributed SystemsKafkaKafka Operations
0 likes · 5 min read
How to Quickly Scale Kafka Topic Replicas with Know Streaming
IT Architects Alliance
IT Architects Alliance
Nov 2, 2022 · Databases

The Importance, Evolution, and Future Trends of Distributed Databases

This article examines why databases are foundational to modern IT, traces the historical development of distributed database technologies, compares various architectural approaches such as sharding middleware, shared‑storage and shared‑nothing designs, and discusses emerging trends like multi‑model, HTAP, cloud‑native, and open‑source ecosystems.

Cloud NativeDistributed SystemsHTAP
0 likes · 11 min read
The Importance, Evolution, and Future Trends of Distributed Databases
Sanyou's Java Diary
Sanyou's Java Diary
Oct 31, 2022 · Backend Development

Mastering the Spring Cloud Alibaba Microservice Ecosystem: From Nacos to XXL‑JOB

This article provides a comprehensive guide to building a microservice ecosystem with Spring Cloud Alibaba, covering essential modules such as service registration, load balancing, configuration, messaging, gateway, fault tolerance, distributed transactions, tracing, and task scheduling, and showing how to integrate them with practical code examples.

Distributed SystemsNacosSpring Boot
0 likes · 26 min read
Mastering the Spring Cloud Alibaba Microservice Ecosystem: From Nacos to XXL‑JOB
Top Architect
Top Architect
Oct 29, 2022 · Databases

Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization

This article provides a comprehensive overview of Elasticsearch, covering its underlying Lucene architecture, data types, cluster components, shard allocation, indexing mechanisms, storage strategies, and performance tuning tips for building scalable, near‑real‑time search solutions.

Distributed SystemsPerformance Optimizationindexing
0 likes · 35 min read
Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization
Architects' Tech Alliance
Architects' Tech Alliance
Oct 29, 2022 · Databases

Analysis of China's Distributed Database Market and Future Development Trends

This article examines the importance, definitions, classifications, and technological evolution of distributed databases in China, outlines major architecture routes such as sharding middleware, shared‑storage and decentralized models, discusses HTAP and cloud‑native trends, and summarizes future directions including open‑source ecosystems and industry support.

Cloud NativeDistributed SystemsHTAP
0 likes · 10 min read
Analysis of China's Distributed Database Market and Future Development Trends
DataFunTalk
DataFunTalk
Oct 28, 2022 · Big Data

Angel Graph: A High‑Performance Distributed Graph Computing Framework for Intelligent Risk Control

Angel Graph is a high‑performance, fault‑tolerant distributed graph computing framework developed by Tencent, featuring scalable node‑metric, community‑detection, and graph‑neural‑network algorithms optimized for billion‑node, trillion‑edge datasets, and demonstrated through practical applications in intelligent financial risk control.

Distributed Systemscommunity-detectiongraph computing
0 likes · 20 min read
Angel Graph: A High‑Performance Distributed Graph Computing Framework for Intelligent Risk Control
Architect's Guide
Architect's Guide
Oct 27, 2022 · Big Data

Elasticsearch Overview: Data Types, Lucene Foundations, Core Concepts, Cluster Architecture, Indexing, Storage, and Performance Optimization

This article provides a comprehensive introduction to Elasticsearch, covering the distinction between structured and unstructured data, Lucene’s inverted index, ES core concepts such as clusters, nodes, shards and replicas, mapping, basic usage, storage mechanisms, and practical performance‑tuning tips for large‑scale search deployments.

Distributed SystemsElasticsearchPerformance Optimization
0 likes · 39 min read
Elasticsearch Overview: Data Types, Lucene Foundations, Core Concepts, Cluster Architecture, Indexing, Storage, and Performance Optimization
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 26, 2022 · Backend Development

DolphinScheduler Design, Architecture, and Source Code Analysis

This article provides a comprehensive overview of DolphinScheduler’s design strategies, distributed architecture, fault‑tolerance mechanisms, configuration files, core APIs, Quartz integration, master‑worker execution flow, RPC communication, load‑balancing algorithms, and logging services, accompanied by detailed code excerpts and diagrams.

Backend DevelopmentDistributed SystemsDolphinScheduler
0 likes · 46 min read
DolphinScheduler Design, Architecture, and Source Code Analysis
Top Architect
Top Architect
Oct 22, 2022 · Backend Development

Comprehensive Guide to Microservice Architecture, Spring Cloud, Dubbo, and Related Backend Practices

This article provides an in‑depth overview of microservice architecture, covering concepts such as RPC frameworks, serialization, CAP/BASE theories, distributed transactions, monitoring, high availability, load balancing, service registration, Dubbo fault‑tolerance strategies, Spring Boot vs MVC differences, core Spring annotations, and auto‑configuration mechanisms.

Backend ArchitectureDistributed SystemsDubbo
0 likes · 38 min read
Comprehensive Guide to Microservice Architecture, Spring Cloud, Dubbo, and Related Backend Practices
Top Architect
Top Architect
Oct 21, 2022 · Backend Development

From Monolithic to Distributed Architecture: A Detailed Inventory System Case Study

This article explains the concepts of software architecture, compares monolithic and distributed styles, and walks through a real‑world inventory system migration—including functional and business splitting, CQRS adoption, and distributed transaction challenges—illustrated with Java code examples.

CQRSDistributed SystemsJava
0 likes · 17 min read
From Monolithic to Distributed Architecture: A Detailed Inventory System Case Study
Architect's Tech Stack
Architect's Tech Stack
Oct 20, 2022 · Fundamentals

Understanding ULID: A Better Alternative to UUID

ULID (Universally Unique Lexicographically Sortable Identifier) combines a millisecond-precision timestamp with high-entropy randomness to produce 128‑bit, URL‑safe, lexicographically sortable IDs that avoid UUID’s collision risks, offering advantages such as monotonic ordering, compact Base32 encoding, and suitability for distributed database primary keys.

Distributed SystemsPythonULID
0 likes · 8 min read
Understanding ULID: A Better Alternative to UUID
Architecture & Thinking
Architecture & Thinking
Oct 17, 2022 · Backend Development

Understanding RocketMQ’s Network Communication Architecture and Protocol

This article explains RocketMQ’s core components, the rocketmq‑remoting module, its Netty‑based protocol design, message structure, communication flow, and the Reactor multi‑thread model that together ensure high‑performance, reliable messaging in distributed backend systems.

Backend DevelopmentDistributed SystemsMessage Queue
0 likes · 11 min read
Understanding RocketMQ’s Network Communication Architecture and Protocol
Top Architect
Top Architect
Oct 16, 2022 · Backend Development

Common Load Balancing Algorithms and Their Java Implementations

This article provides a comprehensive overview of various load balancing strategies—including round‑robin, random, weighted, smooth weighted round‑robin, consistent hashing, least‑active, and optimal‑response algorithms—explaining their principles, advantages, disadvantages, use‑cases, and offering complete Java code examples for each.

Distributed Systemsalgorithmbackend
0 likes · 33 min read
Common Load Balancing Algorithms and Their Java Implementations
Laravel Tech Community
Laravel Tech Community
Oct 13, 2022 · Backend Development

Designing a Scalable Backend for a Nationwide ID Query Service

The article outlines a simple yet scalable backend architecture that can handle 20 million daily ID queries by partitioning a billion‑record dataset across multiple 16 GB virtual machines, using direct‑index lookups, modest bandwidth, and basic redundancy mechanisms to achieve ample performance headroom.

Distributed SystemsScalabilityredundancy
0 likes · 6 min read
Designing a Scalable Backend for a Nationwide ID Query Service
Programmer DD
Programmer DD
Oct 12, 2022 · Backend Development

From Monolith to Distributed: How We Transformed a Stock System with CQRS

This article explains what software architecture is, why choosing an architectural style matters, compares monolithic and distributed approaches using a real‑world inventory system case study, and details the step‑by‑step functional and business splitting, CQRS implementation, code refactoring, and handling of distributed transactions.

CQRSDistributed SystemsSoftware Architecture
0 likes · 20 min read
From Monolith to Distributed: How We Transformed a Stock System with CQRS
IT Architects Alliance
IT Architects Alliance
Oct 9, 2022 · Backend Development

Event‑Driven Messaging Patterns at Wix: Consumption, Projection, End‑to‑End Streaming, In‑Memory KV Stores, Scheduling, Transactions, and Aggregation

The article describes how Wix engineers built a robust, Kafka‑based event‑driven messaging infrastructure for over 1,400 microservices, detailing patterns such as consumption and projection, end‑to‑end streaming with websockets, in‑memory KV stores, schedule‑and‑forget jobs, exactly‑once transactions, and event aggregation to achieve scalability, resilience, and low‑latency data access.

Data StreamingDistributed SystemsEvent-Driven Architecture
0 likes · 16 min read
Event‑Driven Messaging Patterns at Wix: Consumption, Projection, End‑to‑End Streaming, In‑Memory KV Stores, Scheduling, Transactions, and Aggregation
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 29, 2022 · Backend Development

Scaling Event‑Driven Messaging at Wix with Kafka: Key Patterns

This article explains how Wix uses Kafka‑based event‑driven messaging to decouple microservices, improve scalability, and achieve exactly‑once processing through patterns such as consume‑and‑project, end‑to‑end event streams, in‑memory KV stores, scheduled jobs, transactional events, and event aggregation.

Data StreamingDistributed SystemsEvent-Driven Architecture
0 likes · 16 min read
Scaling Event‑Driven Messaging at Wix with Kafka: Key Patterns
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 27, 2022 · Big Data

How JindoData Transforms Data Lake Storage for the Big Data Era

This article reviews Sun DaPeng's presentation on Alibaba Cloud's open‑source big data platform, covering the rapid growth of data, the evolution of storage architectures from HDFS to cloud‑native data lakes, and the detailed JindoData solution—including JindoFS, JindoFSx, and JindoSDK—that delivers high‑performance, cost‑effective storage for modern analytics workloads.

Distributed SystemsJindoDatacloud
0 likes · 16 min read
How JindoData Transforms Data Lake Storage for the Big Data Era
vivo Internet Technology
vivo Internet Technology
Sep 21, 2022 · Backend Development

Dubbo Generic Invocation: Project Practice and Principle Analysis

By applying Dubbo's GenericService $invoke method, the vivo project replaced tightly‑coupled direct API calls with a unified remote‑call layer that eliminates third‑party JAR dependencies, reduces system coupling, and leverages Dubbo’s internal proxy‑exporter mechanisms to dynamically invoke diverse external services.

Distributed SystemsDubboGeneric Invocation
0 likes · 23 min read
Dubbo Generic Invocation: Project Practice and Principle Analysis
Baidu Geek Talk
Baidu Geek Talk
Sep 21, 2022 · Industry Insights

How Baidu’s Transaction Middle‑Platform Asset System Enables C2C Payments and Guarantees Consistency

This article details the design and implementation of Baidu's transaction middle‑platform asset system, covering its C2C payment model, core asset management capabilities, consistency guarantees, double‑entry accounting, hot‑account handling, sharding and archiving strategies, and compliance with national financial regulations.

C2C paymentsConsistencyDistributed Systems
0 likes · 15 min read
How Baidu’s Transaction Middle‑Platform Asset System Enables C2C Payments and Guarantees Consistency
Dada Group Technology
Dada Group Technology
Sep 19, 2022 · Backend Development

How to Build a Real‑Time Inventory Sync System that Eliminates Overselling

This article analyzes the challenges of real‑time inventory synchronization for omnichannel retail—such as sync latency, concurrent overselling, and shared stock calculation—and presents a comprehensive backend architecture featuring low‑latency syncing, dynamic throttling, safety‑stock algorithms, and a scalable calculation engine.

Backend ArchitectureDistributed SystemsSynchronization
0 likes · 11 min read
How to Build a Real‑Time Inventory Sync System that Eliminates Overselling
Architect's Guide
Architect's Guide
Sep 17, 2022 · Backend Development

An Introduction to Microservice Architecture: Concepts, Evolution, Comparison with Monolithic, Design Patterns, and Pros & Cons

This article provides a comprehensive overview of microservice architecture, covering its definition, history, differences from monolithic development, key characteristics, comparison with SOA, practical implementation steps, common design patterns, advantages, disadvantages, and essential considerations for successful adoption.

DevOpsDistributed Systemsapi-gateway
0 likes · 20 min read
An Introduction to Microservice Architecture: Concepts, Evolution, Comparison with Monolithic, Design Patterns, and Pros & Cons
Qingyun Technology Community
Qingyun Technology Community
Sep 15, 2022 · Cloud Computing

How GPU, VPU, and CPU Accelerate Cloud Video Transcoding: Architecture and Best Practices

This article explores the rapid growth of video traffic, explains why transcoding is essential, compares CPU, GPU, and VPU hardware for video processing, details the FFmpeg software stack, describes the design of a cloud‑native transcoding cluster, its scheduling, shard‑transcoding technique, and presents performance test results.

Cloud ComputingDistributed SystemsFFmpeg
0 likes · 23 min read
How GPU, VPU, and CPU Accelerate Cloud Video Transcoding: Architecture and Best Practices
Practical DevOps Architecture
Practical DevOps Architecture
Sep 15, 2022 · Cloud Native

Brief Overview of etcd and Kubernetes: Features, Use Cases, and Core Components

This article provides a concise overview of etcd and Kubernetes, detailing etcd’s features and use‑cases, explaining Kubernetes fundamentals, its relationship with Docker, and describing key components such as Minikube, Kubectl, Kubelet, common deployment methods, and the platform’s cluster management architecture.

Cloud NativeDistributed Systemsetcd
0 likes · 6 min read
Brief Overview of etcd and Kubernetes: Features, Use Cases, and Core Components
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 13, 2022 · Backend Development

Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared

This article examines common business scenarios that require timed execution, explains why scheduled tasks are essential, compares standalone and distributed Java scheduling frameworks—including Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, Elastic-Job, Saturn, and XXL-Job—and provides guidance on selecting the most suitable solution based on scalability, reliability, and operational needs.

Backend DevelopmentDistributed SystemsJava
0 likes · 14 min read
Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared
phodal
phodal
Sep 12, 2022 · Backend Development

How Feakin Builds Real‑Time Collaborative Editing with WebSockets, CRDTs, and Rust

This article analyzes Feakin's approach to online collaborative diagram editing, covering communication protocols, data formats, the trade‑offs between centralized OT and decentralized CRDT algorithms, and the Rust‑based server and client implementation using Actix, WebSocket, and WebAssembly.

ActixCRDTDistributed Systems
0 likes · 13 min read
How Feakin Builds Real‑Time Collaborative Editing with WebSockets, CRDTs, and Rust
Java Captain
Java Captain
Sep 10, 2022 · Backend Development

Designing a Scalable Backend for One Billion Users with Minimal Resources

The article outlines how a modest cluster of 20 virtual machines with 16 GB RAM each can handle 1 billion user records and 20 million hourly queries by using simple in‑memory arrays, basic indexing, modest bandwidth, and straightforward failover mechanisms, without requiring advanced technologies.

Distributed SystemsMemory Optimization
0 likes · 7 min read
Designing a Scalable Backend for One Billion Users with Minimal Resources
IT Architects Alliance
IT Architects Alliance
Sep 8, 2022 · Backend Development

Evolution of a Simple MVP Monolithic Architecture to a Complex Distributed System: A Taobao Case Study

This article uses a simulated Taobao example to illustrate how a simple MVP monolithic architecture evolves through ten stages—from separating Tomcat and database to adopting caching, load balancing, database sharding, microservices, ESB, containerization, and cloud platforms—highlighting the technologies and design principles involved in each transition.

Distributed SystemsScalabilityarchitecture
0 likes · 20 min read
Evolution of a Simple MVP Monolithic Architecture to a Complex Distributed System: A Taobao Case Study
macrozheng
macrozheng
Sep 8, 2022 · Backend Development

Why Do Payment Orders Disappear? Causes and Prevention Strategies for E‑Commerce

The article explains why e‑commerce users sometimes see their payments completed in the wallet but the order remains unpaid, analyzes internal and external drop‑order scenarios, and provides practical server‑side, client‑side, and active‑query techniques—including scheduled tasks and delayed‑message queues—to prevent such issues.

Distributed SystemsMessage Queueactive query
0 likes · 13 min read
Why Do Payment Orders Disappear? Causes and Prevention Strategies for E‑Commerce
Tencent Cloud Developer
Tencent Cloud Developer
Sep 6, 2022 · Backend Development

Understanding Rate Limiting in Distributed Systems: Algorithms and Best Practices

Rate limiting safeguards distributed systems by controlling request rates through algorithms such as leaky bucket, token bucket, fixed and sliding windows, and back pressure, while client‑side tactics like exponential backoff, jitter, and careful retries, and requires atomic distributed storage solutions (e.g., Redis+Lua) to avoid race conditions.

Back-pressureDistributed SystemsRate Limiting
0 likes · 16 min read
Understanding Rate Limiting in Distributed Systems: Algorithms and Best Practices
JavaEdge
JavaEdge
Sep 3, 2022 · Backend Development

How to Ensure Idempotent Order Creation and Prevent ABA Issues in Distributed Systems

This article explains why order creation and payment APIs must be idempotent, outlines practical techniques such as unique request IDs, database unique constraints, Redis flags, and version‑based optimistic locking to avoid duplicate orders and solve the ABA problem in distributed environments.

ABA problemDistributed SystemsIdempotency
0 likes · 9 min read
How to Ensure Idempotent Order Creation and Prevent ABA Issues in Distributed Systems
ByteDance Cloud Native
ByteDance Cloud Native
Sep 2, 2022 · Big Data

How ByteDance’s Cloud Shuffle Service Boosts Big Data Job Stability and Performance

ByteDance’s Cloud Shuffle Service (CSS) replaces the traditional Pull‑Based Sort Shuffle in Spark, FlinkBatch and MapReduce with a Push‑Based remote shuffle that improves stability, performance and elasticity, supports compute‑storage separation, and delivers significant speedups in large‑scale TPC‑DS benchmarks.

Distributed SystemsPerformance OptimizationRemote Shuffle
0 likes · 11 min read
How ByteDance’s Cloud Shuffle Service Boosts Big Data Job Stability and Performance
IT Architects Alliance
IT Architects Alliance
Sep 2, 2022 · Fundamentals

Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More

This article introduces essential distributed‑system concepts—including Bloom filters, consistent hashing, quorum, leader/follower roles, heartbeats, fencing, WAL, segment logs, high‑water marks, leases, gossip protocol, Phi failure detection, CAP and PACELC theorems, hinted handoff, read repair, and Merkle trees—explaining their purpose and how they are applied in systems such as BigTable, Cassandra, Dynamo, and Kafka.

CAP theoremDistributed SystemsMerkle Tree
0 likes · 12 min read
Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More
Top Architect
Top Architect
Sep 1, 2022 · Backend Development

Ensuring Zero Message Loss in MQ Systems – Interview Guide and Best Practices

This article explains how to guarantee that messages are never lost when using MQ middleware such as Kafka, RabbitMQ or RocketMQ, covering the three lifecycle stages, detection methods, design‑for‑failure principles, idempotent consumption, handling message backlog, and practical interview answers.

Distributed SystemsInterview preparationMQ
0 likes · 13 min read
Ensuring Zero Message Loss in MQ Systems – Interview Guide and Best Practices
Architecture Digest
Architecture Digest
Aug 31, 2022 · Backend Development

Implementing a Reliable Delay Queue with Redis and Go

This article explains how to build a reliable delayed message queue using Redis, covering business scenarios, requirements such as persistence and retry, the design of Redis data structures, Lua scripts for atomic operations, and a Go implementation with example code for producing and consuming delayed tasks.

Distributed SystemsGoLua
0 likes · 13 min read
Implementing a Reliable Delay Queue with Redis and Go
Top Architect
Top Architect
Aug 30, 2022 · Fundamentals

Key Distributed System Design Patterns and Concepts

This article explains essential distributed‑system design patterns such as Bloom filters, consistent hashing, quorum, leader‑follower replication, heartbeats, fencing, write‑ahead logs, segment logs, high‑water marks, leases, CAP and PACELC theorems, hinted handoff, read‑repair, Merkle trees, and related failure‑detection mechanisms, illustrating how they improve scalability, consistency and fault tolerance.

CAP theoremConsistencyDistributed Systems
0 likes · 12 min read
Key Distributed System Design Patterns and Concepts
Xingsheng Youxuan Technology Community
Xingsheng Youxuan Technology Community
Aug 30, 2022 · Big Data

How to Build a Unified Big Data Security Platform with Ranger and Custom Authorization

This article explains the design and implementation of a unified data security control platform that protects user privacy and corporate data across multiple big‑data components (Hive, Hetu, GaussDB) by integrating Apache Ranger, custom authorization APIs, asynchronous processing, distributed locking, and SDK‑based authentication to achieve fine‑grained, one‑stop permission management.

Access ControlAuthorizationBig Data
0 likes · 17 min read
How to Build a Unified Big Data Security Platform with Ranger and Custom Authorization
MaGe Linux Operations
MaGe Linux Operations
Aug 28, 2022 · Cloud Native

Master MinIO: From Client Commands to Scalable Distributed Clusters

This guide walks through MinIO client (mc) usage, bucket management, user and policy administration, and two practical methods for expanding a MinIO distributed cluster—peer‑to‑peer scaling and federation with etcd—providing step‑by‑step commands, scripts, and configuration details for cloud‑native object storage.

Distributed SystemsMinioObject Storage
0 likes · 31 min read
Master MinIO: From Client Commands to Scalable Distributed Clusters
Code Ape Tech Column
Code Ape Tech Column
Aug 26, 2022 · Fundamentals

Understanding the Raft Consensus Algorithm: Roles, Elections, Log Replication, and Split‑Brain Scenarios

This article explains the Raft consensus algorithm in detail, covering its three node roles, leader election process, state‑machine log replication, handling of leader failures, multiple candidates, and split‑brain situations, providing clear diagrams and step‑by‑step descriptions for distributed system fundamentals.

Consensus AlgorithmDistributed SystemsLog Replication
0 likes · 16 min read
Understanding the Raft Consensus Algorithm: Roles, Elections, Log Replication, and Split‑Brain Scenarios
Meituan Technology Team
Meituan Technology Team
Aug 25, 2022 · Databases

Transactions, Consistency, and Consensus in Distributed Systems

This article explains how transactions, consistency, and consensus interrelate in distributed systems, reviews replication models, details ACID properties, internal consistency models, consensus algorithms, and Kafka’s configuration and transaction support, and highlights verification tools like TLA+ and Jepsen for ensuring correctness.

ACIDConsensusConsistency
0 likes · 46 min read
Transactions, Consistency, and Consensus in Distributed Systems
Meituan Technology Team
Meituan Technology Team
Aug 25, 2022 · Databases

Data Replication in Distributed Systems – Part 1: Models, Challenges, and Design Considerations

The article surveys three data‑replication models—master‑slave, multi‑master, and leaderless—explains how they enable scalability and fault‑tolerance, and examines core distributed‑system challenges such as partial node failures, unreliable networks, and unsynchronized clocks, while stressing safety‑liveness trade‑offs and design techniques like quorum and timeouts.

ConsistencyDistributed SystemsKafka
0 likes · 37 min read
Data Replication in Distributed Systems – Part 1: Models, Challenges, and Design Considerations
Selected Java Interview Questions
Selected Java Interview Questions
Aug 24, 2022 · Backend Development

Understanding ElasticSearch: Distributed Search, Full‑Text Retrieval, and Inverted Index

This article explains what search is, why traditional databases struggle with full‑text queries, introduces the concepts of inverted indexes and Lucene, and shows how ElasticSearch combines distributed architecture, real‑time analytics, and powerful search features to solve these problems.

Distributed SystemsFull-Text Searchinverted index
0 likes · 8 min read
Understanding ElasticSearch: Distributed Search, Full‑Text Retrieval, and Inverted Index
21CTO
21CTO
Aug 23, 2022 · Cloud Native

How RocketMQ Evolved into a Cloud‑Native Super‑Fusion Messaging Platform

This article traces RocketMQ's transformation from a traditional message queue to a cloud‑native, ultra‑fusion platform that integrates messaging, event‑driven architecture, and streaming, highlighting its historical stages, architectural upgrades, multi‑language SDKs, stateless consumption, and future cloud‑native trends.

Cloud NativeDistributed SystemsEvent-Driven Architecture
0 likes · 22 min read
How RocketMQ Evolved into a Cloud‑Native Super‑Fusion Messaging Platform
IT Architects Alliance
IT Architects Alliance
Aug 21, 2022 · Backend Development

How to Build a Scalable Delayed Queue with Redis and Java

This article explains why delayed queues are needed for scenarios like unpaid orders or auto‑generated comments, compares built‑in and third‑party solutions, and provides a detailed design and implementation guide for a Redis‑based delayed‑queue service, including version‑1.0 features, version‑2.0 optimizations, and multi‑node deployment.

Distributed SystemsJavaMessage Queue
0 likes · 9 min read
How to Build a Scalable Delayed Queue with Redis and Java
Tencent Cloud Developer
Tencent Cloud Developer
Aug 19, 2022 · Backend Development

Message Queue Basics, Use Cases, and Selection Guide for Kafka, RabbitMQ, Pulsar, and RocketMQ

The article explains fundamental concepts, common use cases, and selection criteria for four popular message‑queue platforms—Kafka, RabbitMQ, Pulsar, and RocketMQ—detailing each system’s architecture, strengths, and drawbacks so readers can match workload, scalability, ordering, latency, and operational needs to the most suitable middleware.

Distributed SystemsKafkaMessage Queue
0 likes · 16 min read
Message Queue Basics, Use Cases, and Selection Guide for Kafka, RabbitMQ, Pulsar, and RocketMQ
IT Architects Alliance
IT Architects Alliance
Aug 19, 2022 · Backend Development

Comprehensive Guide to Microservices Architecture, Spring Cloud, Dubbo, and Distributed System Practices

This article provides an in‑depth overview of microservice concepts, RPC frameworks, serialization methods, distributed transaction models, CAP and BASE theories, monitoring solutions, high‑availability strategies, load‑balancing techniques, configuration management, service registration/discovery, and Dubbo fault‑tolerance clusters, offering practical examples and code snippets for Java‑based cloud native systems.

Distributed SystemsDubboRPC
0 likes · 37 min read
Comprehensive Guide to Microservices Architecture, Spring Cloud, Dubbo, and Distributed System Practices
21CTO
21CTO
Aug 18, 2022 · Cloud Native

Why Go (Golang) Is the Go‑To Language for Cloud‑Native Development

This article explores Go's concise design, strong concurrency model, fast compilation, static binaries, and broad ecosystem, highlighting its ideal fit for cloud‑native applications, distributed services, and command‑line tools while also addressing its limitations and future direction.

Cloud NativeConcurrencyDistributed Systems
0 likes · 12 min read
Why Go (Golang) Is the Go‑To Language for Cloud‑Native Development
dbaplus Community
dbaplus Community
Aug 17, 2022 · Databases

How RedKV Achieves Billion‑QPS KV Storage with Multi‑Cloud Elastic Scaling

RedKV is Xiaohongshu's self‑developed NVMe‑SSD based distributed NoSQL KV store that combines Gossip and Shard control, delivering petabyte‑scale storage, near‑100 million QPS, multi‑cloud elasticity, low‑cost Redis compatibility, and advanced features such as token‑bucket rate limiting, online compression, backup‑read tail‑latency mitigation, and robust backup‑recovery mechanisms.

Distributed SystemsKV StoreNoSQL
0 likes · 24 min read
How RedKV Achieves Billion‑QPS KV Storage with Multi‑Cloud Elastic Scaling
Selected Java Interview Questions
Selected Java Interview Questions
Aug 17, 2022 · Backend Development

Microservice Architecture and Its Most Important Design Patterns

This article explains the evolution of software complexity, introduces microservice architecture as a modern solution, and details ten essential design patterns—including database per service, event sourcing, CQRS, Saga, BFF, API gateway, Strangler, circuit breaker, externalized configuration, and consumer‑driven contract testing—while outlining their advantages, disadvantages, and appropriate usage scenarios.

Distributed Systemsarchitecturebackend
0 likes · 22 min read
Microservice Architecture and Its Most Important Design Patterns
DaTaobao Tech
DaTaobao Tech
Aug 15, 2022 · Cloud Native

Reflections on CAP Theory, ACID, BASE, and Cloud‑Native Fault Tolerance

Reflecting on reading, the author reviews CAP theory’s consistency‑availability‑partition trade‑offs, extends ACID and BASE concepts, proposes modernizing CAP objects to consistency, fault and disaster tolerance, and examines how cloud‑native architectures, micro‑services, and SLA‑driven designs reshape fault tolerance and future self‑healing systems.

ACIDBASECAP theorem
0 likes · 21 min read
Reflections on CAP Theory, ACID, BASE, and Cloud‑Native Fault Tolerance
Top Architect
Top Architect
Aug 12, 2022 · Operations

Key Distributed System Design Patterns Explained by a Senior Architect

This article presents a concise overview of essential distributed‑system design patterns—including Bloom filters, consistent hashing, quorum, leader/follower, heartbeat, fencing, high‑water mark, leases, gossip protocol, PACELC theorem, hinted handoff, read‑repair, and Merkle trees—explaining their purpose, operation, and typical usage in large‑scale storage and coordination services.

ConsistencyDistributed Systemsarchitecture
0 likes · 15 min read
Key Distributed System Design Patterns Explained by a Senior Architect
IT Architects Alliance
IT Architects Alliance
Aug 11, 2022 · Fundamentals

Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More

This article introduces essential distributed‑system mechanisms—including Bloom filters, consistent hashing, quorum, leader/follower roles, heartbeats, fencing, write‑ahead logs, segment logs, high‑water marks, leases, gossip protocols, failure detection, CAP/PACELC theorems, hinted handoff, read‑repair, and Merkle trees—to help engineers design scalable and fault‑tolerant services.

CAP theoremConsistencyData Structures
0 likes · 12 min read
Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More
Ctrip Technology
Ctrip Technology
Aug 11, 2022 · Databases

Design and Implementation of Ctrip's Data Replicate Center (DRC) for Database Cloud Migration

This article details Ctrip's Data Replicate Center (DRC) architecture, challenges, and solutions for migrating MySQL databases to the cloud, covering read‑only and read‑write scenarios, cost analysis, proxy modules, transaction‑table replication, data isolation, filtering, deployment workflow, and achieved performance and cost benefits.

CtripDRCDistributed Systems
0 likes · 16 min read
Design and Implementation of Ctrip's Data Replicate Center (DRC) for Database Cloud Migration
DataFunTalk
DataFunTalk
Aug 9, 2022 · Databases

Graph Database Storage Technologies and Practices: Concepts, Core Goals, Technical Solutions, and Galaxybase Case Study

This article introduces graph database fundamentals, explains why graph databases are needed, outlines core storage goals such as index‑free adjacency, compares array, linked‑list and LSM‑tree storage schemes, and presents the design, performance advantages, and real‑world applications of the Galaxybase distributed graph database.

Big DataDistributed SystemsGalaxybase
0 likes · 20 min read
Graph Database Storage Technologies and Practices: Concepts, Core Goals, Technical Solutions, and Galaxybase Case Study
Selected Java Interview Questions
Selected Java Interview Questions
Aug 5, 2022 · Backend Development

Understanding Interface Call Idempotency and Practical Solutions for Backend Systems

The article explains the concept of interface call idempotency in distributed micro‑service architectures, outlines scenarios that cause idempotency problems, and presents practical solutions such as token mechanisms, various lock strategies, unique constraints, deduplication tables, and global request IDs, with code examples in Java and Redis.

Distributed SystemsJavaLocks
0 likes · 13 min read
Understanding Interface Call Idempotency and Practical Solutions for Backend Systems
Sohu Tech Products
Sohu Tech Products
Aug 3, 2022 · Fundamentals

Common Message Queues: RabbitMQ, RocketMQ, and Kafka – Components, Features, and Best Practices

This article introduces the core concepts, components, exchange types, reliability mechanisms, ordering, delay, transaction, high‑availability, and load‑balancing strategies of three popular message‑queue systems—RabbitMQ, RocketMQ, and Kafka—while also discussing common challenges such as message ordering, delayed consumption, reliability, idempotence, and backlog handling.

Distributed SystemsKafkaMessage Queue
0 likes · 33 min read
Common Message Queues: RabbitMQ, RocketMQ, and Kafka – Components, Features, and Best Practices
政采云技术
政采云技术
Aug 2, 2022 · Fundamentals

Understanding the Chandy‑Lamport Distributed Snapshot Algorithm

This article explains the Chandy‑Lamport algorithm for capturing consistent global snapshots in distributed systems, describes its assumptions and message‑marker rules, walks through a detailed example with three processes and channels, and relates it to Apache Flink's asynchronous checkpoint mechanism.

Apache FlinkChandy-LamportDistributed Systems
0 likes · 14 min read
Understanding the Chandy‑Lamport Distributed Snapshot Algorithm
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Aug 2, 2022 · Backend Development

How Nacos’s Distro Protocol Ensures High‑Availability Consistency

This article explains the design, six mechanisms, and source‑code flow of Nacos’s Distro protocol, showing how asynchronous replication, periodic sync, new‑node loading, and local reads together provide AP‑style high availability and eventual consistency for service registration.

APConsistencyDistributed Systems
0 likes · 15 min read
How Nacos’s Distro Protocol Ensures High‑Availability Consistency
MaGe Linux Operations
MaGe Linux Operations
Jul 31, 2022 · Backend Development

Mastering Message Queues: Key Concepts of RabbitMQ, RocketMQ, and Kafka

This article provides a comprehensive overview of modern message‑queue systems, detailing RabbitMQ components and exchange types, RocketMQ’s core architecture and high‑availability features, and Kafka’s fundamental concepts, controller mechanisms, and consumer rebalance strategies, while also covering reliability, ordering, and dead‑letter handling techniques.

Distributed SystemsKafkaMessage Queue
0 likes · 31 min read
Mastering Message Queues: Key Concepts of RabbitMQ, RocketMQ, and Kafka
DataFunTalk
DataFunTalk
Jul 31, 2022 · Big Data

Design, Evolution, and Optimization of NetEase's Log Collection and Transmission Service (Datastream‑NG)

This article presents a comprehensive overview of NetEase's log collection and transmission platform, detailing its evolution from 2011 to the current Datastream‑NG architecture, the system's design goals, core component optimizations, operational monitoring, and future plans for intelligent scaling and diagnostics.

Big DataCloud NativeData Streaming
0 likes · 23 min read
Design, Evolution, and Optimization of NetEase's Log Collection and Transmission Service (Datastream‑NG)
Su San Talks Tech
Su San Talks Tech
Jul 31, 2022 · Fundamentals

Mastering Message Queues: Core Concepts of RabbitMQ, RocketMQ, and Kafka

This article explains the fundamental components and mechanisms of RabbitMQ, RocketMQ, and Kafka—including exchanges, TTL, confirm and return listeners, consumer ACK/NACK, dead‑letter queues, delay and ordered messages, transactional flows, high‑availability setups, load balancing, partitioning, leader election, offset handling, and practical solutions to common messaging challenges.

Distributed SystemsKafkaMessage Queue
0 likes · 31 min read
Mastering Message Queues: Core Concepts of RabbitMQ, RocketMQ, and Kafka
Top Architect
Top Architect
Jul 31, 2022 · Backend Development

Design and Implementation of Delayed Message Queues in Distributed Systems

This article surveys common delayed‑message solutions in distributed asynchronous messaging, evaluates implementations based on external storage, databases, RocksDB, Redis, and open‑source MQs like RocketMQ, Pulsar and QMQ, and discusses their advantages, drawbacks, and practical design considerations.

Delayed MessagingDistributed SystemsPulsar
0 likes · 13 min read
Design and Implementation of Delayed Message Queues in Distributed Systems
Top Architect
Top Architect
Jul 30, 2022 · Backend Development

Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Components, and Best Practices

This article provides an in‑depth technical guide to three major message‑queue systems—RabbitMQ, RocketMQ, and Kafka—covering their core components, exchange and routing mechanisms, durability features, consumer acknowledgment, dead‑letter handling, load balancing, and practical strategies for reliability, ordering, and scaling in distributed backend applications.

Distributed SystemsMessagingRabbitMQ
0 likes · 29 min read
Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Components, and Best Practices
vivo Internet Technology
vivo Internet Technology
Jul 27, 2022 · Operations

Building and Migrating to RocketMQ-based Message Middleware Platform at vivo

vivo’s Internet Middleware Team replaced its RabbitMQ service with a RocketMQ‑based platform, building an AMQP‑Proxy gateway and metadata layer to enable seamless, zero‑downtime migration while achieving over 100,000 TPS, billion‑message capacity, 50% resource savings, and advanced features such as transactions, ordered and delayed messaging, and tracing.

Distributed SystemsMessage MiddlewareRabbitMQ Migration
0 likes · 12 min read
Building and Migrating to RocketMQ-based Message Middleware Platform at vivo