BestHub
Sign in
Tagged articles
2124 articles
Page 14 of 22
JD Tech Talk
JD Tech Talk
Nov 13, 2020 · Artificial Intelligence

Practical Engineering Guide to Federated Learning: Deployment, Training, and Inference

This article provides a comprehensive engineering overview of federated learning, covering its core distributed‑learning concept, Docker‑based deployment, detailed training‑service architecture with validation, scheduling, metadata, and model‑management components, as well as a complete inference framework and workflow for production use.

AI EngineeringDistributed Systemsdocker
0 likes · 12 min read
Practical Engineering Guide to Federated Learning: Deployment, Training, and Inference
Practical DevOps Architecture
Practical DevOps Architecture
Nov 10, 2020 · Databases

Design of Ant Financial's Logical Data Center (LDC) and Unitization for High‑TPS Payments

The article explains how Ant Financial’s Logical Data Center (LDC) and unit‑based architecture, combined with sharding, CAP analysis, and OceanBase’s Paxos‑based consensus, enable the payment platform to sustain tens of millions of transactions per second during Double‑11 events while ensuring high availability and disaster recovery.

CAP theoremDistributed SystemsHigh TPS
0 likes · 42 min read
Design of Ant Financial's Logical Data Center (LDC) and Unitization for High‑TPS Payments
IT Architects Alliance
IT Architects Alliance
Nov 5, 2020 · Industry Insights

How Do Massive Websites Scale? Key Architecture Patterns Unveiled

This article examines the defining traits of large‑scale web systems and walks through the step‑by‑step evolution of their architecture—from single‑server LAMP setups to multi‑layer, distributed, and automated designs—highlighting performance, availability, scalability, and security considerations.

CachingDistributed SystemsScalability
0 likes · 18 min read
How Do Massive Websites Scale? Key Architecture Patterns Unveiled
Programmer DD
Programmer DD
Nov 4, 2020 · Fundamentals

What Starbucks Can Teach Us About Asynchronous Messaging and Two‑Phase Commit

The article uses Starbucks' coffee‑ordering workflow as a real‑world analogy to explain asynchronous messaging patterns, correlation challenges, exception handling strategies, and why two‑phase commit can hinder scalability, illustrating how everyday processes inspire robust distributed system designs.

CompensationDistributed Systemsasynchronous messaging
0 likes · 8 min read
What Starbucks Can Teach Us About Asynchronous Messaging and Two‑Phase Commit
Architecture Digest
Architecture Digest
Nov 3, 2020 · Backend Development

Data Consistency in Microservices: Transaction Management and Implementation Patterns

This article introduces the limitations of traditional local and distributed transactions for microservices, explains the BASE theory, and details four practical patterns—reliable event notification, maximum‑effort notification, business compensation, and TCC—providing code examples, diagrams, and a comparative table to guide developers in achieving eventual consistency across microservice architectures.

BASE theoryData ConsistencyDistributed Systems
0 likes · 19 min read
Data Consistency in Microservices: Transaction Management and Implementation Patterns
Top Architect
Top Architect
Nov 2, 2020 · Backend Development

Evolution of Taobao Backend Architecture: From Single‑Server to Cloud‑Native Scalability

This article uses Taobao's backend as a case study to illustrate how a system evolves from a single‑machine deployment to a multi‑layer, highly available, cloud‑native architecture capable of handling millions of concurrent users, covering concepts such as distribution, load balancing, caching, database sharding, micro‑services, containerization, and cloud platforms.

BackendDistributed SystemsScalability
0 likes · 20 min read
Evolution of Taobao Backend Architecture: From Single‑Server to Cloud‑Native Scalability
High Availability Architecture
High Availability Architecture
Oct 27, 2020 · Fundamentals

Quorum in Distributed Systems: Concepts, Variants, and Impact on Availability and Latency

Quorum, the core principle behind majority read/write and Paxos, can be defined in various ways—including weighted, hierarchical, and non‑majority quorums—to trade off system availability, latency, and fault tolerance, with examples illustrating how different quorum designs affect performance in distributed storage and coordination services.

AvailabilityConsensusDistributed Systems
0 likes · 18 min read
Quorum in Distributed Systems: Concepts, Variants, and Impact on Availability and Latency
Architecture Digest
Architecture Digest
Oct 26, 2020 · Fundamentals

How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges

This article outlines why distributed systems are needed, explains how they address cost and high‑availability issues by coordinating cheap nodes, and discusses the new coordination challenges such as service discovery, load balancing, fault isolation, monitoring, data partitioning, replication, and distributed transactions, providing a roadmap for further study.

Distributed Systemsdata replication
0 likes · 11 min read
How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Oct 22, 2020 · Backend Development

Core Concepts and Architecture of RocketMQ

This article introduces RocketMQ’s core concepts, including its deployment architecture, naming server, broker and client roles, subscription model, consumption modes, queue allocation algorithms, rebalancing, offset storage, transaction and delayed messages, as well as filtering mechanisms, providing a solid foundation for further practice.

BackendDistributed SystemsMessage queue
0 likes · 13 min read
Core Concepts and Architecture of RocketMQ
Aikesheng Open Source Community
Aikesheng Open Source Community
Oct 16, 2020 · Databases

Impact of High Network Latency on MySQL Group Replication Performance

An experiment with a three‑node MySQL Group Replication (MGR) cluster shows that even when flow control is disabled, adding significant network latency to a single node reduces overall throughput, because MGR’s multi‑paxos protocol makes the delayed node a performance bottleneck during its turn as leader.

Distributed SystemsGroup ReplicationMulti-Paxos
0 likes · 4 min read
Impact of High Network Latency on MySQL Group Replication Performance
Architect
Architect
Oct 13, 2020 · Fundamentals

Distributed ID Generation Schemes and the rpcxio/did Service

This article reviews various ID generation methods—including UUID/GUID, auto‑increment integers, random numbers, Snowflake, and MongoDB ObjectID—explains their advantages and drawbacks, and introduces the rpcxio/did distributed ID service with performance benchmarks and deployment considerations.

Distributed SystemsID generationsnowflake
0 likes · 12 min read
Distributed ID Generation Schemes and the rpcxio/did Service
ITPUB
ITPUB
Oct 12, 2020 · Databases

Why ClickHouse Outperforms Other Databases: Core Features Unveiled

This article explains how ClickHouse’s column‑oriented storage, vectorized execution engine, rich DBMS capabilities, flexible table engines, and carefully designed distributed architecture enable it to handle massive workloads with sub‑second query latency, making it a standout OLAP solution.

ClickHouseColumnar DatabaseDistributed Systems
0 likes · 29 min read
Why ClickHouse Outperforms Other Databases: Core Features Unveiled
Tuhu Marketing Technology Team
Tuhu Marketing Technology Team
Oct 10, 2020 · Backend Development

Ensuring Idempotency in Distributed Systems: Strategies and Code Samples

This article explains the concept of idempotency, examines common failure scenarios such as duplicate order creation, coupon redemption, and inventory deduction, and presents practical solutions—including unique identifiers, locking, database constraints, and state‑machine approaches—accompanied by concrete SQL and pseudo‑code examples.

Backend DevelopmentCode ExamplesDatabase
0 likes · 12 min read
Ensuring Idempotency in Distributed Systems: Strategies and Code Samples
Selected Java Interview Questions
Selected Java Interview Questions
Oct 9, 2020 · Cloud Native

Why Learn Spring Cloud: Core Concepts, Architecture, Projects and Best Practices

This article explains the motivations for adopting Spring Cloud, defines its components and design goals, compares it with Spring Boot and other frameworks, outlines its main sub‑projects, versioning scheme, and provides practical guidance on configuration, service discovery, load balancing, fault tolerance, and gateway development for cloud‑native microservices.

BackendDistributed SystemsJava
0 likes · 21 min read
Why Learn Spring Cloud: Core Concepts, Architecture, Projects and Best Practices
Top Architect
Top Architect
Oct 8, 2020 · Backend Development

Flash Sale (秒杀) System Architecture, Technical Challenges and Solutions

This article analyses the complete flash‑sale business flow, enumerates its unique characteristics and technical challenges such as high concurrency, bandwidth pressure, inventory overselling, and then presents a layered architecture—including frontend static pages, site‑level throttling, service‑level queuing, database sharding, caching, and anti‑cheat mechanisms—along with concrete Java code examples and best‑practice recommendations for building a reliable, high‑performance flash‑sale system.

Distributed SystemsSystem architectureflash sale
0 likes · 32 min read
Flash Sale (秒杀) System Architecture, Technical Challenges and Solutions
Architects' Tech Alliance
Architects' Tech Alliance
Oct 7, 2020 · Fundamentals

Understanding Software Architecture: Concepts, Layers, Types, Evolution, and Common Pitfalls

This article explains the fundamental concepts of software architecture, distinguishes systems, subsystems, modules and components, describes various architectural layers such as business, application, data, code, technical and deployment, outlines evolution from monoliths to micro‑services, and highlights common misconceptions and measurement criteria for a sound architecture.

Architecture PatternsDistributed SystemsSoftware Architecture
0 likes · 29 min read
Understanding Software Architecture: Concepts, Layers, Types, Evolution, and Common Pitfalls
Java Architect Essentials
Java Architect Essentials
Oct 5, 2020 · Backend Development

Implementing Distributed Rate Limiting in Spring Cloud Gateway with Token Bucket and Lua Script

This article explains how Spring Cloud Gateway uses a token‑bucket algorithm backed by Redis and a Lua script to perform distributed rate limiting, reviews common limiting algorithms, provides detailed Java and Lua code examples, and analyzes each step of the implementation for high‑concurrency systems.

Distributed SystemsLuaRate Limiting
0 likes · 7 min read
Implementing Distributed Rate Limiting in Spring Cloud Gateway with Token Bucket and Lua Script
Big Data Technology Architecture
Big Data Technology Architecture
Sep 30, 2020 · Databases

Core Technologies of OLAP Systems: Storage, Computation, Optimizer, and Emerging Trends

This article systematically examines the core technologies of OLAP systems, covering storage models, columnar formats, indexing, distributed storage architectures, query execution steps, optimizer designs, and emerging trends such as real‑time analytics, HTAP, cloud‑native deployment, and hardware acceleration.

Columnar StorageDistributed SystemsOLAP
0 likes · 23 min read
Core Technologies of OLAP Systems: Storage, Computation, Optimizer, and Emerging Trends
MaGe Linux Operations
MaGe Linux Operations
Sep 29, 2020 · Backend Development

Understanding Message Middleware: Core Architecture and Kafka Basics

This article explains the fundamental architecture of message middleware, its key roles such as peak shaving, asynchronous processing and decoupling, the two consumption models (publish‑subscribe and point‑to‑point), and introduces core Kafka concepts with practical Java code examples.

Backend DevelopmentDistributed SystemsJava
0 likes · 7 min read
Understanding Message Middleware: Core Architecture and Kafka Basics
58 Tech
58 Tech
Sep 28, 2020 · Fundamentals

WPaxos: A Production‑Grade Java Implementation of the Paxos Consensus Algorithm – Design and Engineering Analysis

This article introduces the open‑source WPaxos project, explains the core Basic Paxos algorithm, analyzes various failure scenarios, and details the production‑level engineering optimizations and Java code implementations that enable high‑performance, reliable distributed consensus.

Consensus AlgorithmDistributed SystemsJava
0 likes · 19 min read
WPaxos: A Production‑Grade Java Implementation of the Paxos Consensus Algorithm – Design and Engineering Analysis
New Oriental Technology
New Oriental Technology
Sep 28, 2020 · Fundamentals

Understanding Distributed Systems: CAP, BASE, Caching, Message Queues, and Practical Improvements in New Oriental's Mobile App

This article explains the fundamentals of distributed systems, covering the CAP and BASE theorems, caching strategies, message queues, database choices, JVM optimization, and practical architectural improvements applied to New Oriental's mobile app to enhance availability and performance.

CAP theoremCachingDatabase
0 likes · 20 min read
Understanding Distributed Systems: CAP, BASE, Caching, Message Queues, and Practical Improvements in New Oriental's Mobile App
Wukong Talks Architecture
Wukong Talks Architecture
Sep 24, 2020 · Fundamentals

Common Pitfalls in Distributed Systems: Message Queues, Caches, Sharding, and Transactions

This article systematically explains the fundamental concepts and typical pitfalls of distributed systems—including CAP and BASE theories, message‑queue reliability issues, distributed cache challenges, sharding strategies, and transaction models—while offering practical mitigation techniques for each problem.

CAP theoremDistributed SystemsSharding
0 likes · 24 min read
Common Pitfalls in Distributed Systems: Message Queues, Caches, Sharding, and Transactions
dbaplus Community
dbaplus Community
Sep 23, 2020 · Databases

How JinS Achieves Multi‑Region Data Consistency and High Performance

Facing scalability limits, disaster risks, and latency in single‑region setups, OPPO built the JinS data‑sync framework, detailing its multi‑region challenges, design principles, modular architecture, consistency models, crash‑safe 2PC mechanisms, file‑queue optimizations, relay‑log handling, and performance gains over open‑source and commercial alternatives.

ConsistencyDistributed SystemsJinS
0 likes · 21 min read
How JinS Achieves Multi‑Region Data Consistency and High Performance
JD Tech Talk
JD Tech Talk
Sep 21, 2020 · Blockchain

JD Digits' JACOBI Blockchain Innovation Lab Announces Major Research Achievements Including Dumbo Asynchronous Consensus and Identity Management Protocols

JD Digits' JACOBI Blockchain Innovation Lab unveiled a series of breakthrough research results—such as the Dumbo and Dumbo‑MVBA asynchronous consensus protocols, a blockchain identity management scheme, and a storage‑time proof—demonstrating leading academic contributions across consensus, cryptography, and distributed applications.

BlockchainConsensusDistributed Systems
0 likes · 8 min read
JD Digits' JACOBI Blockchain Innovation Lab Announces Major Research Achievements Including Dumbo Asynchronous Consensus and Identity Management Protocols
IT Architects Alliance
IT Architects Alliance
Sep 20, 2020 · Industry Insights

What Is Middleware? History, Types, and the Chinese Market Landscape

This article explains middleware as foundational software for distributed systems, outlines its evolution from early transaction monitors to modern Java and .NET stacks, categorizes its various types, and analyzes global and Chinese market sizes while profiling leading domestic vendors.

Chinese vendorsDistributed Systemsmarket analysis
0 likes · 15 min read
What Is Middleware? History, Types, and the Chinese Market Landscape
Architects' Tech Alliance
Architects' Tech Alliance
Sep 19, 2020 · Fundamentals

How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges

This article outlines why distributed systems are needed, explains how they address cost and high‑availability issues through coordinated nodes, and discusses the new challenges such as service discovery, load balancing, avalanche prevention, monitoring, data sharding, replication, and distributed transactions, while offering practical and theoretical learning paths.

CAP theoremDistributed SystemsLearning Guide
0 likes · 10 min read
How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Sep 19, 2020 · Backend Development

An Introduction to Apache RocketMQ: Concepts, Architecture, Message Types, and Best Practices

This article provides a comprehensive overview of Apache RocketMQ, covering its core concepts, architecture, various message types, reasons for adoption such as asynchronous decoupling and peak‑shaving, as well as best practices and local transaction patterns for reliable distributed messaging.

Best PracticesDistributed SystemsMessage queue
0 likes · 17 min read
An Introduction to Apache RocketMQ: Concepts, Architecture, Message Types, and Best Practices
IT Architects Alliance
IT Architects Alliance
Sep 19, 2020 · Cloud Native

Inside Eastern Securities' Multi-Language gRPC-Nebula Platform for Microservice Governance

This article examines Eastern Securities' transition to a microservice architecture by detailing the design, implementation, and performance of its gRPC‑Nebula service‑governance framework and the Star‑Chen platform, covering challenges such as heterogeneous interfaces, service registration, load balancing, fault tolerance, traffic control, multi‑registry support, and real‑world deployment results.

Distributed Systemscloud-nativegRPC
0 likes · 34 min read
Inside Eastern Securities' Multi-Language gRPC-Nebula Platform for Microservice Governance
Architects' Tech Alliance
Architects' Tech Alliance
Sep 18, 2020 · Industry Insights

What Is Middleware? Types, Market Trends, and Leading Chinese Vendors

This article explains middleware fundamentals, its evolution in distributed systems, classifies its major types, analyzes global and Chinese market growth, and profiles key domestic vendors such as Dongfangtong, Baoland, Puyuan, Kingdee, Zhongchuang, Alibaba, and Tencent.

Chinese vendorsCloud ComputingDistributed Systems
0 likes · 16 min read
What Is Middleware? Types, Market Trends, and Leading Chinese Vendors
Big Data Technology & Architecture
Big Data Technology & Architecture
Sep 18, 2020 · Big Data

Understanding the Elasticsearch Master Election Process

This article explains when Elasticsearch triggers a master election, describes each election stage—including active master and candidate selection, Bully algorithm comparison, and master node responsibilities—while providing code excerpts that illustrate the underlying implementation details.

Big DataCluster ManagementDistributed Systems
0 likes · 8 min read
Understanding the Elasticsearch Master Election Process
Full-Stack DevOps & Kubernetes
Full-Stack DevOps & Kubernetes
Sep 18, 2020 · Cloud Native

Why Etcd Clusters Use Odd Nodes & What Happens During Leader Election

This article explains etcd’s Raft‑based consensus, why odd‑numbered nodes are recommended, details the leader election process with log excerpts, discusses split‑brain and consistency guarantees, and provides step‑by‑step instructions for generating certificates, deploying an etcd cluster, and using etcdctl commands.

CertificateCluster DeploymentDistributed Systems
0 likes · 19 min read
Why Etcd Clusters Use Odd Nodes & What Happens During Leader Election
Tencent Cloud Developer
Tencent Cloud Developer
Sep 17, 2020 · Cloud Computing

Evolution and Performance Optimization of Tencent Cloud Block Storage (CBS)

Tencent Cloud Block Storage (CBS) has evolved through three generations—apllo, atlas, and HiSTOR—adopting a client‑direct, distributed architecture, SPDK, RDMA and user‑space TCP to cut latency to sub‑microseconds while delivering exabyte‑scale throughput, high IOPS, and reliable multi‑copy replication for cloud VM workloads.

Distributed SystemsRDMASPDK
0 likes · 24 min read
Evolution and Performance Optimization of Tencent Cloud Block Storage (CBS)
Top Architect
Top Architect
Sep 17, 2020 · Backend Development

Cache Consistency Strategies: Cache‑Aside Pattern, Deleting vs. Updating Cache, and Queue‑Based Solutions for High Concurrency

The article explains how distributed cache‑aside patterns work, why deleting stale cache entries is often preferable to updating them, analyzes basic and complex cache‑database inconsistency scenarios, and proposes a JVM‑queue‑driven, single‑threaded update mechanism with practical considerations for high‑concurrency environments.

BackendConsistencyDistributed Systems
0 likes · 11 min read
Cache Consistency Strategies: Cache‑Aside Pattern, Deleting vs. Updating Cache, and Queue‑Based Solutions for High Concurrency
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Sep 17, 2020 · Fundamentals

Why Distributed Systems Matter: Core Concepts, Design Trade‑offs & CAP

This article explores the fundamentals of distributed systems, explaining what they are, why they’re used, design considerations such as replication and partitioning, the implications of the CAP theorem, common distribution strategies, typical architectural patterns, and the advantages and challenges of building and operating such systems.

CAP theoremDistributed SystemsScalability
0 likes · 14 min read
Why Distributed Systems Matter: Core Concepts, Design Trade‑offs & CAP
Java Backend Technology
Java Backend Technology
Sep 13, 2020 · Backend Development

How to Build a Robust Idempotent Framework for Distributed Systems

This article explains why idempotency is essential, presents simple database‑based and concurrency‑safe implementations, and then details a generic, annotation‑driven idempotent framework with multi‑level storage, code examples, and deployment guidelines for Java backend services.

BackendDistributed SystemsIdempotency
0 likes · 12 min read
How to Build a Robust Idempotent Framework for Distributed Systems
iQIYI Technical Product Team
iQIYI Technical Product Team
Sep 11, 2020 · Cloud Native

Chaos Engineering Framework and Practices in iQIYI FinTech Team

The iQIYI FinTech team implemented a Chaos Engineering framework, using a purpose‑driven Chaos Monkey to inject controlled failures, validate high‑availability, isolation, and self‑healing of payment services, derive architectural improvements, build a fault‑case library, and transition from fault detection to proactive system robustness.

Chaos MonkeyDistributed SystemsFinTech
0 likes · 9 min read
Chaos Engineering Framework and Practices in iQIYI FinTech Team
Java Backend Technology
Java Backend Technology
Sep 10, 2020 · Backend Development

How to Prevent Duplicate Order Numbers in High-Concurrency Java Applications

This article analyzes a real incident where duplicate order numbers were generated under high concurrency, critiques the original timestamp‑based approach, and presents a thread‑safe Java solution using AtomicInteger, Java 8 date formatting, and optional IP suffixes to ensure globally unique identifiers.

AtomicIntegerDistributed Systemsorder-number
0 likes · 9 min read
How to Prevent Duplicate Order Numbers in High-Concurrency Java Applications
Fulu Network R&D Team
Fulu Network R&D Team
Sep 10, 2020 · Backend Development

Snowflake ID Algorithm: Theory, Advantages, and .NET Implementation with Redis

This article explains the principles of primary keys, compares auto‑increment IDs and GUIDs, introduces the Snowflake ID structure, discusses its benefits and drawbacks, and provides a complete .NET implementation using Redis for dynamic worker‑ID allocation, including handling clock rollback and code examples.

C++Distributed SystemsRedis
0 likes · 17 min read
Snowflake ID Algorithm: Theory, Advantages, and .NET Implementation with Redis
Architect
Architect
Sep 9, 2020 · Backend Development

Cache Aside Pattern and Solutions for Cache‑Database Consistency in High‑Concurrency Environments

The article explains the classic Cache Aside pattern, why deleting rather than updating cache is preferred, analyzes basic and complex cache inconsistency scenarios, and proposes a queue‑based lazy update solution with practical considerations for read‑write blocking, request routing, and hotspot handling in high‑traffic systems.

ConsistencyDistributed SystemsQueue
0 likes · 11 min read
Cache Aside Pattern and Solutions for Cache‑Database Consistency in High‑Concurrency Environments
Architect's Tech Stack
Architect's Tech Stack
Sep 9, 2020 · Databases

How Redis Sentinel Implements Automatic Failover

This article explains how Redis Sentinel provides automatic failover by combining multi‑replica deployment, health monitoring, leader election, and distributed consensus to detect master failures, select a new master, promote it, and notify clients, ensuring high availability for Redis databases.

Distributed SystemsRedisautomatic failover
0 likes · 10 min read
How Redis Sentinel Implements Automatic Failover
Selected Java Interview Questions
Selected Java Interview Questions
Sep 6, 2020 · Backend Development

Redis Interview Questions and High‑Availability Distributed System Overview

This article compiles common Redis interview questions, compares Redis with Memcached, explains eviction policies, and provides a concise introduction to distributed systems, high‑availability architectures, master‑slave replication, synchronization methods, and Redis‑based distributed lock solutions.

CacheDistributed SystemsInterview
0 likes · 12 min read
Redis Interview Questions and High‑Availability Distributed System Overview
Architects' Tech Alliance
Architects' Tech Alliance
Sep 2, 2020 · Fundamentals

Understanding Software Architecture: Concepts, Layers, Classifications, and Evolution

This article explains the fundamental concepts of software architecture, distinguishes system, subsystem, module, component, and framework, outlines architectural layers and classifications, describes the evolution from monolithic to distributed and micro‑service architectures, and discusses how to evaluate and avoid common design pitfalls.

Distributed SystemsSoftware ArchitectureSystem Design
0 likes · 18 min read
Understanding Software Architecture: Concepts, Layers, Classifications, and Evolution
Sohu Tech Products
Sohu Tech Products
Sep 2, 2020 · Fundamentals

LegoOS: A Distributed Operating System for Disaggregated Hardware – Architecture and Design Overview

This article reviews the award‑winning 2018 OSDI paper LegoOS, describing its split‑kernel architecture, component‑based resource management across processors, memory and storage, and how it enables hardware disaggregation in data‑center clusters while addressing network latency and failure handling.

Distributed SystemsOS ArchitectureOperating Systems
0 likes · 17 min read
LegoOS: A Distributed Operating System for Disaggregated Hardware – Architecture and Design Overview
Java Architect Essentials
Java Architect Essentials
Sep 1, 2020 · Backend Development

How to Ensure Data Consistency in Microservices: Patterns and Pitfalls

Microservice architectures struggle with traditional ACID transactions, so this article reviews local and distributed transaction basics, explains why 2PC/3PC are unsuitable, introduces the BASE model, and details four practical consistency patterns—reliable event, async event, business compensation, and TCC—highlighting their mechanisms, advantages, and drawbacks.

BASE theoryData ConsistencyDistributed Systems
0 likes · 17 min read
How to Ensure Data Consistency in Microservices: Patterns and Pitfalls
Top Architect
Top Architect
Sep 1, 2020 · Backend Development

Improving Order Number Generation to Avoid Duplicates in High‑Concurrency Java Applications

The article analyzes a real‑world incident where duplicate order IDs were generated under high concurrency, demonstrates the shortcomings of the original Java implementation, and presents a thread‑safe redesign using AtomicInteger, Java 8 date‑time API and container IP suffix to guarantee unique identifiers across parallel requests and clustered instances.

BackendConcurrencyDistributed Systems
0 likes · 11 min read
Improving Order Number Generation to Avoid Duplicates in High‑Concurrency Java Applications
Top Architect
Top Architect
Sep 1, 2020 · Game Development

Why Game Companies’ Servers Are Reluctant to Adopt Microservices

The article explains, through interview excerpts, why many game studios avoid microservice architectures for their real‑time servers, highlighting latency‑sensitive communication, stateful processing, and the overhead of distributed networking that conflict with the performance demands of modern multiplayer games.

BackendDistributed Systemsarchitecture
0 likes · 8 min read
Why Game Companies’ Servers Are Reluctant to Adopt Microservices
Java Backend Technology
Java Backend Technology
Aug 30, 2020 · Backend Development

How to Generate Collision‑Free Order Numbers in High‑Concurrency Java Apps

The article examines a real‑world incident where duplicate order IDs appeared under high concurrency, analyzes the shortcomings of the original timestamp‑and‑random‑based scheme, and presents a revised Java implementation using thread‑safe counters, Java 8 date‑time APIs, and IP‑based suffixes to reliably produce unique order numbers even in clustered environments.

Distributed SystemsJavaUnique ID
0 likes · 13 min read
How to Generate Collision‑Free Order Numbers in High‑Concurrency Java Apps
Big Data Technology & Architecture
Big Data Technology & Architecture
Aug 27, 2020 · Big Data

HBase Architecture, Components, and Operations Overview

This article provides a comprehensive overview of Apache HBase’s architecture, detailing its core components such as RegionServer, HMaster, ZooKeeper, WAL, MemStore, and HFiles, and explains key processes including read/write paths, compaction, region splitting, load balancing, and recovery mechanisms.

Big DataDatabase ArchitectureDistributed Systems
0 likes · 17 min read
HBase Architecture, Components, and Operations Overview
Java Architect Essentials
Java Architect Essentials
Aug 25, 2020 · Backend Development

Understanding Kafka: Core Concepts, Architecture, and Performance Secrets

This article explains Kafka's role as a message system, details its fundamental components such as topics, partitions, producers, consumers, and replicas, describes how Zookeeper coordinates the cluster, and explores performance optimizations like sequential writes, zero‑copy, and network design.

Backend DevelopmentDistributed SystemsKafka
0 likes · 12 min read
Understanding Kafka: Core Concepts, Architecture, and Performance Secrets
Programmer DD
Programmer DD
Aug 23, 2020 · Backend Development

How Short URLs Work: Theory, Design, and a Java Implementation

This article explains why short URLs are used in spam SMS, outlines their benefits, describes the basic principle of mapping long URLs to short ones, and details service design choices such as storage, one‑to‑one mapping, high‑concurrency handling, distributed ID generation, and provides a Java implementation using Redis.

Backend DevelopmentDistributed SystemsRedis
0 likes · 11 min read
How Short URLs Work: Theory, Design, and a Java Implementation
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 19, 2020 · Backend Development

Implementing Transactional Messages with Apache RocketMQ

This article explains how to use Apache RocketMQ's 2PC-based transactional messaging feature, covering the overall workflow, key concepts such as half messages and compensation, and providing complete Java/Spring Boot code examples for producers, transaction listeners, and consumers.

2PCDistributed SystemsJava
0 likes · 12 min read
Implementing Transactional Messages with Apache RocketMQ
Top Architect
Top Architect
Aug 18, 2020 · Fundamentals

Fundamentals of Distributed Systems: Models, Replication, Consistency, and Core Protocols

This comprehensive article explains the core concepts of distributed systems—including node modeling, failure types, replica strategies, consistency levels, performance metrics, data distribution techniques, lease mechanisms, quorum, logging, two‑phase commit, MVCC, Paxos, and the CAP theorem—providing a solid foundation for designing robust, scalable architectures.

CAP theoremConsensusConsistency
0 likes · 53 min read
Fundamentals of Distributed Systems: Models, Replication, Consistency, and Core Protocols
Programmer DD
Programmer DD
Aug 16, 2020 · Game Development

Why Game Servers Shy Away from Microservices: Real‑Time Constraints Explained

This article examines why many game companies avoid microservice architectures, highlighting the real‑time latency, stateful memory requirements, and networking constraints that make traditional microservice patterns unsuitable for fast, multiplayer game servers.

Backend ArchitectureDistributed Systemsgame server
0 likes · 8 min read
Why Game Servers Shy Away from Microservices: Real‑Time Constraints Explained
Programmer DD
Programmer DD
Aug 13, 2020 · Backend Development

How to Solve Distributed Cache Consistency Issues with Lazy Updates and Queues

This article explains the classic Cache‑Aside pattern, analyzes common cache‑database consistency problems in high‑concurrency scenarios, and presents a lazy‑update queue solution that deletes stale cache entries, routes updates through internal JVM queues, and mitigates read‑blocking and hotspot issues.

ConsistencyDistributed SystemsQueue
0 likes · 11 min read
How to Solve Distributed Cache Consistency Issues with Lazy Updates and Queues
DevOps
DevOps
Aug 13, 2020 · Operations

ByteDance’s Chaos Engineering Journey: Practices, Architecture, and Future Directions

This article outlines ByteDance’s adoption of chaos engineering, describing its background, industry examples, the evolution of internal fault‑injection platforms across three generations, the fault model and center design, experiment principles, and future plans for infrastructure‑level chaos and automated diagnostics.

Distributed SystemsFault InjectionObservability
0 likes · 21 min read
ByteDance’s Chaos Engineering Journey: Practices, Architecture, and Future Directions
Big Data Technology Architecture
Big Data Technology Architecture
Aug 12, 2020 · Databases

Core Features and Architecture of ClickHouse

ClickHouse, the high‑performance columnar OLAP DBMS behind Yandex.Metrica, combines complete DBMS capabilities, column‑oriented storage with compression, vectorized execution, flexible table engines, multi‑master clustering, and extensive SQL support, offering fast online queries and scalable distributed processing for massive data workloads.

ClickHouseColumnar DatabaseDistributed Systems
0 likes · 28 min read
Core Features and Architecture of ClickHouse
Tencent Cloud Developer
Tencent Cloud Developer
Aug 11, 2020 · Cloud Native

Tencent TDMQ: Cloud‑Native Message Queue Architecture and Implementation

Tencent’s TDMQ is a cloud‑native, Pulsar‑based message queue that separates storage and compute, offering multi‑protocol support, strong consistency, high reliability, active‑active cross‑region replication, and read‑only broker scaling to meet financial‑grade billing workloads with billions of daily transactions.

Apache PulsarDistributed SystemsFinancial Services
0 likes · 26 min read
Tencent TDMQ: Cloud‑Native Message Queue Architecture and Implementation
New Oriental Technology
New Oriental Technology
Aug 11, 2020 · Backend Development

Engineering Case Study of New Oriental Cloud Classroom Backend Architecture and Scaling During the Pandemic

The article details how New Oriental's Cloud Classroom backend, built with Java, Spring, MySQL, Redis, Kafka, Sentinel, and other modern technologies, scaled to support millions of users and a hundred‑fold surge in demand during the pandemic through architectural optimizations, distributed caching, traffic control, and rapid performance improvements.

Distributed SystemsJavaKafka
0 likes · 7 min read
Engineering Case Study of New Oriental Cloud Classroom Backend Architecture and Scaling During the Pandemic
Java Backend Technology
Java Backend Technology
Aug 6, 2020 · Fundamentals

Why ZooKeeper? Unveiling the Core of Distributed Coordination Services

This article explains what ZooKeeper is, why it was created, its key features such as high performance, high availability, and strong consistency, and how it simplifies distributed application development by providing coordination primitives like naming, locks, leader election, and configuration management.

ConsensusCoordination ServiceDistributed Systems
0 likes · 10 min read
Why ZooKeeper? Unveiling the Core of Distributed Coordination Services
Efficient Ops
Efficient Ops
Aug 3, 2020 · Backend Development

Mastering Kafka Producer API: Tips, Configurations, and Common Pitfalls

This article provides a comprehensive guide to Kafka's producer API, covering core concepts, client‑side workflow, essential configurations, idempotent and transactional producers, and practical Java code examples to help developers avoid common pitfalls and optimize message publishing.

Distributed SystemsIdempotent ProducerJava
0 likes · 21 min read
Mastering Kafka Producer API: Tips, Configurations, and Common Pitfalls
Programmer DD
Programmer DD
Aug 2, 2020 · Backend Development

How to Solve Session Sharing and Cache Issues in Distributed Systems

This article explains how to handle session sharing in distributed systems through replication, sticky sessions, or a dedicated session server, and addresses cache penetration and avalanche issues with practical mitigation techniques such as request filtering, empty-object caching, hash repositories, Redis clustering, staggered expirations, and concurrency controls.

Backend DevelopmentDistributed SystemsSession Management
0 likes · 6 min read
How to Solve Session Sharing and Cache Issues in Distributed Systems
Programmer DD
Programmer DD
Aug 1, 2020 · Databases

Inside Ant Financial’s LDC Architecture: Scaling Double‑11 Payments with OceanBase and CAP Theory

This article explains how Ant Financial’s logical data center (LDC) and unitized architecture, combined with OceanBase’s Paxos‑based consensus, enable the massive TPS growth for Double‑11 payments while addressing sharding, CAP trade‑offs, traffic diversion, and multi‑site disaster recovery.

Ant FinancialCAP theoremDistributed Systems
0 likes · 37 min read
Inside Ant Financial’s LDC Architecture: Scaling Double‑11 Payments with OceanBase and CAP Theory
Architects Research Society
Architects Research Society
Jul 29, 2020 · Big Data

Static Members and Incremental Cooperative Rebalancing in Apache Kafka

Apache Kafka 2.3 introduced static members and incremental cooperative rebalancing to reduce disruptive global rebalances, allowing workers to retain assignments during failures, schedule delayed rebalances, and improve scalability for Kafka Connect clusters, balancing availability and fault tolerance.

Apache KafkaDistributed SystemsIncremental Rebalancing
0 likes · 12 min read
Static Members and Incremental Cooperative Rebalancing in Apache Kafka
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 24, 2020 · Big Data

Key Concepts and Internal Mechanisms of Apache Kafka

This article provides an in‑depth overview of Apache Kafka’s internal topics, preferred replicas, partition allocation mechanisms, log directory structure, index files, offset and timestamp lookup, log retention and compaction policies, storage architecture, delayed operations, controller role, consumer rebalance process, and producer idempotence.

Consumer RebalanceDistributed SystemsIdempotence
0 likes · 18 min read
Key Concepts and Internal Mechanisms of Apache Kafka
Amap Tech
Amap Tech
Jul 23, 2020 · Big Data

Overview of Apache Big Data Ecosystem Tools

The article surveys the Apache big‑data ecosystem, covering Hadoop’s storage and resource management, column stores HBase and Kudu, compute engines Spark, Flink, Impala, and Presto, coordination via ZooKeeper, ingestion with Sqoop and Flume, messaging Kafka, security Ranger and Sentry, metadata Atlas, OLAP Kylin, Hive, quality tool Griffin, notebooks Zeppelin, visualizations Superset and Tableau, the TPCx‑BB benchmark, and ends with an Alibaba analysis competition notice.

AnalyticsApacheDistributed Systems
0 likes · 19 min read
Overview of Apache Big Data Ecosystem Tools
转转QA
转转QA
Jul 23, 2020 · Operations

Building a Near Real‑Time Log Collection and Query System for Distributed Deployment

The article describes how a distributed deployment platform built a centralized Elasticsearch‑based log collection and query system to replace manual multi‑machine log inspection, detailing the background challenges, architecture, implementation steps, practical usage, and future improvements.

Distributed SystemsElasticsearchKibana
0 likes · 6 min read
Building a Near Real‑Time Log Collection and Query System for Distributed Deployment
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 22, 2020 · Big Data

Kafka Architecture and Core Concepts: Producers, Brokers, and Consumers

This article explains Kafka's fundamental architecture, including the roles of producers, brokers, and consumers, key concepts such as topics, partitions, replicas, ISR, and controller, as well as detailed mechanisms of producer client structure, interceptors, serializers, partitioners, and consumer group rebalancing strategies.

Big DataDistributed SystemsKafka
0 likes · 22 min read
Kafka Architecture and Core Concepts: Producers, Brokers, and Consumers
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 22, 2020 · Big Data

Exploring the Apache Big Data Ecosystem: Hadoop, Spark, Flink, and More

This article surveys the rapidly evolving big data landscape by reviewing a wide range of Apache projects—including Hadoop, Spark, Flink, HBase, Kudu, Impala, Kafka, and others—detailing their core components, architectures, strengths, and typical use‑cases for building distributed data platforms.

ApacheBig DataData Processing
0 likes · 20 min read
Exploring the Apache Big Data Ecosystem: Hadoop, Spark, Flink, and More
dbaplus Community
dbaplus Community
Jul 19, 2020 · Databases

How Beike Achieved Millisecond Queries on a 48‑Billion‑Triple Graph with Dgraph

This article details Beike's journey of storing and querying a 480‑billion‑triple industry graph in milliseconds, covering graph database fundamentals, a comparative evaluation of JanusGraph and Dgraph, the design and deployment of a Docker‑K8s based Dgraph platform, data ingestion pipelines, a custom Graph‑SQL layer, performance testing, optimizations, and future roadmap.

BeikeDgraphDistributed Systems
0 likes · 25 min read
How Beike Achieved Millisecond Queries on a 48‑Billion‑Triple Graph with Dgraph
Architect's Alchemy Furnace
Architect's Alchemy Furnace
Jul 19, 2020 · Fundamentals

Understanding Consistent Hashing: Principles, Design, and Real-World Applications

This article explains the fundamentals of hash functions, outlines the key characteristics of a good hash algorithm, and dives deep into consistent hashing—its background, mechanism, desirable properties, fault tolerance, scalability, and the use of virtual nodes to solve data skew in distributed systems.

Consistent HashingDistributed SystemsHashing
0 likes · 12 min read
Understanding Consistent Hashing: Principles, Design, and Real-World Applications
DataFunTalk
DataFunTalk
Jul 18, 2020 · Databases

Core Features and Architecture of ClickHouse: An In‑Depth Overview

This article provides a comprehensive technical overview of ClickHouse, covering its complete DBMS capabilities, column‑oriented storage and compression, vectorized execution engine, relational SQL support, diverse table engines, multi‑master clustering, sharding, and the design philosophies that make it exceptionally fast for large‑scale analytical workloads.

ClickHouseColumnar DatabaseDatabase Architecture
0 likes · 29 min read
Core Features and Architecture of ClickHouse: An In‑Depth Overview
Sohu Tech Products
Sohu Tech Products
Jul 15, 2020 · Backend Development

Design and Implementation of a High‑Performance Global Unique ID Generation Algorithm (Mist) and Service (Medis)

This article analyses the limitations of existing global unique ID solutions such as Snowflake, presents the design of a new high‑performance, time‑independent Mist algorithm with extended lifespan, and describes its practical Redis‑backed service Medis, including performance benchmarks and architectural considerations.

Distributed SystemsGolangRedis
0 likes · 14 min read
Design and Implementation of a High‑Performance Global Unique ID Generation Algorithm (Mist) and Service (Medis)
Architects Research Society
Architects Research Society
Jul 15, 2020 · Big Data

Introduction to Apache Kafka: A Distributed Streaming Platform

This article provides a comprehensive overview of Apache Kafka, explaining its distributed, fault‑tolerant architecture, horizontal scalability, disk‑based commit log, replication mechanisms, Streams API, KSQL, and why it is widely adopted as the backbone of event‑driven, high‑throughput systems.

Distributed SystemsKafkaMessage queue
0 likes · 15 min read
Introduction to Apache Kafka: A Distributed Streaming Platform
Top Architect
Top Architect
Jul 14, 2020 · Databases

Understanding Alipay’s LDC Architecture, Unitization, and CAP Analysis

The article explains how Alipay achieves massive payment throughput during Double‑11 by using logical data centers (LDC), unit‑based system design, multi‑active disaster‑recovery, and CAP‑theorem analysis, highlighting the role of OceanBase and PAXOS in ensuring consistency and availability.

CAP theoremDistributed SystemsHigh TPS
0 likes · 37 min read
Understanding Alipay’s LDC Architecture, Unitization, and CAP Analysis
Selected Java Interview Questions
Selected Java Interview Questions
Jul 12, 2020 · Backend Development

Evolution of High‑Concurrency Backend Architecture: From Single‑Machine to Cloud‑Native Solutions

The article walks through Taobao's backend architecture evolution—from a single‑machine setup to distributed caching, load balancing, database sharding, microservices, containerization, and finally cloud deployment—explaining each stage's technologies, challenges, and design principles for building scalable, highly available systems.

CachingDistributed SystemsScalability
0 likes · 23 min read
Evolution of High‑Concurrency Backend Architecture: From Single‑Machine to Cloud‑Native Solutions
Programmer DD
Programmer DD
Jul 11, 2020 · Fundamentals

Mastering Consistent Hashing: Balance, Monotonicity, and Minimal Data Shifts

Consistent hashing, introduced by MIT in 1997, addresses hotspot issues in distributed systems by ensuring balance, monotonicity, spread, and load properties, using a ring hash space, virtual nodes, and minimal data movement when nodes are added or removed.

Consistent HashingDistributed Systemsload balancing
0 likes · 10 min read
Mastering Consistent Hashing: Balance, Monotonicity, and Minimal Data Shifts
AntTech
AntTech
Jul 9, 2020 · Cloud Native

Ant Group's Financial-Grade Unitized Architecture: Design, Capabilities, and Real-World Banking Cases

This article presents Ant Group’s financial‑grade unitized architecture, detailing industry‑standard distributed models, the design of RZone/GZone/CZone, its disaster‑recovery, elasticity and gray‑release capabilities, and real‑world banking case studies demonstrating cloud‑native deployment strategies in the financial sector.

Distributed Systemsarchitecturecloud-native
0 likes · 11 min read
Ant Group's Financial-Grade Unitized Architecture: Design, Capabilities, and Real-World Banking Cases
Java Backend Technology
Java Backend Technology
Jul 9, 2020 · Backend Development

How to Solve Distributed Cache Consistency Issues with Lazy Updates

This article explains the Cache Aside pattern, why deleting stale cache entries is often better than updating them, and presents a queue‑based lazy‑update solution that handles simple and complex consistency problems in high‑concurrency environments while outlining practical performance considerations.

BackendCacheConsistency
0 likes · 11 min read
How to Solve Distributed Cache Consistency Issues with Lazy Updates
Top Architect
Top Architect
Jul 8, 2020 · Fundamentals

Distributed System Characteristics and Solutions for Distributed Transaction Consistency

This article explains the key characteristics of distributed systems, introduces the CAP and BASE theories, compares strong, weak and eventual consistency models, and reviews common distributed transaction solutions such as two‑phase commit, TCC and message‑based approaches, highlighting their trade‑offs and practical considerations.

BASE theoryCAP theoremDistributed Systems
0 likes · 13 min read
Distributed System Characteristics and Solutions for Distributed Transaction Consistency
JD Retail Technology
JD Retail Technology
Jul 1, 2020 · Backend Development

JdHotkey: A Lightweight Hotkey Detection Framework – Architecture, Workflow, and Performance

The article introduces the JdHotkey framework, a lightweight, real‑time hotkey detection solution for Redis and other services, detailing the risks of hot keys, prior mitigation methods, core design components, operational workflow, and performance benchmarks across various hardware configurations.

Distributed SystemsHotKeyRedis
0 likes · 16 min read
JdHotkey: A Lightweight Hotkey Detection Framework – Architecture, Workflow, and Performance
Selected Java Interview Questions
Selected Java Interview Questions
Jun 28, 2020 · Backend Development

Rate Limiting Strategies and Guava RateLimiter for High Concurrency Traffic

This article explains the concept of high traffic, compares common mitigation techniques such as caching, degradation and rate limiting, and then details four classic rate‑limiting algorithms—counter, sliding window, leaky bucket and token bucket—followed by a practical Guava RateLimiter example and a brief note on distributed scenarios.

Distributed SystemsGuavaRate Limiting
0 likes · 7 min read
Rate Limiting Strategies and Guava RateLimiter for High Concurrency Traffic
Top Architect
Top Architect
Jun 26, 2020 · Backend Development

Design and Implementation of a Transactional Message Module Using RabbitMQ and MySQL

This article explains a lightweight transactional message solution for microservices that leverages RabbitMQ, MySQL, and Spring Boot to achieve eventual consistency, detailing design principles, compensation mechanisms, table schemas, and deployment considerations for high‑throughput asynchronous processing.

CompensationDistributed SystemsMySQL
0 likes · 9 min read
Design and Implementation of a Transactional Message Module Using RabbitMQ and MySQL