traffic routing

Rare Earth Juejin Tech Community

Feb 20, 2025 · Cloud Native

TrafficRoute GTM: GEO‑Based Routing and Traffic Orchestration at ByteDance

This article explains how ByteDance’s TrafficRoute GTM, a DNS‑based global traffic routing service, uses GEO‑based routing, health‑check orchestration, and intelligent load‑balancing to achieve high stability, performance, and cost efficiency for ultra‑large‑scale traffic across multiple regions and CDN providers.

ByteDanceDNS Load BalancingGTM

0 likes · 11 min read

TrafficRoute GTM: GEO‑Based Routing and Traffic Orchestration at ByteDance

Alibaba Cloud Infrastructure

Jul 15, 2024 · Operations

Managing LLM Traffic in Alibaba Service Mesh (ASM): Routing, Observability, and Security

This article explains how to use Alibaba Service Mesh (ASM) to register large language model (LLM) providers, configure LLMProvider and LLMRoute resources, and implement traffic routing, observability, and security for LLM services through step‑by‑step Kubernetes manifests and curl tests.

AIASMLLM

0 likes · 13 min read

Managing LLM Traffic in Alibaba Service Mesh (ASM): Routing, Observability, and Security

DeWu Technology

Mar 25, 2024 · Cloud Native

Design and Implementation of Same‑City Dual‑Active Architecture for a Transaction Platform

The paper details a same‑city dual‑active architecture for a high‑traffic transaction platform, combining blue‑green and dual‑cluster deployment with zone‑aware routing, middleware transformations, and a gradual traffic‑coloring release process that achieved near‑50/50 traffic split, stable performance, minimal cost, and outlines remaining challenges.

High Availabilitycloud-nativedeployment

0 likes · 20 min read

Design and Implementation of Same‑City Dual‑Active Architecture for a Transaction Platform

Yang Money Pot Technology Team

Feb 27, 2024 · Cloud Native

Implementing SwimLane Isolation with Service Mesh and Kubernetes: Architecture, WASM Filters, and CRD Controllers

This article describes how to use Istio Service Mesh, Kubernetes CRDs, and custom WASM Envoy filters to create isolated swim‑lane call chains that prevent branch conflicts, enable full‑link header propagation, and support features such as Java remote debugging, middleware deployment, and hot code reload.

CRDSwimLaneWASM

0 likes · 26 min read

Implementing SwimLane Isolation with Service Mesh and Kubernetes: Architecture, WASM Filters, and CRD Controllers

Top Architect

Jan 6, 2023 · Backend Development

Janus Gateway: Architecture, Routing Rules, and Performance at Baidu

The article explains Baidu's Janus gateway—its motivations, three‑level routing design, variable and condition expression language, plugin implementations for disaster recovery and caching, and performance benchmarks—showing how it supports millions of QPS while remaining flexible and efficient.

Expression Languagebackendgateway

0 likes · 11 min read

Janus Gateway: Architecture, Routing Rules, and Performance at Baidu

Zhuanzhuan Tech

Jan 4, 2023 · Operations

Evolution of Zhaozhuan Test Environment Governance: From Physical Isolation to Tag‑Based Traffic Routing

This article describes how Zhaozhuan’s testing environment evolved through three versions—physical isolation, automatic‑IP‑tag routing, and manual‑tag routing—detailing the architectural background, implementation principles, advantages, drawbacks, and supporting tools that dramatically reduced deployment time and resource consumption while introducing new operational challenges.

Microservicescloud-nativeoperations

0 likes · 23 min read

Evolution of Zhaozhuan Test Environment Governance: From Physical Isolation to Tag‑Based Traffic Routing

Architecture Digest

Dec 14, 2022 · Backend Development

Why Baidu Built Janus: Design and Implementation of a High‑Performance General Gateway

Janus is Baidu’s high‑throughput, multi‑purpose gateway that complements BFE, supporting traffic, business, and hybrid routing for dozens of internal services; the article explains its motivations, architecture, three‑tier routing rules, variable and conditional expressions, plugin system, performance benchmarks, and future extensions.

backend developmentgatewayperformance

0 likes · 12 min read

Why Baidu Built Janus: Design and Implementation of a High‑Performance General Gateway

High Availability Architecture

Dec 9, 2022 · Backend Development

Design and Implementation of Baidu's Janus General Gateway Service

The article explains why Baidu built the high‑performance Janus gateway, its architecture and deployment topology, the three routing modes, the three‑level rule system with variable and condition expressions, plugin extensibility, performance benchmarks, and how the design can be generalized to other use cases.

backendcondition expressiongateway

0 likes · 9 min read

Design and Implementation of Baidu's Janus General Gateway Service

Zhuanzhuan Tech

Aug 5, 2022 · Operations

ITCP Alliance Closed‑Door Technical Exchange on Traffic Routing – Presentations, Discussions, and Future Plans

On August 5, the ITCP Alliance hosted a four‑hour closed‑door technical exchange at ZhaiZhai Group where five member companies shared detailed traffic routing practices, discussed common challenges, and outlined future collaborative initiatives to improve service governance and operational efficiency.

ITCP AllianceMicroservicesTesting Environment

0 likes · 6 min read

ITCP Alliance Closed‑Door Technical Exchange on Traffic Routing – Presentations, Discussions, and Future Plans

Zhuanzhuan Tech

Feb 16, 2022 · Backend Development

Leveraging ngx_lua for Traffic Grouping in Nginx

This article explains how to use the ngx_lua module in Nginx to assign traffic tags, implement header‑based or domain‑based routing, and integrate with dynamic upstreams for parallel testing, load testing, and gray‑release scenarios, providing code examples and configuration details.

Lua scriptingNginxbackend

0 likes · 9 min read

Leveraging ngx_lua for Traffic Grouping in Nginx

DeWu Technology

Jan 26, 2022 · Operations

Gray Release Strategy and Architecture for Online Customer Service System

The article describes the “小得物” gray‑release environment—a single‑region, isolated production setup that adds dedicated SLBs and DLB routing, uses UID‑based user and staff segmentation via HTTP headers and message metadata, and enables daytime partial‑traffic releases for the online customer‑service system, dramatically improving stability and reducing incident rates.

backend architecturedeploymentgray release

0 likes · 10 min read

Gray Release Strategy and Architecture for Online Customer Service System

Xianyu Technology

Oct 27, 2021 · Backend Development

Migrating Idlecenter: Code and Traffic Migration Strategies for Large-Scale Backend Services

The migration of Xianyu’s legacy Idlecenter service split into code migration—defining clear RPC‑service boundaries, moving middleware together, and avoiding refactoring—and traffic migration using HSF routing to shift load transparently, enabling gray releases, observability, sub‑second rollbacks, cutting effort to one person‑week per service with zero faults and a reusable checklist.

Backend MigrationHSFMicroservices

0 likes · 9 min read

Migrating Idlecenter: Code and Traffic Migration Strategies for Large-Scale Backend Services

Xianyu Technology

Oct 14, 2021 · Cloud Computing

Multi-Region High Availability Architecture for Xianyu Recommendation Service

The Xianyu recommendation service was re‑architected into an active‑active, multi‑region high‑availability system—using a unified access‑layer router, centralizing long‑tail dependencies, keeping data unsharded, refactoring caches and MySQL replication, and adhering to traffic‑closed‑loop and availability‑first principles—to overcome latency, improve scalability, and ensure low‑cost disaster recovery across two regions and three data centers.

Database ReplicationHigh AvailabilitySystem Architecture

0 likes · 15 min read

Multi-Region High Availability Architecture for Xianyu Recommendation Service

Yuanfudao Tech

Jul 30, 2021 · Cloud Native

Virtual Environment for Isolated Branch Testing in Service Mesh

The article describes a virtual environment solution that uses traffic coloring and routing to enable independent branch testing for micro‑services, improving development efficiency, reducing test costs, and supporting HTTP, RPC, and MQ protocols within a cloud‑native infrastructure.

TestingVirtual Environmentcloud-native

0 likes · 15 min read

Virtual Environment for Isolated Branch Testing in Service Mesh

Zhuanzhuan Tech

Jan 27, 2021 · Backend Development

IP‑Tag Based Traffic Routing and Distributed Tracing System for Test Environments

This article describes how a microservice architecture uses IP‑tag traffic routing to separate dynamic test environments from stable ones, implements RPC and MQ routing, and introduces a custom Zipkin‑based distributed tracing system called Tianwang to improve deployment efficiency, resource utilization, and debugging in large‑scale backend services.

Distributed TracingMQMicroservices

0 likes · 12 min read

IP‑Tag Based Traffic Routing and Distributed Tracing System for Test Environments

Architecture Digest

Nov 15, 2020 · Cloud Native

Ele.me's Multi‑Active Architecture: Design Principles, Core Components and Implementation Overview

This article explains how Ele.me built a multi‑active, geographically distributed system that enables elastic scaling and data‑center‑level disaster recovery by partitioning services, routing traffic, replicating data in real time, and enforcing strict consistency and availability principles.

High Availabilitycloud-nativedata replication

0 likes · 18 min read

Ele.me's Multi‑Active Architecture: Design Principles, Core Components and Implementation Overview

Dada Group Technology

Jul 14, 2020 · Backend Development

Design and Implementation of a Flexible Service Governance and Traffic Distribution Engine at Dada Group

This article describes how Dada Group tackled rapid micro‑service growth by designing a language‑agnostic, lightweight service governance and traffic routing engine that uses Consul metadata, configurable routing rules, and link‑based isolation to enable online pressure testing, parallel development, hot‑cold service separation, gray releases, and dynamic rate limiting.

Microservicesbackend architecturecloud-native

0 likes · 10 min read

Design and Implementation of a Flexible Service Governance and Traffic Distribution Engine at Dada Group

37 Interactive Technology Team

Apr 23, 2018 · Backend Development

API Gateway Overview and Practical Implementation Using OpenResty/Nginx

The article explains how an API gateway serves as a unified, secure entry point for services, outlines the limitations of manual NGINX configurations, and describes a practical implementation using OpenResty/Nginx with the open‑source Orange framework—enhanced with dynamic routing, header‑based authentication, encryption, and high‑availability design, dubbed the Aegis gateway.

API gatewayNGINXOpenResty

0 likes · 7 min read

API Gateway Overview and Practical Implementation Using OpenResty/Nginx