This article explains Envoy's HTTP filter architecture, routing capabilities, gRPC integration, WebSocket handling, and cluster manager functions, detailing how each component operates without needing knowledge of underlying protocols and how they enable advanced traffic management, observability, and service mesh features.
A mobile app gateway for e‑commerce platforms consolidates API exposure, connection pooling, HTTP/2 and QUIC multiplexing, unified encryption, custom DNS, caching and degradation strategies, while supporting heterogeneous back‑ends via gRPC and proxy services, thereby improving stability, speed, capacity planning and revenue.
The 2018 developer‑tool roundup highlights Elasticsearch for log processing, gRPC for high‑performance RPC, the CNCF ecosystem (Kubernetes, Prometheus, etc.), Python’s AI dominance, cross‑platform Mini‑Programs, VSCode’s plugin‑rich IDE, Vue.js front‑end simplicity, GraphQL’s flexible APIs, and notes a shift toward mobile, cloud‑native infrastructure and commercial open‑source licensing.
The investigation of QLB‑4‑based TFServing calls revealed uneven traffic, stale routing after scaling, and idle servers due to layer‑4 hash routing, leading the team to replace QLB‑4 with a Consul‑driven client‑side load‑balancer that dynamically pools servers, eliminates restarts, and cuts GPU waste.
The iQIYI deep‑learning platform identified two TensorFlow Serving memory‑leak problems—a string‑accumulating executor map caused by unordered input maps and an uncontrolled gRPC thread surge under heavy load—submitted upstream patches that sort inputs and cap thread counts, eliminating OOM crashes and stabilizing production.
Long Young GC pauses in gRPC/Netty services were traced to Netty’s default thread‑local cache creating many MpscArrayQueue objects, and disabling the cache with the JVM options ‑Dio.netty.allocator.useCacheForAllThreads=false and ‑Dio.grpc.netty.shaded.io.netty.allocator.useCacheForAllThreads=false reduced GC time from up to 900 ms to about 100 ms, stabilizing the service.
The article details how a sudden surge in goroutine and heap usage was traced to repeatedly creating gRPC clients instead of reusing a singleton, leading to blocked goroutines and TCP connections, and explains using pprof, stack traces, and tools like goleak to detect and prevent such leaks.
Chaos Engineering and Fault Injection System Design combine steady-state hypotheses, controlled blast-radius experiments, and a lightweight interceptor layer using gRPC and protobuf to inject and report faults in micro-service architectures, enabling continuous testing, rapid MTTR reduction, and resilient services through automated, real-time experimentation and analysis.
This comprehensive guide walks you through creating a gRPC user service in Go and PHP, from defining protobuf messages and generating code, implementing server and client stubs, adding client, server, and bidirectional streaming, securing communication with TLS certificates, and managing request deadlines with timeout controls.
The article explains gRPC fundamentals, illustrating service definition in .proto files, synchronous and asynchronous client and server implementations with CompletionQueue and CallData state machines, streaming RPC patterns, HTTP/2 protocol details, metadata handling, and the structure of generated stub and service code.
The article surveys the open‑source microservice ecosystem, comparing RPC‑only frameworks like gRPC, language‑specific solutions such as Spring Cloud, emerging service‑mesh platforms, and Tencent’s multi‑language TARS which integrates full governance features, and explains their architectures, capabilities, and future direction.
Tencent’s Penguin Smart Pen Classroom uses a camera‑equipped dot‑matrix pen and a gRPC‑based micro‑service architecture on Tencent Cloud to capture handwriting, perform AI‑driven grading, share boards in real time, and generate personalized reports across three linked subsystems, scaling to thousands of schools.
The Shopee Games team created a custom Protobuf‑driven API gateway that unifies external HTTP and internal RPC traffic, automatically generates routing, authentication, logging and Swagger from proto annotations, shares capacity across services, and boosts performance and resource utilization for their micro‑service‑based casual gaming platform.
Protocol Buffers (ProtoBuf) is a language‑neutral, binary serialization format that enables compact, fast data exchange and easy backward‑compatible schema evolution across many languages, with automatic code generation, making it ideal for gRPC and storage despite being non‑human‑readable.
The article details the architecture, key components, testing types, and operational results of Autohome's PTS platform, which uses Docker Swarm, gRPC, JMeter, Flume‑Kafka, and Flink to conduct large‑scale distributed load testing for the 818 event and outlines future improvements toward Kubernetes and direct Kafka logging.
This article introduces Kaiyan Kuaichuang's Flutter‑based cross‑platform architecture, covering component layering, state‑management strategies (BLoC, Provider, Redux, Built_redux), data communication via gRPC/ProtoBuf, and a custom URL‑based routing solution, while sharing practical code snippets and lessons learned.
This article explains the core concepts and detailed design of a custom message queue built on a distributed key‑value store, covering terminology, architecture, broker metadata, topic metadata, message format, sending, storage, retrieval, delay handling, retry mechanisms, dead‑letter queues, and TTL policies.
This article recounts the migration of the Core Course (CC) service from a custom Ruby RPC framework to a Go‑based gRPC solution, detailing technical choices, performance bottlenecks, testing strategies, monitoring setup, and the substantial improvements achieved after launch.
This article shares the engineering team’s experience of building a high‑growth, reliable backend for English Fluently, covering inter‑service communication with gRPC, service discovery, Docker‑based deployment, health‑checking, monitoring, autoscaling, Kubernetes orchestration, and multi‑cell availability strategies.
This article shares Laiye Technology's practical experience with Protobuf and gRPC, covering performance benefits, common pitfalls such as naming and compatibility issues, and the engineering solutions they implemented—including naming conventions, review processes, unified CI compilation, automatic client generation, version tagging, and Swagger documentation—to streamline large‑scale microservice development.