Tag

gcache

0 views collected around this technical thread.

Architect
Architect
Jan 6, 2024 · Backend Development

Root Cause Analysis and Resolution of Service Availability Fluctuations in a High‑QPS Go Backend

This article details the systematic investigation of intermittent availability drops in a high‑throughput Go service, covering hypothesis formulation, extensive profiling with pprof, gctrace, strace, fgprof, go trace, heap analysis, the discovery of a gcache LFU bug, and the final remediation steps.

GCGoPerformance Debugging
0 likes · 10 min read
Root Cause Analysis and Resolution of Service Availability Fluctuations in a High‑QPS Go Backend
Efficient Ops
Efficient Ops
Jul 10, 2023 · Backend Development

How a Hidden gcache Memory Leak Undermined 99.9% Service Availability

A high‑traffic Go service suffered intermittent availability drops below 99.9% due to timeouts, and after extensive profiling, tracing, and heap analysis the root cause was identified as a memory‑leak bug in the third‑party gcache LFU implementation, which was fixed by upgrading the library.

GCGoPerformance
0 likes · 10 min read
How a Hidden gcache Memory Leak Undermined 99.9% Service Availability
Bilibili Tech
Bilibili Tech
Jun 2, 2023 · Backend Development

Investigation and Resolution of Service Availability Fluctuations in a High‑QPS Go Backend Service

An investigation of a 100k‑QPS Go monolith revealed that intermittent availability drops were caused by a memory‑leak in the third‑party gcache LFU implementation, which inflated GC work and produced long mark phases; upgrading gcache eliminated the leak and restored 0.999+ availability, highlighting the need for thorough observability and dependency monitoring.

Garbage CollectionGoPerformance Debugging
0 likes · 10 min read
Investigation and Resolution of Service Availability Fluctuations in a High‑QPS Go Backend Service