This article introduces thirteen practical Linux operation tools—including Nethogs, IOZone, IOTop, IPtraf, IFTop, Fail2ban, and more—providing concise descriptions, download links, and step‑by‑step installation commands to help system administrators monitor performance, network traffic, and protect against attacks.
The article outlines eBay's key scalability best practices—including functional partitioning, horizontal sharding, avoiding distributed transactions, aggressive asynchronous decoupling, moving work to async pipelines, pervasive virtualization, and intelligent caching—to achieve linear or better resource usage as load grows.
This article presents 360's AIOps project, detailing how AI-driven capacity forecasting, host classification, resource recycling, intelligent MySQL scheduling, anomaly detection, alarm convergence, and root‑cause analysis have saved millions, improved efficiency, and paved the way for a fully automated operations workflow.
The article details Ant Financial's development of a highly available wireless test cluster that supports automated testing for its massive mobile app ecosystem, describing its architecture, data‑driven monitoring, full integration, and the All‑in‑One solution that enables rapid, cost‑effective iteration across dozens of services and IoT scenarios.
At Didi, the team replaced a chaotic mix of Kafka, Redis, and other queues with a custom, RocketMQ‑based service, using dual‑write and dual‑read migration, extensive performance testing, custom failover, batch extensions, and operational tweaks to achieve stable high‑throughput, low‑latency messaging at massive scale.
This article explains how Alibaba’s massive data‑center operations detect hardware failures early, automatically isolate faulty servers, and execute self‑healing workflows through a centralized, cloud‑native platform, detailing detection methods, convergence rules, architecture evolution, and the benefits of a closed‑loop AIOps system.
This tutorial walks you through the complete process of safely expanding a VMware virtual machine's disk, from powering off the VM and logging into vSphere Client to adding a new hard disk, configuring its size, and confirming the successful expansion with screenshots.
The article announces the open-source release of the Windows Agent component under the Apache license, its integration into the Open-Falcon community, future feature enhancements, and gratitude to contributors, while providing links to the source code and related documentation.
This article explores how the VUCA-driven volatility of modern FinTech demands robust, multi‑layered monitoring solutions and explains why Zabbix, with its open‑source flexibility, automated discovery, and deep integration capabilities, is a compelling choice for achieving resilient, automated operations.
This article chronicles Alibaba's decade‑long journey of capacity planning for Double 11, detailing five evolutionary phases—from manual estimates to full‑link testing ecosystems—while balancing cost, stability, and efficiency in massive distributed systems.
The article shares practical reflections on a two‑year DevOps transformation, examining the integration of development and operations, the shift to product‑oriented teams, and the decentralization of the IT operations department, while highlighting emerging challenges and key lessons for supporting global business.
The article summarizes the 58 Group technical salon where experts from Momo and 58 shared practical experiences on monitoring platform architectures, coverage, alarm configurations, convergence techniques, custom dimensions, multi‑view dashboards, and future directions for intelligent and automated monitoring across the company.
Over ten years of Alibaba's Double 11, the company transformed a modest marketing event into a global e‑commerce platform by continuously improving backend architecture, scaling strategies, full‑link stress testing, multi‑active data centers, cloud migration, and real‑time incident response, offering valuable operational insights.
This article outlines comprehensive Linux security measures—including account hardening, remote access protection, file system safeguards, rootkit detection tools, and step‑by‑step post‑attack response—to help system administrators strengthen server defenses and quickly recover from compromises.
Marking the 10th anniversary of Double 11, ZTO Technology details how it tackles massive traffic spikes with an automatic sorting management platform, a high‑availability IDC and private cloud, smart voice and face‑recognition services, real‑time data dashboards, and extensive performance testing to ensure stable, fast, and accurate order fulfillment.
From its humble 2009 launch to the 2018 tenth anniversary, Alibaba’s Double 11 shopping festival evolved through relentless technical challenges—system crashes, CDN bottlenecks, over‑selling bugs, and massive load‑testing innovations—offering a decade‑long case study in operations, scalability, and resilience for large‑scale e‑commerce platforms.
From the humble 2009 launch of Double 11 to the massive, cloud-native, multi-region architecture of 2018, Alibaba’s engineers chronicle yearly technical hurdles—traffic spikes, system crashes, CDN limits, over-selling, and the evolution of stress-testing, capacity planning, and operational safeguards that turned the shopping festival into a global engineering showcase.
This guide walks Linux administrators through common signs of server compromise, shows how to examine logs, user files, active processes, network traffic, and demonstrates using lsof and /proc to recover deleted log files, all with concrete command examples.
This article shares a detailed, experience‑driven guide on Elasticsearch tuning, covering data model fundamentals, storage cost reductions, cluster stability tricks, performance‑boosting settings, and custom kernel improvements, all illustrated with real‑world diagrams and Q&A insights.
Li Xiaohui shares Tencent Cloud MongoDB’s real‑world mini‑game operations, detailing schema‑free design, sharding, thread‑per‑connection tuning, snapshot‑based read fixes, and table‑level rollback, then demonstrates a one‑click cloud stack that provisions MongoDB, serverless functions, storage, monitoring and security for mini‑program developers.
The article explains how to achieve precise, real‑time detection of physical server outages, reduce false alarms through heartbeat monitoring, network and special‑case interference filtering, and detailed analysis, ultimately improving detection accuracy and coverage for reliable operations.
This article examines why automated operations are essential for growing game businesses, outlines the goals of a complete, simple, efficient, and secure system, and details the architecture and individual subsystems—including installation, platform, security, client updates, backup, and monitoring—that together form a robust DevOps solution.
This article shares practical strategies for avoiding system failures by doubting third‑party services, protecting against misuse by consumers, and strengthening internal design through solid API practices, resource limits, and disciplined coding principles.
This article explains how to assess and model system I/O capabilities, presents common disk and network I/O benchmarking tools, outlines key performance metrics and monitoring utilities, and offers detailed optimization approaches for storage, network, and low‑latency transaction scenarios.
This article outlines Youzan's end‑to‑end online incident management process—from fault detection and coordination through root‑cause analysis, recovery, review, and actionable JIRA tracking—highlighting practical workflows, data analysis, and continuous improvement practices for reliable service delivery.
The article introduces SGM, a comprehensive service governance and monitoring solution that addresses scaling, dependency complexity, and operational challenges by providing automated topology, real‑time tracing, capacity planning, root‑cause analysis, and extensive monitoring features such as performance metrics, JVM stats, call‑chain visualization, business dashboards, and intelligent alerting.
This article outlines the scope, terminology, classification levels, site selection principles, equipment layout, and subsystem requirements—including lighting, grounding, lightning protection, HVAC, monitoring, and cabling—for building and operating data center facilities in accordance with industry standards.
The article explains what constitutes a fault, introduces key metrics such as RPO and RTO, and describes various fault isolation principles, patterns, and practical examples—including dependency degradation, failover, dynamic adjustment, fast‑fail, caching, rate limiting, and resource isolation—to improve system reliability.
This article explains what load balancing is, compares it to navigation routing, and details five common strategies—round‑robin, weighted round‑robin, least connections, fastest response, and hash‑based—along with their pros, use‑cases, and health‑check mechanisms for achieving high availability.
This article explains how Alibaba’s mixed‑deployment (co‑location) technology combines online transaction services and offline compute workloads on shared physical servers, detailing its architecture, scheduling mechanisms, resource‑concession strategies, achieved performance gains, and future directions for large‑scale e‑commerce infrastructure.
The article explores why many operations engineers feel unhappy, identifies achievement and compensation as key to happiness, explains the internal and external value of ops work, and outlines how a dedicated ops team can improve product speed, stability, cost efficiency, and overall business outcomes.
The article explains why a downtime diagnosis system is needed, outlines its architecture and implementation methods—including log sources, feature extraction, and API integration—and presents early results showing high automation coverage and significant operational cost savings.
The Jenkins Area Meetup 2018 in Shenzhen, co‑hosted by DevOps时代社区 and vivo Mobile Internet, gathered experts who presented on hybrid‑cloud DevOps, large‑scale CI/CD with Jenkins at Tencent, DevOps‑based R&D and operations standards, and an automated CMDB‑driven operations platform, concluding with strong community engagement and available presentation materials.
The article details Weibo Advertising's Hubble monitoring system, describing its three‑layer architecture, metric taxonomy, AI‑driven trend prediction with LSTM models, dynamic alert thresholds, and performance testing using GoReplay, illustrating how large‑scale data and machine learning enable proactive operations.
Fabric is a Python library that lets you write task scripts and execute them over SSH on multiple hosts, providing a powerful way to automate deployments, system administration, and other large‑scale remote operations.
This article explains how to use Nginx’s built‑in limit_req and limit_conn modules to implement request‑rate and connection‑based throttling, covering configuration directives, execution flow, burst handling, delay modes, whitelist setup with geo and map modules, and practical examples for IP and domain limits.
This article explains Alibaba's mixed‑deployment (co‑location) technique, detailing its motivation, architecture, resource‑sharing mechanisms, scheduling strategies, performance results, and future directions for scaling and refining resource utilization across online and offline workloads.
This article explains why Redis is a popular in‑memory key‑value store, defines high availability, enumerates failure scenarios, and walks through four incremental architectures—single instance, master‑slave with one Sentinel, dual Sentinel, and three‑Sentinel with VIP—to achieve a robust, production‑grade Redis deployment.
This article compiles essential Linux commands and a suite of Java diagnostic utilities—including tail, grep, awk, find, tsar, btrace, Greys, JProfiler, and others—providing concise examples and code snippets to help engineers troubleshoot and monitor production systems efficiently.
Tencent’s architecture platform team explains how they monitor, automate, and secure billions of daily operations across storage, CDN, and live services, using multi‑dimensional metrics, real‑time and instant computation, AI‑driven anomaly detection, and a custom control platform for safe changes.
This guide explains how to silently monitor USB insertions on a computer, automatically copy the drive’s contents to a local folder or server using a Python script that periodically scans the /Volumes directory and triggers file transfer without the user noticing.
This article clarifies that DevOps extends beyond tools like Chef or Puppet, emphasizing people, processes, and culture, and outlines the comprehensive toolchain and steps needed for full‑stack automation in modern cloud‑native environments.
This article provides a comprehensive overview of data‑center rack cabinets, covering size specifications, power and cooling requirements, key industry standards such as IEC 60297‑1 and EIA‑310‑D, structural components, environmental considerations, load capacity, and practical design guidelines for safe and efficient deployment.
This article examines Youzan's journey to containerize its development and testing environments using Kubernetes and Docker, detailing the motivations, architectural decisions, network and isolation challenges, image integration, logging, load balancing, debugging, and the ongoing rollout to standard production environments.
This article offers eight practical operations‑team strategies—inspection, monitoring alerts, capacity planning, network restrictions, risk pre‑plans, data backup, on‑call mechanisms, and staying connected—to ensure system stability and enjoy the Golden Week holiday without incidents.
This article explains the shortcomings of traditional configuration files, describes why distributed configuration centers are essential for dynamic, multi‑environment microservice deployments, outlines their evolution, presents a simple design with caching and consistency improvements, and reviews popular open‑source solutions.
Tencent’s billing platform powers billions of daily transactions across 180+ countries, supporting both consumer and business payments, and employs sophisticated capacity testing, dynamic auto‑scaling, resource sharing, and change‑control mechanisms to ensure reliable large‑scale promotional events without service disruptions.
The article provides a comprehensive overview of JD's invoice system, detailing its business lines, core modules, data sources, invoicing workflows—including forward and reverse invoicing—and the system's role in automating tax management and reducing operational risk.
Goldeneye, Alibaba Mom's monitoring platform, uses big‑data pipelines, dynamic threshold prediction, mean‑shift change‑point detection, and automated metric discovery to replace manual alarm settings, reduce false alerts, and provide intelligent, scalable business monitoring across hundreds of services.
This talk explores how ops engineers can achieve continuous professional development by adopting checklist thinking, covering growth drivers, error classification, practical checklist applications, cognitive models, and design principles that turn complex incidents into systematic, repeatable processes.
A comprehensive visual guide lists essential Linux commands covering file handling, network operations, user management, system monitoring, and more, helping administrators quickly reference and master command-line tasks.
The article investigates intermittent CPU usage spikes on Linux servers caused by a kernel cputime bug, explains the root‑cause analysis, describes a cold patch applied to newer kernels, and details a hot‑patch solution that safely resolves the issue across thousands of production machines.
This article provides a comprehensive overview of internet operations, detailing how service‑centric stability, security, and efficiency are achieved through infrastructure management, monitoring, risk mitigation, and continuous optimization, while outlining the various operational roles, their duties, and the evolution of ops practices.
Alibaba’s monitoring evolution—from fragmented early tools to the standardized Sunfire platform and now AI‑powered full‑link observability—addresses scaling challenges, introduces business‑centric metrics, automated traceability, and intelligent anomaly detection, illustrating how massive, multi‑tenant infrastructures achieve unified, proactive operations at scale.
The 2018 Global DevOps State of the World Report, compiled by DORA with contributions from leading experts, presents extensive data from over 30,000 professionals, highlights new trends such as accelerated practices, cloud infrastructure, elite high‑performance organizations, and offers a live online session to help practitioners quickly grasp its valuable findings.
On September 15, Youzan’s big-data team and NetEase YouShu hosted a technical sharing titled “The Road to Data-Driven Operations,” where speakers explored the evolution of Youzan’s data warehouse metadata system, the architecture of its big-data development platform, and the application of functional programming in visual data analysis, highlighting current trends and future directions.
This document presents a comprehensive solution for merchant settlement in joint‑venture (co‑operated) offline stores, describing business models, settlement subject abstraction, billing engine components, settlement workflow, payment collection, and reconciliation architecture with detailed tables and diagrams.
The article introduces common open‑source monitoring tools such as Zabbix and Nagios, explains why distributed systems need proactive health checks, compares features, and provides a detailed Zabbix monitoring workflow including data collection, storage, visualization, alerting, and specific metrics for servers, networks, JVM and MySQL.
The XSigma system combines AI‑driven demand forecasting, real‑time optimization, visual decision‑making and intelligent training to automatically schedule, scale, balance load and match customers with the best agents, dramatically improving resource utilization and user experience for Alibaba’s massive CCO operation.
Qunar built a fault‑injection platform that dynamically injects runtime errors into its densely coupled backend services, enabling verification of degradation and circuit‑breaker strategies, with a four‑part architecture comprising a web UI, deployment system, command server, and Java agents using Instrumentation‑API for bytecode weaving.
This talk examines how traditional financial institutions, facing intense internet disruption, struggle with DevOps adoption, highlighting real-world case studies, the importance of granularity and decoupling, internal innovation mechanisms, and practical steps such as physical Kanban, CI/CD pipelines, and Git workflows to improve efficiency.
This article details the design, evolution, and implementation of an online test‑monitoring platform that transforms CI/CD pipelines into proactive alerting systems, covering the initial Spring‑based prototype, its shortcomings, the 2.0 configurable and visual redesign, plugin architecture, and future distributed deployment plans.
This article provides a detailed Jenkins migration guide, covering environment preparation, Tomcat configuration, permission settings, script adjustments, data copying, and troubleshooting tips to ensure a smooth transition to a new production server.
This article explains five essential flow metrics—Flow Time, Flow Efficiency, WIP Report, Aging Report, and Flow Distribution—showing how they help technology companies measure outcomes, improve predictability, and optimize DevOps transformations through data‑driven insights.
The article explains how Tencent's SNG operations team uses business profiling—including capacity, activity, core‑link, and SET models—to address performance testing across device types, forecast activity‑driven resource needs, identify core versus peripheral services, and plan reliable multi‑region deployments.
A comprehensive collection of Linux operations interview questions and answers covering topics such as system maintenance, networking, load balancing, RAID, MySQL, scripting, security, and troubleshooting, providing practical guidance for candidates seeking high‑pay Linux sysadmin roles.
This article provides a comprehensive overview of MySQL's lock architecture, covering the two‑layer server/storage engine design, metadata (MDL) locks, InnoDB row and gap locks, transaction isolation levels, and practical debugging techniques using source‑code entry points and real‑world examples.
This article continues the Elasticsearch performance monitoring series by detailing host‑level system and network metrics, cluster health and node availability, resource saturation, and related errors, providing practical guidance on disk space, I/O, CPU, network throughput, file descriptors, HTTP connections, thread pools, caches, pending tasks, and failed GET requests.
This article explains practical approaches for time‑series anomaly detection, multi‑dimensional drill‑down analysis, alarm‑convergence root‑cause analysis, and future AIOps planning, combining statistical methods, unsupervised learning, and supervised models to improve monitoring accuracy and operational efficiency.
Alibaba’s infrastructure team introduces a full‑link business monitoring approach that visualizes end‑to‑end health from a business perspective, unifies metrics, automates data collection, and leverages intelligent baseline alerts, enabling rapid issue detection, precise root‑cause analysis, and fine‑grained dimension monitoring across services.
This article details Alibaba's three‑year journey building a search middle platform, describing how DevOps, goal‑driven operations, and AI‑assisted automation (Sophon, Bahamut, and AIOps) were introduced to improve scalability, stability, and efficiency for large‑scale search services.
The article shares three detailed production incidents—an Oracle overload, a blockchain media service overload, and a 502 failure in an Nginx‑Tomcat rental app—explaining how the author diagnosed, mitigated, and permanently resolved each problem, and distilling key operational lessons.
This article explains how Tencent's SNG operations team builds and applies business profiling models—including capacity, activity, core‑link, and SET planning—to predict performance, automate scaling, identify critical services, and efficiently distribute workloads across multiple regions.
This article explains how to build an automated CMDB asset collection system by extending Puppet's Facter with custom plugins, using a custom Report Processor to post data to an AutoBank service, and deploying a Python/Django API server for storage and retrieval.
This article compiles and explains a set of Linux command‑line utilities—including uptime, dmesg, vmstat, mpstat, pidstat, iostat, free, sar and top—showing how to interpret their output to quickly identify CPU, memory, I/O, and network performance issues, with practical examples and key columns to monitor.
This article examines a real‑world case where a client’s multi‑threaded download caused sudden internet‑outbound bandwidth congestion, details the packet‑level investigation that revealed partial HTTP requests, explains the underlying network traffic analysis architecture, and outlines how automated monitoring and alerts improve operations efficiency.
This article explains Application Performance Management (APM), its role in monitoring distributed and micro‑service systems, outlines the five‑dimensional APM model, details core monitoring functions, and reviews leading open‑source APM solutions such as PinPoint, Zipkin, SkyWalking, Prometheus, CAT and Hawkular.
This article examines how enterprises can adopt DevOps with minimal risk and cost by leveraging agile management, continuous delivery frameworks like the 100‑to‑100 model, Conway’s Law, automation, scripting, and containerization with Docker, while also presenting a recruitment call for DevOps engineers.
This article outlines the motivations, design principles, system architecture, and key tools—including Cobbler, Ignite‑UX, WSUS, and Ansible—behind a bank’s automated operations platform, and details Ansible’s features, capabilities across Linux, HPUX, Windows and OpenStack, and its practical application scenarios such as batch changes, software installation, and environment delivery.
The article presents a detailed case study of the 58 Cloud DB Platform, describing its architecture, automated workflow using Celery and Ansible, and intelligent features such as server selection and alarm merging powered by machine‑learning, highlighting how it streamlines MySQL, Redis, and MongoDB operations for developers and DBAs.
This article presents an extensive DevOps glossary covering key terms and practices, a detailed periodic table of DevOps tools, and a skill roadmap outlining the essential knowledge and technologies needed to successfully implement DevOps in modern software delivery.
This article details the challenges and solutions encountered while transitioning a rapidly growing financial services platform from a VM‑centric private cloud to a hybrid environment that combines containers and virtual machines, covering network integration, IP management, container image standards, resource isolation, scheduling compatibility, and future lightweight container strategies.
When high service reliability demands immediate detection of slow requests, this guide shows three Python techniques—using tail via subprocess, file.tell/seek loops, and a generator with yield—to continuously watch log files and trigger alerts as soon as specified patterns appear.
This article shares practical methodologies for building software systems that remain stable for a decade, covering goal setting, holistic design, operator and data‑center choices, cross‑region active‑active challenges, server and platform selection, comprehensive monitoring, and the importance of continuous personal improvement.
This talk by Tencent’s monitoring R&D lead outlines a decade of evolution in large‑scale monitoring, covering real‑world incident cases, the three drivers behind architectural upgrades, the implementation of a three‑dimensional monitoring framework, and the application of AI‑powered AIOps for precise, rapid anomaly detection.
The article presents a straightforward DevOps value framework that links business, architecture, technology, people, process, tools, principles, methods, and practices, illustrating how each element supports the others and offering practical guidance for startups, micro‑service adoption, and economic decision‑making in software delivery.
This article shares how a fast‑growing short‑video company designed a lean big‑data architecture, introduced the ALPS foundation service, and leveraged Consul to automate CMDB, job distribution, service discovery, and monitoring, enabling efficient growth with minimal operational overhead.
This guide introduces the most frequently used Ansible modules—including ping, setup, file, copy, service, cron, yum, user, group, synchronize, mount, and get_url—explaining their purpose, key options, and providing concrete command‑line examples to help you automate system tasks efficiently.
This guide explains what Jenkins is—a free, powerful CI/CD platform for any build or deployment—and shows the exact command to display the initial administrator password stored in the Jenkins home directory on a Windows host.
The article explains how to proactively monitor Elasticsearch by covering key performance areas such as query and indexing latency, JVM heap and garbage‑collection behavior, and host‑level system metrics, providing practical guidance and visual diagrams for effective operations management.
This article explains how microservice architectures require a comprehensive monitoring system, covering data, resource, and code dimensions, and describes eight atomic monitoring scenarios such as URL, host, product, component, custom, resource, APM, and event monitoring to help engineers design effective observability solutions.
The article discusses how embracing speed and flexible configuration in QA, exemplified by the Beetle platform’s interface testing workflow, can improve project efficiency, enable unified automated testing, and integrate continuous integration, while emphasizing that tools alone cannot guarantee test quality.
This article presents a curated collection of ELK Stack utilities—including head plugins, Kibana extensions, cluster monitoring, migration, security, visualization, automation, SQL, and alerting tools—designed to enhance Elasticsearch development, management, and operational efficiency for developers and ops teams.
The article argues that static, five‑level maturity models are unsuitable for DevOps, outlines their three main shortcomings, and presents the data‑driven DevOps Capability Growth Model with its five capability categories and suggested measurement practices.
This article shares Sogou's journey in constructing a large‑scale big data platform, covering business overview, the evolution of its operations infrastructure, productization practices, security measures, and practical tips for medium‑size teams seeking to add value from data.
This article outlines Tencent's automated operations framework, covering the evolution of its package management system, multi‑center organizational structures, CMDB resource imaging, process automation, version control, and release management, while sharing practical lessons and pitfalls from real‑world deployments.
This article explains how Linux administrators can replace slow serial shell loops with concurrent executions using background processes, simulated queues, and FIFO pipes, providing step‑by‑step scripts, performance comparisons, and practical guidelines to control process counts safely.
This guide outlines a step‑by‑step approach for taking over new operational responsibilities, covering communication with development leaders, business overview, asset inventory, basic and business‑specific monitoring, standardization, SOP creation, failure drills, cost and capacity planning, and effective cross‑team communication.
Meizu’s operations team transformed reactive firefighting into proactive delivery by building a cloud‑native continuous integration platform, detailing their automation journey, challenges, platform components, release evolution, and intelligent ops that together boost quality, efficiency, cost control, and security.
This article provides a detailed reference of common Linux commands—including ls, mv, cp, scp, rm, touch, cd, mkdir, find, grep, tar, chmod, and many others—explaining each option, flag, and typical usage examples to help system administrators and developers work efficiently in the shell.
