Jingdong Woodpecker System: Automated Monitoring for E-commerce Activities

The Jingdong Woodpecker system is an automated monitoring solution designed to ensure the quality of e-commerce activities across multiple platforms including App, PC, mobile site, and WeChat/QQ. The system monitors tens of thousands of active activities daily, with numbers reaching hundreds of thousands during major shopping events like 618 and Double 11.

The system provides comprehensive monitoring in two main directions: functional and performance. Functional monitoring checks for expired activities, 404 errors, access timeouts, empty content, holiday mismatches, missing HTTPS configuration, platform adaptation errors, and plus member pricing issues. Performance monitoring evaluates page load times, image sizes, traffic usage, caching mechanisms, compression, HTTP connection reuse, and resource validity.

The architecture is built around a simple yet effective design using Spring framework for backend services. The core components include an activity list creation system that gathers real-time activity data through API calls and static configuration, a monitoring system that uses headless Chrome with Puppeteer framework for efficient page access, an alerting module for issue notification, and a repair confirmation system for tracking resolution progress.

The monitoring system employs a tree-structured approach where each activity maintains parent node information to track the complete access path. This enables precise issue localization when problems occur. The system uses multi-threaded processing with Node.js processes to fetch page content, followed by analysis using regular expressions and status code checks to identify various issues.

The system achieves high throughput of over 100 activities per minute through efficient design and the use of headless browsers. The Puppeteer framework enables fast, parallel page access without UI overhead, making it ideal for large-scale monitoring operations. The alerting system is configurable to route notifications to appropriate personnel based on issue type.

Through continuous monitoring and rapid issue detection, the Woodpecker system helps prevent poor user experiences and potential revenue loss by identifying and addressing problems before users encounter them. The system represents a comprehensive approach to quality assurance in e-commerce operations, combining technical sophistication with practical business value.