How Vipshop’s VTP Revolutionizes Automated Testing at Scale

Project Background

Vipshop, a fast‑growing e‑commerce company, faces unprecedented pressure on its backend systems as business expands. Ensuring system stability relies on rigorous quality control, which in turn depends on software testing. In today’s agile environment, functional and regression testing are essential for rapid iteration, yet they have traditionally been performed by isolated business teams without unified management. To address this, Vipshop launched the VIP Test Platform (VTP).

System Architecture

VTP consists of three main components: the VTP core, an agent, and the open‑source Jenkins server. VTP uses the Jenkins API to schedule jobs, collect test reports, and present results uniformly. Each business team can configure its own Jenkins instance to connect to VTP.

Execution Flowchart

Platform Features

Scheduling: Batch execution of test cases from various testing frameworks.

Reporting: Unified collection and display of test execution results.

Supported Frameworks

AutoV (TestNG) Fine‑Grained Support

VTP normally schedules tests at the JOB level, causing all cases to run. Fine‑grained support resolves this by allowing selective execution of individual TestNG cases. The following flowcharts illustrate the parsing and execution processes.

Parse TestNG Case Flowchart

Execute TestNG Case Flowchart

Integration with Other Systems

The platform follows a front‑end/back‑end separation architecture. The back end provides RESTful APIs as integration points, while the front end uses pure jQuery and HTML5 for UI rendering.

It has already integrated with the company’s CI (release) platform, enabling automatic test triggering after a CI pipeline runs. Integration with QAMP (Quality Management Platform) is in progress, which will allow test case selection and execution directly from QAMP.

Current Usage

Conclusion

The automation testing platform is just beginning; as teams from Guangzhou, Shanghai, and Beijing join, user numbers will grow. Future work will focus on ensuring stability, efficiency, scalability, expanding test capabilities, and enriching data visualizations to better support all development teams. Users are encouraged to actively adopt the Vipshop Automation Testing Platform.