Operations 6 min read

1. Architecture Overview

Drawing on experience with TimerTask, Quartz, SpringTask, HashWheelTimer, Elastic‑Job, XXL‑JOB, and AirFlow, the author created a teaching‑focused, horizontally scalable task‑scheduling platform supporting over 100 000 jobs, organized into gateway, admin, and worker layers, with a detailed architecture and tech‑stack overview.

Sohu Tech Products
Sohu Tech Products
Sohu Tech Products
1. Architecture Overview

在我的职业生涯里,接触过如下 TimerTask 、Quartz 、SpringTask、 时间轮 HashWheelTimer 、Elastic-Job 、XXL-JOB、PowerJob、AirFlow 等任务调度系统,也曾在一家汽车租赁公司自研过基于 XXL-JOB 改造的任务调度系统。

不少同学对我原来的自研经历很感兴趣,于是我编写了一个教学型的任务调度系统(支持 10万 + 调度任务),希望能帮助中高级工程师快速提升架构思维。

经过多轮思考,最终架构图如下 :

任务调度系统分为三个核心组件:

1、网关层负责应用的接入,任务的推送。

2、Admin 层负责任务的管理、任务的分片、UI 界面等。

3、Worker 层负责任务的调度,并将任务触发到网关。

之所以这么设计,必须保证所有的组件是可水平扩展的。

技术栈如下表:

项目仓库截图:

architectureDeploymenttask schedulingNettyQuartz
Sohu Tech Products
Written by

Sohu Tech Products

A knowledge-sharing platform for Sohu's technology products. As a leading Chinese internet brand with media, video, search, and gaming services and over 700 million users, Sohu continuously drives tech innovation and practice. We’ll share practical insights and tech news here.

0 followers
Reader feedback

How this landed with the community

login Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.