iQIYI Technical Product Team
Jul 26, 2018 · Big Data
Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI
Gear is iQIYI’s internal, high‑availability workflow scheduler built on Apache Oozie and extended with a YAML‑based definition language, GitLab‑driven submission, and a web UI, enabling thousands of daily Hadoop/Spark jobs, complex dependencies, retries, and monitoring, and evolving from SSH‑centric 1.x to feature‑rich 2.x.
Big DataHadoopOozie
0 likes · 14 min read