Alimama Tech
Dec 21, 2022 · Artificial Intelligence
GBA: Global Batch Gradients Aggregation for Search Advertising Training
GBA (Global Batch Gradients Aggregation) introduces a training mode that seamlessly switches between synchronous and asynchronous learning for search‑advertising models by keeping a constant global batch size, using token‑controlled gradient aggregation and staleness management to retain synchronous‑level accuracy while preserving asynchronous efficiency and eliminating manual hyperparameter tuning.
AlibabaGBASearch Advertising
0 likes · 15 min read