Tag

GBA

1 views collected around this technical thread.

Alimama Tech
Alimama Tech
Dec 21, 2022 · Artificial Intelligence

GBA: Global Batch Gradients Aggregation for Search Advertising Training

GBA (Global Batch Gradients Aggregation) introduces a training mode that seamlessly switches between synchronous and asynchronous learning for search‑advertising models by keeping a constant global batch size, using token‑controlled gradient aggregation and staleness management to retain synchronous‑level accuracy while preserving asynchronous efficiency and eliminating manual hyperparameter tuning.

AlibabaGBASearch Advertising
0 likes · 15 min read
GBA: Global Batch Gradients Aggregation for Search Advertising Training