Context‑Aware Re‑ranking in Industrial Recommendation Systems: Design and Practice of a List Retrieval System
The article presents a comprehensive study of re‑ranking in large‑scale industrial recommendation pipelines, identifies four key challenges—context awareness, permutation specificity, computational complexity, and business constraints—and proposes a two‑stage List Retrieval System that combines fast sequence search and a generative re‑ranking network with a deep context‑wise model, achieving significant online gains across multiple Taobao feed scenarios.
Re‑ranking has become an essential component of industrial recommendation systems, yet traditional greedy approaches ignore the contextual relationships among items in the final list, leading to sub‑optimal sequence rewards.
The authors analyze existing re‑ranking methods, highlight four major challenges (context awareness, permutation specificity, complexity, and business requirements), and argue that a truly optimal solution must model both upstream and downstream influences of each item.
To address these issues, they introduce a two‑stage List Retrieval System (LRS): • Re‑rank‑recall generates candidate sequences using a fast beam‑search algorithm and a Generative Reranking Network (GRN) that leverages policy‑gradient training. • Re‑rank‑sorting scores each candidate with a Deep Context‑Wise Network (DCWN) and selects the sequence with the highest List Reward (LR) metric.
Extensive online experiments on Taobao’s homepage, micro‑detail pages, and short‑video feeds demonstrate notable improvements (e.g., PV + 11%, IPV + 6%, effective VV + 5%, and increased average watch time) with minimal latency overhead.
The paper also discusses practical deployment considerations such as edge‑computing for GRN inference, handling variable sequence lengths, and integrating business‑driven diversification rules.
DataFunTalk
Dedicated to sharing and discussing big data and AI technology applications, aiming to empower a million data scientists. Regularly hosts live tech talks and curates articles on big data, recommendation/search algorithms, advertising algorithms, NLP, intelligent risk control, autonomous driving, and machine learning/deep learning.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.