semantic identifiers

JD Cloud Developers

May 28, 2025 · Artificial Intelligence

Uncovering the ‘Sandwich’ Bottleneck in Residual Quantized Semantic IDs for Generative Search

This study investigates the “sandwich” bottleneck observed in residual‑quantized semantic identifiers (RQ‑SID) used in generative search and recommendation systems, revealing that token concentration in intermediate codebooks caused by path sparsity and long‑tail distributions degrades performance, and proposes two effective mitigation strategies that improve efficiency and generalization in e‑commerce applications.

e-commerce recommendationgenerative searchlong-tail distribution

0 likes · 13 min read

Uncovering the ‘Sandwich’ Bottleneck in Residual Quantized Semantic IDs for Generative Search

JD Tech Talk

Apr 27, 2025 · Artificial Intelligence

Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval

This paper investigates the "sandglass" phenomenon in residual‑quantized semantic identifiers for generative search and recommendation, analyzes its causes of path sparsity and long‑tail token distribution, and proposes heuristic and adaptive token‑removal methods that substantially improve model performance in e‑commerce scenarios.

adaptive token removalgenerative retrievalrecommendation systems

0 likes · 10 min read

Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval

JD Cloud Developers

Apr 27, 2025 · Artificial Intelligence

Overcoming the Hourglass Effect in Residual Quantization for Generative Retrieval

This paper investigates the “hourglass” phenomenon in residual‑quantized semantic identifiers for generative search and recommendation, revealing that token concentration in intermediate codebooks causes path sparsity and long‑tail distributions, and proposes heuristic layer removal and adaptive token‑pruning strategies that markedly improve model performance.

generative retrievalhourglass phenomenonresidual quantization

0 likes · 13 min read

Overcoming the Hourglass Effect in Residual Quantization for Generative Retrieval