Tag

long-tail distribution

0 views collected around this technical thread.

JD Cloud Developers
JD Cloud Developers
May 28, 2025 · Artificial Intelligence

Uncovering the ‘Sandwich’ Bottleneck in Residual Quantized Semantic IDs for Generative Search

This study investigates the “sandwich” bottleneck observed in residual‑quantized semantic identifiers (RQ‑SID) used in generative search and recommendation systems, revealing that token concentration in intermediate codebooks caused by path sparsity and long‑tail distributions degrades performance, and proposes two effective mitigation strategies that improve efficiency and generalization in e‑commerce applications.

e-commerce recommendationgenerative searchlong-tail distribution
0 likes · 13 min read
Uncovering the ‘Sandwich’ Bottleneck in Residual Quantized Semantic IDs for Generative Search