Artificial Intelligence 27 min read

Cross‑Domain Recommendation and Heterogeneous Mixed‑Feed Ranking Practices in 58 Community

This article presents a comprehensive overview of 58 Community's recommendation ecosystem, detailing its business background, cross‑domain recommendation concepts, three key challenges, practical solutions such as cross‑domain collaborative filtering with factorization machines, attribute‑mapping and multi‑view DSSM approaches, as well as the engineering of heterogeneous mixed‑feed ranking using scoring alignment, MMR and DPP diversity algorithms, and reports significant online performance gains.

DataFunTalk
DataFunTalk
DataFunTalk
Cross‑Domain Recommendation and Heterogeneous Mixed‑Feed Ranking Practices in 58 Community

58 Community is a unified content platform under 58.com that aggregates various services such as real‑estate, jobs, cars, and local life, aiming to connect users across multiple scenarios.

The recommendation scenarios span multiple entry points in the app, displaying feeds that contain news, posts, topics, videos, and other heterogeneous items.

Cross‑domain recommendation is introduced to leverage user and item overlap between the target domain (58 Community) and source domains (other 58 business lines) to improve cold‑start performance, overall relevance, and diversity.

Three practical problems are identified: (1) how to use data from other business lines to boost Community recommendations, (2) how to jointly improve PGC and UGC content, and (3) how to rank multiple heterogeneous entities in a single feed.

Solution 1: Cross‑domain collaborative filtering based on Factorization Machines, where user one‑hot, item one‑hot, and source‑domain behavior multi‑hot features are concatenated, and embeddings are trained and served via Faiss, yielding ~8% conversion lift.

Solution 2: Attribute‑mapping using statistical co‑occurrence or word2vec‑derived tag embeddings to map source‑domain categories to Community tags, enabling a simple recall pipeline that improves UV conversion by ~4%.

Solution 3: Multi‑view DSSM model that shares a common user tower across domains while keeping domain‑specific item towers, achieving ~2% UV conversion gain.

For heterogeneous mixed‑feed ranking, a unified scoring model aligns scores from different sub‑models, applies bucketed feature handling, and merges wide‑&‑deep components into a single model, resulting in +1% AUC and +4% CTR.

Diversity is enhanced using two algorithms: Maximal Marginal Relevance (MMR) with a custom distance hierarchy and Determinantal Point Process (DPP) based on the paper “Fast Greedy MAP Inference for Determinantal Point Process to Improve Recommendation Diversity,” both delivering higher CTR, UV‑CTR, and average view counts.

The overall conclusion emphasizes that cross‑domain recommendation is a strategic approach akin to multi‑task and transfer learning, that algorithmic choices must align with business characteristics, and that diversity should be treated as a means to improve core business metrics.

Rankingcross-domain recommendationdiversityFactorization Machinesheterogeneous feedmulti-view dssm
DataFunTalk
Written by

DataFunTalk

Dedicated to sharing and discussing big data and AI technology applications, aiming to empower a million data scientists. Regularly hosts live tech talks and curates articles on big data, recommendation/search algorithms, advertising algorithms, NLP, intelligent risk control, autonomous driving, and machine learning/deep learning.

0 followers
Reader feedback

How this landed with the community

login Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.