DaTaobao Tech
Apr 12, 2022 · Artificial Intelligence
ArcCSE: Angular Margin Contrastive Learning for Self‑Supervised Text Representation
ArcCSE introduces an angular‑margin contrastive loss and both pairwise (dropout‑augmented) and triple‑wise (span‑masked) relationship modeling to self‑supervise text embeddings, yielding tighter decision boundaries, higher alignment and uniformity, and superior performance on unsupervised STS, SentEval, and Alibaba’s retrieval and recommendation systems.
NLPangular margincontrastive learning
0 likes · 8 min read