Xiaohongshu Tech REDtech
Dec 26, 2024 · Artificial Intelligence
Instruction Embedding: Latent Representations of Instructions for Task Identification
The paper introduces Instruction Embedding—a task‑focused text representation learned on the new Instruction Embedding Benchmark—and shows that Prompt‑based Instruction Embedding (PIE) outperforms standard embeddings in clustering, similarity, and downstream tasks such as data selection, in‑context example retrieval, test‑set compression, and task‑correlation analysis.
Fine-tuningcontrastive learninginstruction embedding
0 likes · 15 min read