Rare Earth Juejin Tech Community
Jan 3, 2024 · Artificial Intelligence
Llama 2: Open Foundation and Fine‑Tuned Chat Models – Ghost Attention, RLHF Results, and Safety Evaluation
This article summarizes the Llama 2 series, describing the Ghost Attention technique for maintaining system‑message consistency across multi‑turn dialogs, presenting RLHF and human evaluation results, and discussing extensive safety pre‑training, benchmark assessments, and model release details.
AI evaluationGhost AttentionLlama 2
0 likes · 20 min read