← Flash PapersLlama 2 Explained: Pretraining, Fine-Tuning, and Safety Alignment

Share this Flash Paper

Llama 2 Explained: Pretraining, Fine-Tuning, and Safety Alignment

https://flashpapers.ai/p/sx5jbngsq9
Make your own
Hugo Touvron, Louis Martin +66 more
Details ▸
MMLU (5-shot):68.9%· MMLUGSM8K (8-shot):56.8%· GSM8KHumanEval (0-shot):29.9%· HumanEvalToxigen:0.01%· Toxigen
Abstract

In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama 2-Chat, are optimized for dialogue use cases. Our models outperform open-source chat models on most benchmarks we tested, and based on our human evaluations for helpfulness and safety, may be a suitable substitute for closed-source models. We provide a detailed description of our approach to fine-tuning and safety improvements of Llama 2-Chat in order to enable the community to build on our work and contribute to the responsible development of LLMs.

Concepts:RLHF