Home / Research Articles Hub / Llama 2: Open Foundation and Fine-Tuned Chat Model...
⚙️ Engineering & Technology OpenAlex

Llama 2: Open Foundation and Fine-Tuned Chat Models

📅 Published: July 18, 2023 👤 Hugo Touvron, Louis Martin, Kevin H. Stone et al. 📖 arXiv (Cornell University) 📊 2,622 citations
AI-Generated Summary

In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our models outperform open-source chat models on most benchmarks we tested, and based on our human evaluations for helpfulness and safety, may be a suitable substitute for closed-source models.

⚡ This is an original paraphrased summary — not copied from the abstract. Full paper available at the source link below.

Key Findings
  • 1 Our fine-tuned LLMs, called Llama 2-Chat, are optimized for dialogue use cases.
  • 2 Our models outperform open-source chat models on most benchmarks we tested, and based on our human evaluations for helpfulness and safety, may be a suitable substitute for closed-source models.
  • 3 We provide a detailed description of our approach to fine-tuning and safety improvements of Llama 2-Chat in order to enable the community to build on our work and contribute to the responsible development of LLMs.
Why It Matters

These innovations can translate to real-world improvements in technology, infrastructure, and everyday tools.

This summary is based on publicly available metadata and abstract. For the full research paper, visit the original source:

Read Full Paper at OpenAlex
More Engineering & Technology Papers ← Back to Hub 📚 Learning Hub
Article Details
Source OpenAlex
Category ⚙️ Engineering & Technology
Published Jul 18, 2023
Journal arXiv (Cornell University)
DOI 10.48550/arxiv.2307.09288
Citations 2,622
Authors Hugo Touvron, Louis Martin, Kevin H. Stone, Peter J. Albert, Amjad Almahairi