Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, great care was taken to optimize helpfulness and safety. The GPTQ quantization of the Llama 3 model offers a significant memory requirement reduction with a slight trade off in inference quality and speed.

For instructions on accessing this model or initializing it via API, please refer to our docs.