File size: 1,748 Bytes
cf011fe
 
 
 
1661b2d
 
1efc60e
1661b2d
 
 
75f5417
 
2a5cc77
ce0aaa8
 
2a5cc77
6da648b
1661b2d
 
 
615bda0
341ccd8
 
6da648b
341ccd8
1661b2d
 
 
615bda0
341ccd8
 
 
 
1661b2d
 
 
250a538
0a77c7a
639d167
250a538
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
---
license: llama3
---

## Overview

Meta developed and released the [Meta Llama 3](https://huggingface.co/meta-llama/Meta-Llama-3-8B) family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, we took great care to optimize helpfulness and safety.

## Variants

| No | Variant | Cortex CLI command |
| --- | --- | --- |
| 1 | [onnx](https://huggingface.co/cortexso/llama3/tree/onnx) | `cortex run llama3:onnx` |
| 2 | [8b-tensorrt-llm-linux-ada](https://huggingface.co/cortexso/llama3/tree/8b-tensorrt-llm-linux-ada) | `cortex run llama3:8b-tensorrt-llm-linux-ada` |
| 3 | [8b-tensorrt-llm-windows-ada](https://huggingface.co/cortexso/llama3/tree/8b-tensorrt-llm-windows-ada) | `cortex run llama3:8b-tensorrt-llm-windows-ada` |
| 4 | [gguf](https://huggingface.co/cortexso/llama3/tree/gguf) | `cortex run llama3:gguf` |
| 5 | [default](https://huggingface.co/cortexso/llama3/tree/default) | `cortex run llama3` |

## Use it with Jan (UI)

1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
2. Use in Jan model Hub:
    ```
    cortexso/llama3
    ```

## Use it with Cortex (CLI)

1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
2. Run the model with command:
    ```
    cortex run llama3
    ```

## Credits

- **Author:** Meta
- **Converter:** [Homebrew](https://www.homebrew.ltd/)
- **Original License:** [License](https://llama.meta.com/llama3/license/)
- **Papers:** [Llama-3 Blog](https://llama.meta.com/llama3/)