Hugging Face's logo

allenai
/
Llama-3.1-Tulu-3-8B-DPO

Text Generation
Transformers
PyTorch
Safetensors
English
llama
conversational
text-generation-inference
Model card Files
xet
Community
4
vwxyzjn commited on
Commit
25d5d68
·
verified ·
1 Parent(s): 41bd4ee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -45,7 +45,8 @@ Tülu3 is designed for state-of-the-art performance on a diversity of tasks in a
45
  |-----------|-------------------|
46
  | **Base Model** | [meta-llama/llama-3.1-405B](https://huggingface.co/meta-llama/llama-3.1-405B) |
47
  | **SFT** | [allenai/llama-3.1-Tulu-3-405B-SFT](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B-SFT) |
48
- | **Final Model (DPO)** | [allenai/llama-3.1-Tulu-3-405B](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B) |
 
49
  | **Reward Model (RM)**| (Same as 8B)
50
 
51
 
 
45
  |-----------|-------------------|
46
  | **Base Model** | [meta-llama/llama-3.1-405B](https://huggingface.co/meta-llama/llama-3.1-405B) |
47
  | **SFT** | [allenai/llama-3.1-Tulu-3-405B-SFT](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B-SFT) |
48
+ | **DPO** | [allenai/llama-3.1-Tulu-3-405B-DPO](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B-DPO) |
49
+ | **Final Model (RLVR)** | [allenai/llama-3.1-Tulu-3-405B](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B) |
50
  | **Reward Model (RM)**| (Same as 8B)
51
 
52