Instructions to use tencent/Hunyuan-4B-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tencent/Hunyuan-4B-Instruct with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("tencent/Hunyuan-4B-Instruct", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -88,7 +88,7 @@ Note: The following benchmarks are evaluated by TRT-LLM-backend on several **bas
|
|
| 88 |
### Use with transformers
|
| 89 |
First, please install transformers.
|
| 90 |
```SHELL
|
| 91 |
-
|
| 92 |
```
|
| 93 |
Our model defaults to using slow-thinking reasoning, and there are two ways to disable CoT reasoning.
|
| 94 |
1. Pass **"enable_thinking=False"** when calling apply_chat_template.
|
|
|
|
| 88 |
### Use with transformers
|
| 89 |
First, please install transformers.
|
| 90 |
```SHELL
|
| 91 |
+
pip install transformers
|
| 92 |
```
|
| 93 |
Our model defaults to using slow-thinking reasoning, and there are two ways to disable CoT reasoning.
|
| 94 |
1. Pass **"enable_thinking=False"** when calling apply_chat_template.
|