Update README.md
Browse files
README.md
CHANGED
|
@@ -106,7 +106,7 @@ Generated: Of course. Here is a brief introduction to DeepSeek:
|
|
| 106 |
```
|
| 107 |
|
| 108 |
### Generate the model
|
| 109 |
-
|
| 110 |
```python
|
| 111 |
import torch
|
| 112 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
| 106 |
```
|
| 107 |
|
| 108 |
### Generate the model
|
| 109 |
+
Mian branch is required if the model is fp8 and the device supports fp8 https://github.com/intel/auto-round
|
| 110 |
```python
|
| 111 |
import torch
|
| 112 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|