Hugging Face's logo

BSC-LT
/
salamandra-2b-instruct-fp8

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
compressed-tensors
🇪🇺 Region: EU
Model card Files
xet
Community
jsaizant commited on
Commit
94d1f0e
·
1 Parent(s): c38ee2f

Empty branch

Browse files
Files changed (8) hide show
  1. README.md +0 -123
  2. config.json +0 -71
  3. generation_config.json +0 -12
  4. model.safetensors +0 -3
  5. special_tokens_map.json +0 -34
  6. tokenizer.json +0 -3
  7. tokenizer.model +0 -3
  8. tokenizer_config.json +0 -1104
README.md DELETED
@@ -1,123 +0,0 @@
1
- ---
2
- license: apache-2.0
3
- library_name: transformers
4
- base_model: BSC-LT/salamandra-2b-instruct
5
- pipeline_tag: text-generation
6
- language:
7
- - bg
8
- - ca
9
- - code
10
- - cs
11
- - cy
12
- - da
13
- - de
14
- - el
15
- - en
16
- - es
17
- - et
18
- - eu
19
- - fi
20
- - fr
21
- - ga
22
- - gl
23
- - hr
24
- - hu
25
- - it
26
- - lt
27
- - lv
28
- - mt
29
- - nl
30
- - nn
31
- - \no
32
- - oc
33
- - pl
34
- - pt
35
- - ro
36
- - ru
37
- - sh
38
- - sk
39
- - sl
40
- - sr
41
- - sv
42
- - uk
43
- ---
44
-
45
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/633b489acbdbadd99c0b75ef/6y7ivSTUx4zYTn-2o-aAZ.png)
46
-
47
- # Salamandra-2b-instruct-fp8 Model Card
48
-
49
- This model is the fp8-quantized version of [Salamandra-2b-instruct](https://huggingface.co/BSC-LT/salamandra-2b-instruct).
50
-
51
- The model weights are quantized from FP16 to FP8 (8-bit weights) using the FP8 quantization algorithm
52
- from [NeuralMagic](https://neuralmagic.com/blog/vllm-brings-fp8-inference-to-the-open-source-community/).
53
- Inferencing with this model can be done using [VLLM](https://docs.vllm.ai/en/stable/models/engine_args.html).
54
-
55
- Salamandra is a highly multilingual model pre-trained from scratch that comes in three different
56
- sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants,
57
- promoted and financed by the Government of Catalonia through the [Aina Project](https://projecteaina.cat/)
58
- and the _Ministerio para la Transformación Digital y de la Función Pública_ - Funded by EU – NextGenerationEU
59
- within the framework of [ILENIA Project](https://proyectoilenia.es/) with reference 2022/TL22/00215337.
60
-
61
- This model card corresponds to the fp8-quantized version of Salamandra-2b-instruct.
62
-
63
- The entire Salamandra family is released under a permissive [Apache 2.0 license]((https://www.apache.org/licenses/LICENSE-2.0)).
64
-
65
-
66
- ## How to Use
67
-
68
- The following example code works under ``Python 3.9.16``, ``vllm==0.6.3.post1``, ``torch==2.4.0`` and ``torchvision==0.19.0``, though it should run on
69
- any current version of the libraries. This is an example of a conversational chatbot using the model:
70
-
71
- ```
72
- from vllm import LLM, SamplingParams
73
-
74
- model_name = "BSC-LT/salamandra-2b-instruct-fp8"
75
- llm = LLM(model=model_name)
76
-
77
- messages = []
78
-
79
- while True:
80
- user_input = input("user >> ")
81
- if user_input.lower() == "exit":
82
- print("Chat ended.")
83
- break
84
-
85
- messages.append({'role': 'user', 'content': user_input})
86
-
87
- outputs = llm.chat(messages,
88
- sampling_params=SamplingParams(
89
- temperature=0.5,
90
- stop_token_ids=[5],
91
- max_tokens=200)
92
- )[0].outputs
93
-
94
- model_output = outputs[0].text
95
- print(f'assistant >> {model_output}')
96
- messages.append({'role': 'assistant', 'content': model_output})
97
- ```
98
-
99
-
100
- ### Author
101
- International Business Machines (IBM).
102
-
103
- ### Copyright
104
- International Business Machines (IBM).
105
-
106
- ### Contact
107
- For further information, please send an email to <[email protected]>.
108
-
109
- ### Acknowledgements
110
- We appreciate the collaboration with IBM in this work.
111
- Specifically, the IBM team created fp8-quantized version of the Salamandra-2b-instruct model released here.
112
-
113
- ### Disclaimer
114
- Be aware that the model may contain biases or other unintended distortions.
115
- When third parties deploy systems or provide services based on this model, or use the model themselves,
116
- they bear the responsibility for mitigating any associated risks and ensuring compliance with applicable
117
- regulations, including those governing the use of Artificial Intelligence.
118
-
119
- Barcelona Supercomputing Center and International Business Machines shall
120
- not be held liable for any outcomes resulting from third-party use.
121
-
122
- ### License
123
- [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
config.json DELETED
@@ -1,71 +0,0 @@
1
- {
2
- "_name_or_path": "/home/jsaiz/storage5/gpfs/projects/bsc88/text/models/salamandra_quantized_speculative/salamandra-2b-instruct-fp8",
3
- "architectures": [
4
- "LlamaForCausalLM"
5
- ],
6
- "attention_bias": false,
7
- "attention_dropout": 0.0,
8
- "bos_token_id": 1,
9
- "compression_config": {
10
- "config_groups": {
11
- "group_0": {
12
- "input_activations": {
13
- "block_structure": null,
14
- "dynamic": true,
15
- "group_size": null,
16
- "num_bits": 8,
17
- "observer": "memoryless",
18
- "observer_kwargs": {},
19
- "strategy": "token",
20
- "symmetric": true,
21
- "type": "float"
22
- },
23
- "output_activations": null,
24
- "targets": [
25
- "Linear"
26
- ],
27
- "weights": {
28
- "block_structure": null,
29
- "dynamic": false,
30
- "group_size": null,
31
- "num_bits": 8,
32
- "observer": "minmax",
33
- "observer_kwargs": {},
34
- "strategy": "channel",
35
- "symmetric": true,
36
- "type": "float"
37
- }
38
- }
39
- },
40
- "format": "float-quantized",
41
- "global_compression_ratio": 1.238603132760912,
42
- "ignore": [
43
- "lm_head"
44
- ],
45
- "kv_cache_scheme": null,
46
- "quant_method": "compressed-tensors",
47
- "quantization_status": "frozen"
48
- },
49
- "eos_token_id": 2,
50
- "head_dim": 128,
51
- "hidden_act": "silu",
52
- "hidden_size": 2048,
53
- "initializer_range": 0.02,
54
- "intermediate_size": 5440,
55
- "max_position_embeddings": 8192,
56
- "mlp_bias": false,
57
- "model_type": "llama",
58
- "num_attention_heads": 16,
59
- "num_hidden_layers": 24,
60
- "num_key_value_heads": 16,
61
- "num_layers": 24,
62
- "pretraining_tp": 1,
63
- "rms_norm_eps": 1e-05,
64
- "rope_scaling": null,
65
- "rope_theta": 10000.0,
66
- "tie_word_embeddings": false,
67
- "torch_dtype": "float32",
68
- "transformers_version": "4.46.1",
69
- "use_cache": true,
70
- "vocab_size": 256000
71
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
generation_config.json DELETED
@@ -1,12 +0,0 @@
1
- {
2
- "_from_model_config": true,
3
- "bos_token_id": 1,
4
- "do_sample": true,
5
- "eos_token_id": [
6
- 2,
7
- 5
8
- ],
9
- "repetition_penalty": 1.2,
10
- "temperature": 0.6,
11
- "transformers_version": "4.46.1"
12
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c432ea066dce6392f9636e4874844083979856ed68cf77348ecbe9f248800467
3
- size 3303226176
 
 
 
 
special_tokens_map.json DELETED
@@ -1,34 +0,0 @@
1
- {
2
- "additional_special_tokens": [
3
- "<|im_start|>",
4
- "<|im_end|>"
5
- ],
6
- "bos_token": {
7
- "content": "<s>",
8
- "lstrip": false,
9
- "normalized": false,
10
- "rstrip": false,
11
- "single_word": false
12
- },
13
- "eos_token": {
14
- "content": "</s>",
15
- "lstrip": false,
16
- "normalized": false,
17
- "rstrip": false,
18
- "single_word": false
19
- },
20
- "pad_token": {
21
- "content": "<unk>",
22
- "lstrip": false,
23
- "normalized": false,
24
- "rstrip": false,
25
- "single_word": false
26
- },
27
- "unk_token": {
28
- "content": "<unk>",
29
- "lstrip": false,
30
- "normalized": false,
31
- "rstrip": false,
32
- "single_word": false
33
- }
34
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
tokenizer.json DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:990527d1e7b98c027d386c742250b2f8517bd3adf98c46cc6c1c2f35b234c224
3
- size 37007559
 
 
 
 
tokenizer.model DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fa490e57cebce5cb1a0a5b1a5d3fa4de05aee53dc3a44791f1c3401db44d802d
3
- size 4813274
 
 
 
 
tokenizer_config.json DELETED
@@ -1,1104 +0,0 @@
1
- {
2
- "add_bos_token": true,
3
- "add_eos_token": false,
4
- "add_prefix_space": true,
5
- "added_tokens_decoder": {
6
- "0": {
7
- "content": "<unk>",
8
- "lstrip": false,
9
- "normalized": false,
10
- "rstrip": false,
11
- "single_word": false,
12
- "special": true
13
- },
14
- "1": {
15
- "content": "<s>",
16
- "lstrip": false,
17
- "normalized": false,
18
- "rstrip": false,
19
- "single_word": false,
20
- "special": true
21
- },
22
- "2": {
23
- "content": "</s>",
24
- "lstrip": false,
25
- "normalized": false,
26
- "rstrip": false,
27
- "single_word": false,
28
- "special": true
29
- },
30
- "3": {
31
- "content": "<pad>",
32
- "lstrip": false,
33
- "normalized": false,
34
- "rstrip": false,
35
- "single_word": false,
36
- "special": true
37
- },
38
- "4": {
39
- "content": "<|im_start|>",
40
- "lstrip": false,
41
- "normalized": false,
42
- "rstrip": false,
43
- "single_word": false,
44
- "special": true
45
- },
46
- "5": {
47
- "content": "<|im_end|>",
48
- "lstrip": false,
49
- "normalized": false,
50
- "rstrip": false,
51
- "single_word": false,
52
- "special": true
53
- },
54
- "6": {
55
- "content": "<|reserved_token_1|>",
56
- "lstrip": false,
57
- "normalized": false,
58
- "rstrip": false,
59
- "single_word": false,
60
- "special": true
61
- },
62
- "7": {
63
- "content": "<|reserved_token_2|>",
64
- "lstrip": false,
65
- "normalized": false,
66
- "rstrip": false,
67
- "single_word": false,
68
- "special": true
69
- },
70
- "8": {
71
- "content": "<|reserved_token_3|>",
72
- "lstrip": false,
73
- "normalized": false,
74
- "rstrip": false,
75
- "single_word": false,
76
- "special": true
77
- },
78
- "9": {
79
- "content": "<|reserved_token_4|>",
80
- "lstrip": false,
81
- "normalized": false,
82
- "rstrip": false,
83
- "single_word": false,
84
- "special": true
85
- },
86
- "10": {
87
- "content": "<|reserved_token_5|>",
88
- "lstrip": false,
89
- "normalized": false,
90
- "rstrip": false,
91
- "single_word": false,
92
- "special": true
93
- },
94
- "11": {
95
- "content": "<|reserved_token_6|>",
96
- "lstrip": false,
97
- "normalized": false,
98
- "rstrip": false,
99
- "single_word": false,
100
- "special": true
101
- },
102
- "12": {
103
- "content": "<|reserved_token_7|>",
104
- "lstrip": false,
105
- "normalized": false,
106
- "rstrip": false,
107
- "single_word": false,
108
- "special": true
109
- },
110
- "13": {
111
- "content": "<|reserved_token_8|>",
112
- "lstrip": false,
113
- "normalized": false,
114
- "rstrip": false,
115
- "single_word": false,
116
- "special": true
117
- },
118
- "14": {
119
- "content": "<|reserved_token_9|>",
120
- "lstrip": false,
121
- "normalized": false,
122
- "rstrip": false,
123
- "single_word": false,
124
- "special": true
125
- },
126
- "15": {
127
- "content": "<|reserved_token_10|>",
128
- "lstrip": false,
129
- "normalized": false,
130
- "rstrip": false,
131
- "single_word": false,
132
- "special": true
133
- },
134
- "16": {
135
- "content": "<|reserved_token_11|>",
136
- "lstrip": false,
137
- "normalized": false,
138
- "rstrip": false,
139
- "single_word": false,
140
- "special": true
141
- },
142
- "17": {
143
- "content": "<|reserved_token_12|>",
144
- "lstrip": false,
145
- "normalized": false,
146
- "rstrip": false,
147
- "single_word": false,
148
- "special": true
149
- },
150
- "18": {
151
- "content": "<|reserved_token_13|>",
152
- "lstrip": false,
153
- "normalized": false,
154
- "rstrip": false,
155
- "single_word": false,
156
- "special": true
157
- },
158
- "19": {
159
- "content": "<|reserved_token_14|>",
160
- "lstrip": false,
161
- "normalized": false,
162
- "rstrip": false,
163
- "single_word": false,
164
- "special": true
165
- },
166
- "20": {
167
- "content": "<|reserved_token_15|>",
168
- "lstrip": false,
169
- "normalized": false,
170
- "rstrip": false,
171
- "single_word": false,
172
- "special": true
173
- },
174
- "21": {
175
- "content": "<|reserved_token_16|>",
176
- "lstrip": false,
177
- "normalized": false,
178
- "rstrip": false,
179
- "single_word": false,
180
- "special": true
181
- },
182
- "22": {
183
- "content": "<|reserved_token_17|>",
184
- "lstrip": false,
185
- "normalized": false,
186
- "rstrip": false,
187
- "single_word": false,
188
- "special": true
189
- },
190
- "23": {
191
- "content": "<|reserved_token_18|>",
192
- "lstrip": false,
193
- "normalized": false,
194
- "rstrip": false,
195
- "single_word": false,
196
- "special": true
197
- },
198
- "24": {
199
- "content": "<|reserved_token_19|>",
200
- "lstrip": false,
201
- "normalized": false,
202
- "rstrip": false,
203
- "single_word": false,
204
- "special": true
205
- },
206
- "25": {
207
- "content": "<|reserved_token_20|>",
208
- "lstrip": false,
209
- "normalized": false,
210
- "rstrip": false,
211
- "single_word": false,
212
- "special": true
213
- },
214
- "26": {
215
- "content": "<|reserved_token_21|>",
216
- "lstrip": false,
217
- "normalized": false,
218
- "rstrip": false,
219
- "single_word": false,
220
- "special": true
221
- },
222
- "27": {
223
- "content": "<|reserved_token_22|>",
224
- "lstrip": false,
225
- "normalized": false,
226
- "rstrip": false,
227
- "single_word": false,
228
- "special": true
229
- },
230
- "28": {
231
- "content": "<|reserved_token_23|>",
232
- "lstrip": false,
233
- "normalized": false,
234
- "rstrip": false,
235
- "single_word": false,
236
- "special": true
237
- },
238
- "29": {
239
- "content": "<|reserved_token_24|>",
240
- "lstrip": false,
241
- "normalized": false,
242
- "rstrip": false,
243
- "single_word": false,
244
- "special": true
245
- },
246
- "30": {
247
- "content": "<|reserved_token_25|>",
248
- "lstrip": false,
249
- "normalized": false,
250
- "rstrip": false,
251
- "single_word": false,
252
- "special": true
253
- },
254
- "31": {
255
- "content": "<|reserved_token_26|>",
256
- "lstrip": false,
257
- "normalized": false,
258
- "rstrip": false,
259
- "single_word": false,
260
- "special": true
261
- },
262
- "32": {
263
- "content": "<|reserved_token_27|>",
264
- "lstrip": false,
265
- "normalized": false,
266
- "rstrip": false,
267
- "single_word": false,
268
- "special": true
269
- },
270
- "33": {
271
- "content": "<|reserved_token_28|>",
272
- "lstrip": false,
273
- "normalized": false,
274
- "rstrip": false,
275
- "single_word": false,
276
- "special": true
277
- },
278
- "34": {
279
- "content": "<|reserved_token_29|>",
280
- "lstrip": false,
281
- "normalized": false,
282
- "rstrip": false,
283
- "single_word": false,
284
- "special": true
285
- },
286
- "35": {
287
- "content": "<|reserved_token_30|>",
288
- "lstrip": false,
289
- "normalized": false,
290
- "rstrip": false,
291
- "single_word": false,
292
- "special": true
293
- },
294
- "36": {
295
- "content": "<|reserved_token_31|>",
296
- "lstrip": false,
297
- "normalized": false,
298
- "rstrip": false,
299
- "single_word": false,
300
- "special": true
301
- },
302
- "37": {
303
- "content": "<|reserved_token_32|>",
304
- "lstrip": false,
305
- "normalized": false,
306
- "rstrip": false,
307
- "single_word": false,
308
- "special": true
309
- },
310
- "38": {
311
- "content": "<|reserved_token_33|>",
312
- "lstrip": false,
313
- "normalized": false,
314
- "rstrip": false,
315
- "single_word": false,
316
- "special": true
317
- },
318
- "39": {
319
- "content": "<|reserved_token_34|>",
320
- "lstrip": false,
321
- "normalized": false,
322
- "rstrip": false,
323
- "single_word": false,
324
- "special": true
325
- },
326
- "40": {
327
- "content": "<|reserved_token_35|>",
328
- "lstrip": false,
329
- "normalized": false,
330
- "rstrip": false,
331
- "single_word": false,
332
- "special": true
333
- },
334
- "41": {
335
- "content": "<|reserved_token_36|>",
336
- "lstrip": false,
337
- "normalized": false,
338
- "rstrip": false,
339
- "single_word": false,
340
- "special": true
341
- },
342
- "42": {
343
- "content": "<|reserved_token_37|>",
344
- "lstrip": false,
345
- "normalized": false,
346
- "rstrip": false,
347
- "single_word": false,
348
- "special": true
349
- },
350
- "43": {
351
- "content": "<|reserved_token_38|>",
352
- "lstrip": false,
353
- "normalized": false,
354
- "rstrip": false,
355
- "single_word": false,
356
- "special": true
357
- },
358
- "44": {
359
- "content": "<|reserved_token_39|>",
360
- "lstrip": false,
361
- "normalized": false,
362
- "rstrip": false,
363
- "single_word": false,
364
- "special": true
365
- },
366
- "45": {
367
- "content": "<|reserved_token_40|>",
368
- "lstrip": false,
369
- "normalized": false,
370
- "rstrip": false,
371
- "single_word": false,
372
- "special": true
373
- },
374
- "46": {
375
- "content": "<|reserved_token_41|>",
376
- "lstrip": false,
377
- "normalized": false,
378
- "rstrip": false,
379
- "single_word": false,
380
- "special": true
381
- },
382
- "47": {
383
- "content": "<|reserved_token_42|>",
384
- "lstrip": false,
385
- "normalized": false,
386
- "rstrip": false,
387
- "single_word": false,
388
- "special": true
389
- },
390
- "48": {
391
- "content": "<|reserved_token_43|>",
392
- "lstrip": false,
393
- "normalized": false,
394
- "rstrip": false,
395
- "single_word": false,
396
- "special": true
397
- },
398
- "49": {
399
- "content": "<|reserved_token_44|>",
400
- "lstrip": false,
401
- "normalized": false,
402
- "rstrip": false,
403
- "single_word": false,
404
- "special": true
405
- },
406
- "50": {
407
- "content": "<|reserved_token_45|>",
408
- "lstrip": false,
409
- "normalized": false,
410
- "rstrip": false,
411
- "single_word": false,
412
- "special": true
413
- },
414
- "51": {
415
- "content": "<|reserved_token_46|>",
416
- "lstrip": false,
417
- "normalized": false,
418
- "rstrip": false,
419
- "single_word": false,
420
- "special": true
421
- },
422
- "52": {
423
- "content": "<|reserved_token_47|>",
424
- "lstrip": false,
425
- "normalized": false,
426
- "rstrip": false,
427
- "single_word": false,
428
- "special": true
429
- },
430
- "53": {
431
- "content": "<|reserved_token_48|>",
432
- "lstrip": false,
433
- "normalized": false,
434
- "rstrip": false,
435
- "single_word": false,
436
- "special": true
437
- },
438
- "54": {
439
- "content": "<|reserved_token_49|>",
440
- "lstrip": false,
441
- "normalized": false,
442
- "rstrip": false,
443
- "single_word": false,
444
- "special": true
445
- },
446
- "55": {
447
- "content": "<|reserved_token_50|>",
448
- "lstrip": false,
449
- "normalized": false,
450
- "rstrip": false,
451
- "single_word": false,
452
- "special": true
453
- },
454
- "56": {
455
- "content": "<|reserved_token_51|>",
456
- "lstrip": false,
457
- "normalized": false,
458
- "rstrip": false,
459
- "single_word": false,
460
- "special": true
461
- },
462
- "57": {
463
- "content": "<|reserved_token_52|>",
464
- "lstrip": false,
465
- "normalized": false,
466
- "rstrip": false,
467
- "single_word": false,
468
- "special": true
469
- },
470
- "58": {
471
- "content": "<|reserved_token_53|>",
472
- "lstrip": false,
473
- "normalized": false,
474
- "rstrip": false,
475
- "single_word": false,
476
- "special": true
477
- },
478
- "59": {
479
- "content": "<|reserved_token_54|>",
480
- "lstrip": false,
481
- "normalized": false,
482
- "rstrip": false,
483
- "single_word": false,
484
- "special": true
485
- },
486
- "60": {
487
- "content": "<|reserved_token_55|>",
488
- "lstrip": false,
489
- "normalized": false,
490
- "rstrip": false,
491
- "single_word": false,
492
- "special": true
493
- },
494
- "61": {
495
- "content": "<|reserved_token_56|>",
496
- "lstrip": false,
497
- "normalized": false,
498
- "rstrip": false,
499
- "single_word": false,
500
- "special": true
501
- },
502
- "62": {
503
- "content": "<|reserved_token_57|>",
504
- "lstrip": false,
505
- "normalized": false,
506
- "rstrip": false,
507
- "single_word": false,
508
- "special": true
509
- },
510
- "63": {
511
- "content": "<|reserved_token_58|>",
512
- "lstrip": false,
513
- "normalized": false,
514
- "rstrip": false,
515
- "single_word": false,
516
- "special": true
517
- },
518
- "64": {
519
- "content": "<|reserved_token_59|>",
520
- "lstrip": false,
521
- "normalized": false,
522
- "rstrip": false,
523
- "single_word": false,
524
- "special": true
525
- },
526
- "65": {
527
- "content": "<|reserved_token_60|>",
528
- "lstrip": false,
529
- "normalized": false,
530
- "rstrip": false,
531
- "single_word": false,
532
- "special": true
533
- },
534
- "66": {
535
- "content": "<|reserved_token_61|>",
536
- "lstrip": false,
537
- "normalized": false,
538
- "rstrip": false,
539
- "single_word": false,
540
- "special": true
541
- },
542
- "67": {
543
- "content": "<|reserved_token_62|>",
544
- "lstrip": false,
545
- "normalized": false,
546
- "rstrip": false,
547
- "single_word": false,
548
- "special": true
549
- },
550
- "68": {
551
- "content": "<|reserved_token_63|>",
552
- "lstrip": false,
553
- "normalized": false,
554
- "rstrip": false,
555
- "single_word": false,
556
- "special": true
557
- },
558
- "69": {
559
- "content": "<|reserved_token_64|>",
560
- "lstrip": false,
561
- "normalized": false,
562
- "rstrip": false,
563
- "single_word": false,
564
- "special": true
565
- },
566
- "70": {
567
- "content": "<|reserved_token_65|>",
568
- "lstrip": false,
569
- "normalized": false,
570
- "rstrip": false,
571
- "single_word": false,
572
- "special": true
573
- },
574
- "71": {
575
- "content": "<|reserved_token_66|>",
576
- "lstrip": false,
577
- "normalized": false,
578
- "rstrip": false,
579
- "single_word": false,
580
- "special": true
581
- },
582
- "72": {
583
- "content": "<|reserved_token_67|>",
584
- "lstrip": false,
585
- "normalized": false,
586
- "rstrip": false,
587
- "single_word": false,
588
- "special": true
589
- },
590
- "73": {
591
- "content": "<|reserved_token_68|>",
592
- "lstrip": false,
593
- "normalized": false,
594
- "rstrip": false,
595
- "single_word": false,
596
- "special": true
597
- },
598
- "74": {
599
- "content": "<|reserved_token_69|>",
600
- "lstrip": false,
601
- "normalized": false,
602
- "rstrip": false,
603
- "single_word": false,
604
- "special": true
605
- },
606
- "75": {
607
- "content": "<|reserved_token_70|>",
608
- "lstrip": false,
609
- "normalized": false,
610
- "rstrip": false,
611
- "single_word": false,
612
- "special": true
613
- },
614
- "76": {
615
- "content": "<|reserved_token_71|>",
616
- "lstrip": false,
617
- "normalized": false,
618
- "rstrip": false,
619
- "single_word": false,
620
- "special": true
621
- },
622
- "77": {
623
- "content": "<|reserved_token_72|>",
624
- "lstrip": false,
625
- "normalized": false,
626
- "rstrip": false,
627
- "single_word": false,
628
- "special": true
629
- },
630
- "78": {
631
- "content": "<|reserved_token_73|>",
632
- "lstrip": false,
633
- "normalized": false,
634
- "rstrip": false,
635
- "single_word": false,
636
- "special": true
637
- },
638
- "79": {
639
- "content": "<|reserved_token_74|>",
640
- "lstrip": false,
641
- "normalized": false,
642
- "rstrip": false,
643
- "single_word": false,
644
- "special": true
645
- },
646
- "80": {
647
- "content": "<|reserved_token_75|>",
648
- "lstrip": false,
649
- "normalized": false,
650
- "rstrip": false,
651
- "single_word": false,
652
- "special": true
653
- },
654
- "81": {
655
- "content": "<|reserved_token_76|>",
656
- "lstrip": false,
657
- "normalized": false,
658
- "rstrip": false,
659
- "single_word": false,
660
- "special": true
661
- },
662
- "82": {
663
- "content": "<|reserved_token_77|>",
664
- "lstrip": false,
665
- "normalized": false,
666
- "rstrip": false,
667
- "single_word": false,
668
- "special": true
669
- },
670
- "83": {
671
- "content": "<|reserved_token_78|>",
672
- "lstrip": false,
673
- "normalized": false,
674
- "rstrip": false,
675
- "single_word": false,
676
- "special": true
677
- },
678
- "84": {
679
- "content": "<|reserved_token_79|>",
680
- "lstrip": false,
681
- "normalized": false,
682
- "rstrip": false,
683
- "single_word": false,
684
- "special": true
685
- },
686
- "85": {
687
- "content": "<|reserved_token_80|>",
688
- "lstrip": false,
689
- "normalized": false,
690
- "rstrip": false,
691
- "single_word": false,
692
- "special": true
693
- },
694
- "86": {
695
- "content": "<|reserved_token_81|>",
696
- "lstrip": false,
697
- "normalized": false,
698
- "rstrip": false,
699
- "single_word": false,
700
- "special": true
701
- },
702
- "87": {
703
- "content": "<|reserved_token_82|>",
704
- "lstrip": false,
705
- "normalized": false,
706
- "rstrip": false,
707
- "single_word": false,
708
- "special": true
709
- },
710
- "88": {
711
- "content": "<|reserved_token_83|>",
712
- "lstrip": false,
713
- "normalized": false,
714
- "rstrip": false,
715
- "single_word": false,
716
- "special": true
717
- },
718
- "89": {
719
- "content": "<|reserved_token_84|>",
720
- "lstrip": false,
721
- "normalized": false,
722
- "rstrip": false,
723
- "single_word": false,
724
- "special": true
725
- },
726
- "90": {
727
- "content": "<|reserved_token_85|>",
728
- "lstrip": false,
729
- "normalized": false,
730
- "rstrip": false,
731
- "single_word": false,
732
- "special": true
733
- },
734
- "91": {
735
- "content": "<|reserved_token_86|>",
736
- "lstrip": false,
737
- "normalized": false,
738
- "rstrip": false,
739
- "single_word": false,
740
- "special": true
741
- },
742
- "92": {
743
- "content": "<|reserved_token_87|>",
744
- "lstrip": false,
745
- "normalized": false,
746
- "rstrip": false,
747
- "single_word": false,
748
- "special": true
749
- },
750
- "93": {
751
- "content": "<|reserved_token_88|>",
752
- "lstrip": false,
753
- "normalized": false,
754
- "rstrip": false,
755
- "single_word": false,
756
- "special": true
757
- },
758
- "94": {
759
- "content": "<|reserved_token_89|>",
760
- "lstrip": false,
761
- "normalized": false,
762
- "rstrip": false,
763
- "single_word": false,
764
- "special": true
765
- },
766
- "95": {
767
- "content": "<|reserved_token_90|>",
768
- "lstrip": false,
769
- "normalized": false,
770
- "rstrip": false,
771
- "single_word": false,
772
- "special": true
773
- },
774
- "96": {
775
- "content": "<|reserved_token_91|>",
776
- "lstrip": false,
777
- "normalized": false,
778
- "rstrip": false,
779
- "single_word": false,
780
- "special": true
781
- },
782
- "97": {
783
- "content": "<|reserved_token_92|>",
784
- "lstrip": false,
785
- "normalized": false,
786
- "rstrip": false,
787
- "single_word": false,
788
- "special": true
789
- },
790
- "98": {
791
- "content": "<|reserved_token_93|>",
792
- "lstrip": false,
793
- "normalized": false,
794
- "rstrip": false,
795
- "single_word": false,
796
- "special": true
797
- },
798
- "99": {
799
- "content": "<|reserved_token_94|>",
800
- "lstrip": false,
801
- "normalized": false,
802
- "rstrip": false,
803
- "single_word": false,
804
- "special": true
805
- },
806
- "100": {
807
- "content": "<|reserved_token_95|>",
808
- "lstrip": false,
809
- "normalized": false,
810
- "rstrip": false,
811
- "single_word": false,
812
- "special": true
813
- },
814
- "101": {
815
- "content": "<|reserved_token_96|>",
816
- "lstrip": false,
817
- "normalized": false,
818
- "rstrip": false,
819
- "single_word": false,
820
- "special": true
821
- },
822
- "102": {
823
- "content": "<|reserved_token_97|>",
824
- "lstrip": false,
825
- "normalized": false,
826
- "rstrip": false,
827
- "single_word": false,
828
- "special": true
829
- },
830
- "103": {
831
- "content": "<|reserved_token_98|>",
832
- "lstrip": false,
833
- "normalized": false,
834
- "rstrip": false,
835
- "single_word": false,
836
- "special": true
837
- },
838
- "104": {
839
- "content": "\\r",
840
- "lstrip": false,
841
- "normalized": false,
842
- "rstrip": false,
843
- "single_word": false,
844
- "special": false
845
- },
846
- "105": {
847
- "content": "▁▁",
848
- "lstrip": false,
849
- "normalized": false,
850
- "rstrip": false,
851
- "single_word": false,
852
- "special": false
853
- },
854
- "106": {
855
- "content": "▁▁▁",
856
- "lstrip": false,
857
- "normalized": false,
858
- "rstrip": false,
859
- "single_word": false,
860
- "special": false
861
- },
862
- "107": {
863
- "content": "▁▁▁▁",
864
- "lstrip": false,
865
- "normalized": false,
866
- "rstrip": false,
867
- "single_word": false,
868
- "special": false
869
- },
870
- "108": {
871
- "content": "▁▁▁▁▁",
872
- "lstrip": false,
873
- "normalized": false,
874
- "rstrip": false,
875
- "single_word": false,
876
- "special": false
877
- },
878
- "109": {
879
- "content": "▁▁▁▁▁▁",
880
- "lstrip": false,
881
- "normalized": false,
882
- "rstrip": false,
883
- "single_word": false,
884
- "special": false
885
- },
886
- "110": {
887
- "content": "▁▁▁▁▁▁▁",
888
- "lstrip": false,
889
- "normalized": false,
890
- "rstrip": false,
891
- "single_word": false,
892
- "special": false
893
- },
894
- "111": {
895
- "content": "▁▁▁▁▁▁▁▁",
896
- "lstrip": false,
897
- "normalized": false,
898
- "rstrip": false,
899
- "single_word": false,
900
- "special": false
901
- },
902
- "112": {
903
- "content": "▁▁▁▁▁▁▁▁▁",
904
- "lstrip": false,
905
- "normalized": false,
906
- "rstrip": false,
907
- "single_word": false,
908
- "special": false
909
- },
910
- "113": {
911
- "content": "▁▁▁▁▁▁▁▁▁▁",
912
- "lstrip": false,
913
- "normalized": false,
914
- "rstrip": false,
915
- "single_word": false,
916
- "special": false
917
- },
918
- "114": {
919
- "content": "▁▁▁▁▁▁▁▁▁▁▁",
920
- "lstrip": false,
921
- "normalized": false,
922
- "rstrip": false,
923
- "single_word": false,
924
- "special": false
925
- },
926
- "115": {
927
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁",
928
- "lstrip": false,
929
- "normalized": false,
930
- "rstrip": false,
931
- "single_word": false,
932
- "special": false
933
- },
934
- "116": {
935
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁",
936
- "lstrip": false,
937
- "normalized": false,
938
- "rstrip": false,
939
- "single_word": false,
940
- "special": false
941
- },
942
- "117": {
943
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
944
- "lstrip": false,
945
- "normalized": false,
946
- "rstrip": false,
947
- "single_word": false,
948
- "special": false
949
- },
950
- "118": {
951
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
952
- "lstrip": false,
953
- "normalized": false,
954
- "rstrip": false,
955
- "single_word": false,
956
- "special": false
957
- },
958
- "119": {
959
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
960
- "lstrip": false,
961
- "normalized": false,
962
- "rstrip": false,
963
- "single_word": false,
964
- "special": false
965
- },
966
- "120": {
967
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
968
- "lstrip": false,
969
- "normalized": false,
970
- "rstrip": false,
971
- "single_word": false,
972
- "special": false
973
- },
974
- "121": {
975
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
976
- "lstrip": false,
977
- "normalized": false,
978
- "rstrip": false,
979
- "single_word": false,
980
- "special": false
981
- },
982
- "122": {
983
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
984
- "lstrip": false,
985
- "normalized": false,
986
- "rstrip": false,
987
- "single_word": false,
988
- "special": false
989
- },
990
- "123": {
991
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
992
- "lstrip": false,
993
- "normalized": false,
994
- "rstrip": false,
995
- "single_word": false,
996
- "special": false
997
- },
998
- "124": {
999
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
1000
- "lstrip": false,
1001
- "normalized": false,
1002
- "rstrip": false,
1003
- "single_word": false,
1004
- "special": false
1005
- },
1006
- "125": {
1007
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
1008
- "lstrip": false,
1009
- "normalized": false,
1010
- "rstrip": false,
1011
- "single_word": false,
1012
- "special": false
1013
- },
1014
- "126": {
1015
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
1016
- "lstrip": false,
1017
- "normalized": false,
1018
- "rstrip": false,
1019
- "single_word": false,
1020
- "special": false
1021
- },
1022
- "127": {
1023
- "content": "▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁",
1024
- "lstrip": false,
1025
- "normalized": false,
1026
- "rstrip": false,
1027
- "single_word": false,
1028
- "special": false
1029
- },
1030
- "128": {
1031
- "content": "\t\t",
1032
- "lstrip": false,
1033
- "normalized": false,
1034
- "rstrip": false,
1035
- "single_word": false,
1036
- "special": false
1037
- },
1038
- "129": {
1039
- "content": "\t\t\t",
1040
- "lstrip": false,
1041
- "normalized": false,
1042
- "rstrip": false,
1043
- "single_word": false,
1044
- "special": false
1045
- },
1046
- "130": {
1047
- "content": "\t\t\t\t",
1048
- "lstrip": false,
1049
- "normalized": false,
1050
- "rstrip": false,
1051
- "single_word": false,
1052
- "special": false
1053
- },
1054
- "131": {
1055
- "content": "\t\t\t\t\t",
1056
- "lstrip": false,
1057
- "normalized": false,
1058
- "rstrip": false,
1059
- "single_word": false,
1060
- "special": false
1061
- },
1062
- "132": {
1063
- "content": "\t\t\t\t\t\t",
1064
- "lstrip": false,
1065
- "normalized": false,
1066
- "rstrip": false,
1067
- "single_word": false,
1068
- "special": false
1069
- },
1070
- "133": {
1071
- "content": "\n\n",
1072
- "lstrip": false,
1073
- "normalized": false,
1074
- "rstrip": false,
1075
- "single_word": false,
1076
- "special": false
1077
- },
1078
- "134": {
1079
- "content": "\n\n\n",
1080
- "lstrip": false,
1081
- "normalized": false,
1082
- "rstrip": false,
1083
- "single_word": false,
1084
- "special": false
1085
- }
1086
- },
1087
- "additional_special_tokens": [
1088
- "<|im_start|>",
1089
- "<|im_end|>"
1090
- ],
1091
- "bos_token": "<s>",
1092
- "chat_template": "{%- if not date_string is defined %}{%- set date_string = \"2024-09-30\" %}{%- endif %}{{ \"<|im_start|>assistant\nI am Salamandra, an AI language model developed at the Barcelona Supercomputing Centre (BSC) by the Language Technologies Unit. My knowledge base was last updated on August 2023. Today Date: \"+ date_string +\"\nSoy Salamandra, un modelo lingüístico de IA desarrollado en el Barcelona Supercomputing Centre (BSC) por la Language Technologies Unit. Mi base de conocimientos se actualizó por última vez en agosto de 2023.\nSoc Salamandra, un model de llenguatge d'IA desenvolupat al Barcelona Supercomputing Centre (BSC) per la Language Technologies Unit. La meva base de coneixement es va actualitzar per última vegada l'agost de 2023.<|im_end|>\n\" }}{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
1093
- "clean_up_tokenization_spaces": false,
1094
- "eos_token": "</s>",
1095
- "legacy": true,
1096
- "model_max_length": 8192,
1097
- "pad_token": "<unk>",
1098
- "padding_side": "right",
1099
- "sp_model_kwargs": {},
1100
- "spaces_between_special_tokens": false,
1101
- "tokenizer_class": "LlamaTokenizer",
1102
- "unk_token": "<unk>",
1103
- "use_default_system_prompt": false
1104
- }