mlabonne pcuenq HF Staff commited on
Commit
9297028
·
verified ·
1 Parent(s): 7d7fa49

Fix expected model inputs (#15)

Browse files

- Fix expected model inputs (8ab668ab6314429ce2e6fb984f12fd6229f2aa20)


Co-authored-by: Pedro Cuenca <[email protected]>

Files changed (1) hide show
  1. tokenizer_config.json +1 -0
tokenizer_config.json CHANGED
@@ -4064,6 +4064,7 @@
4064
  "eos_token": "<|im_end|>",
4065
  "extra_special_tokens": {},
4066
  "legacy": false,
 
4067
  "model_max_length": 1000000000000000019884624838656,
4068
  "pad_token": "<|pad|>",
4069
  "sp_model_kwargs": {},
 
4064
  "eos_token": "<|im_end|>",
4065
  "extra_special_tokens": {},
4066
  "legacy": false,
4067
+ "model_input_names": ["input_ids", "attention_mask"],
4068
  "model_max_length": 1000000000000000019884624838656,
4069
  "pad_token": "<|pad|>",
4070
  "sp_model_kwargs": {},