whitphx HF Staff commited on
Commit
37096d7
·
verified ·
1 Parent(s): 385b79f

Add/update the quantized ONNX model files and README.md for Transformers.js v3

Browse files

## Applied Quantizations

### ✅ Based on `decoder_model_merged.onnx` *with* slimming

↳ ✅ `fp16`: `decoder_model_merged_fp16.onnx` (replaced because it was invalid)
↳ ✅ `int8`: `decoder_model_merged_int8.onnx` (added)
↳ ✅ `uint8`: `decoder_model_merged_uint8.onnx` (added)
↳ ✅ `q4`: `decoder_model_merged_q4.onnx` (added)
↳ ✅ `q4f16`: `decoder_model_merged_q4f16.onnx` (added)
↳ ✅ `bnb4`: `decoder_model_merged_bnb4.onnx` (added)

onnx/decoder_model_merged_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4e3eca91380b623cebee29070f3c25febd9f4f3708f6fb6888f99df6b1208ca
3
+ size 177088140
onnx/decoder_model_merged_fp16.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:458129a45269c4f507f99249b98acfb27fbff16af389c227c8a0bb3482cd265f
3
- size 326176733
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3aff118527bd2d334acbc53e15b9ad7f8ea540ae75c8d19eee5dcb90f8f4e6a
3
+ size 325925282
onnx/decoder_model_merged_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d77def5beae48c8a47fc9656186420815ac1f862111f126b70001916acc70fd0
3
+ size 163663156
onnx/decoder_model_merged_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:097578e67493426afbf144223360ee9810791d2d50eb4a38a8e9c4dc396cd3d3
3
+ size 185706225
onnx/decoder_model_merged_q4f16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62b32274b3a06d19f48380fc51fcb2535555022516de4519877a9a3f4e9d357b
3
+ size 127699375
onnx/decoder_model_merged_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63e51a3a5a06ee5c59cfb5d8e216efde3240cb6dcb0759c7755ea2c1e51235c7
3
+ size 163663221