turboderp
/

Mixtral-8x22B-Instruct-v0.1-exl2

Model card Files Files and versions

Mixtral-8x22B-Instruct-v0.1-exl2 / README.md

turboderp's picture

Update README.md

a27acc0 verified over 1 year ago

|

581 Bytes

EXL2 quants of Mixtral 8x22B Instruct v0.1

More bitrates still cooking

2.30 bits per weight
4.50 bits per weight
5.00 bits per weight

measurement.json