turboderp
/

Phi-3-mini-128k-instruct-exl2

Model card Files Files and versions

Phi-3-mini-128k-instruct-exl2 / README.md

turboderp's picture

Create README.md

5d9afba verified over 1 year ago

|

732 Bytes

EXL2 quants of Phi-3 mini 128k instruct

2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json