Difference between flux1-dev-Q4_0 flux1-dev-Q4_1

by vcringer - opened Aug 15, 2024

Aug 15, 2024

Hello,

I see too models landed today, namely flux1-dev-Q4_1.gguf, and flux1-dev-Q5_1.gguf. What are these models? And what is the difference between flux1-dev-Q4_0.gguf and flux1-dev-Q4_1.gguf? The Q5 variants?

Thanks

city96

Owner Aug 16, 2024

They're just different quantization types that I added later. See this old chart for reference

city96 changed discussion status to closed Aug 16, 2024

ThirdEye

Aug 17, 2024

which are recommended to use? (0 vs 1)

city96

Owner Aug 17, 2024

1 is slightly better quality than 0 but also larger in terms of size. Pick whichever fits your VRAM without having to use CPU lowvram offloading.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment