MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF · Discussions

Resources

View closed (3)

Interview request: genAI evaluation & documentation

#10 opened 12 months ago by

Add memory usage of each Quantization Methods

#9 opened about 1 year ago by

cant deploy on inference endpoint

#8 opened about 1 year ago by

Support for Function Calling?

#6 opened about 1 year ago by

OSError: MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

#5 opened about 1 year ago by

v3 tokenizer

#4 opened over 1 year ago by

Can you please also quantize Phi-3-SMALL!!!

#2 opened over 1 year ago by