add gptq

README.md

@@ -13,6 +13,7 @@ tags:
 - function calling
 - sharded
 - ggml
+- gptq
 ---
 # fLlama 2 - Function Calling Llama 2
 
@@ -20,7 +21,7 @@ tags:
 - The model responds with a structured json argument with the function name and arguments
 
 Available models:
-- fLlama-7B ([bitsandbytes NF4](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling)), ([GGML](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling-GGML)) - free
+- fLlama-7B ([bitsandbytes NF4](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling)), ([GGML](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling-GGML)), ([GPTQ](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ)) - free
 - fLlama-13B ([bitsandbytes NF4](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling)) - paid
 
 ## Inference with Google Colab and HuggingFace 🤗