To run the model run the following code :
!pip install ctransformers[cuda]
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_pretrained("epsil/Tinyllama-1b-v1.0-gguf", model_file="Tinyllama-1b-v1.0.gguf")
print(llm("AI is going to"))
- Downloads last month
- 5
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support