AI & ML interests
Efficient machine learning for any model and hardware: pruning, quantization, compilation, and more.
Recent Activity
Articles
Organization Card
🌍 Join the Pruna AI community!
💜 Make AI models faster, cheaper, smaller, greener!
Pruna AI makes AI models faster, cheaper, smaller, and greener with the pruna package.
- It supports various models, including CV, NLP, audio, and graphs for predictive and generative AI.
- It supports various hardware, including GPU, CPU, Edge.
- It supports various compression algorithms, including quantization, pruning, distillation, caching, recovery, compilation, or factorization, among others.
- You can combine algorithms to find the optimal configuration and smash/compress your model.
- You can evaluate reliable quality and efficiency metrics of your base vs smashed/compressed models.
Set it up in minutes and compress your first models in a few lines of code!
⏩ How to get started?
You can smash your own models by installing pruna with pip:
pip install pruna
You can start with simple notebooks to experience efficiency gains with:
| Use Case | Free Notebooks |
|---|---|
| 3x Faster Stable Diffusion Models | ⏩ Smash for free |
| Making your LLMs 4x smaller | ⏩ Smash for free |
| Smash your model with a CPU only | ⏩ Smash for free |
| Transcribe 2 hours of audio in less than 2 minutes with Whisper | ⏩ Smash for free |
| 100% faster Whisper Transcription | ⏩ Smash for free |
| Run your Flux model without an A100 | ⏩ Smash for free |
| x2 smaller Sana in action | ⏩ Smash for free |
For more details on installation and free tutorials, check the Pruna AI documentation.
✨ Test our Performance Models
Want to use our optimized models right away? Try them via our API for fast, easy access to Pruna-powered inference.
Train LoRAs at https://replicate.com/prunaai/p-image-edit-trainer. Use LoRAs here: https://replicate.com/prunaai/p-image-edit-lora
-
PrunaAI/p-image-edit-dotted-illustration-lora
Image-to-Image • Updated • 25 -
PrunaAI/p-image-edit-photo-enhancement-lora
Image-to-Image • Updated • 33 -
PrunaAI/p-image-edit-skin-retouching-lora
Image-to-Image • Updated • 83 • 1 -
PrunaAI/p-image-edit-photo-to-anime-lora
Image-to-Image • Updated • 55 • 1
Train LoRAs at https://replicate.com/prunaai/p-image-edit-trainer. Use LoRAs here: https://replicate.com/prunaai/p-image-edit-lora
-
PrunaAI/p-image-edit-dotted-illustration-lora
Image-to-Image • Updated • 25 -
PrunaAI/p-image-edit-photo-enhancement-lora
Image-to-Image • Updated • 33 -
PrunaAI/p-image-edit-skin-retouching-lora
Image-to-Image • Updated • 83 • 1 -
PrunaAI/p-image-edit-photo-to-anime-lora
Image-to-Image • Updated • 55 • 1
Train LoRAs at https://replicate.com/prunaai/p-image-trainer. Use LoRAs here: https://replicate.com/prunaai/p-image-lora
models 160
PrunaAI/PrunaVAED
Text-to-Video • Updated • 64
PrunaAI/ATH-MaaS-Marco-o1-HQQ-8bit-smashed
Updated • 10
PrunaAI/ATH-MaaS-Marco-o1-HQQ-4bit-smashed
Updated • 4
PrunaAI/WeiboAI-VibeThinker-3B-HQQ-8bit-smashed
Updated • 8
PrunaAI/WeiboAI-VibeThinker-3B-HQQ-4bit-smashed
Updated • 8 • 1
PrunaAI/openbmb-MiniCPM5-1B-HQQ-8bit-smashed
Updated • 7 • 1
PrunaAI/openbmb-MiniCPM5-1B-HQQ-4bit-smashed
Updated • 12
PrunaAI/NexaAI-octo-net-HQQ-8bit-smashed
Updated • 5
PrunaAI/NexaAI-octo-net-HQQ-4bit-smashed
Updated • 5
PrunaAI/ibm-granite-granite-4.1-8b-HQQ-8bit-smashed
Updated • 7