Optimum

Overview

🤗 Optimum Installation Quick tour Notebooks

Conceptual guides

Quantization

Nvidia

AMD

Intel

AWS Trainium/Inferentia

Google TPUs

for Intel Gaudi

ExecuTorch

Furiosa

ONNX Runtime

Exporters

Torch FX

LLM quantization

Utilities

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.27.0).

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

🤗 Optimum Furiosa

🤗 Optimum Furiosa is the interface between the 🤗 Transformers library and Furiosa NPUs Furiosa Warboy. It provides a set of tools enabling easy model loading and inference for different downstream tasks.

How-to guides

Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use 🤗 Optimum Furiosa to solve real-world problems.

Reference

Technical descriptions of how the classes and methods of 🤗 Optimum Furiosa work.

🤗 Optimum→