Open-Sora
Collection
A Series of Open-Sora Models • 11 items • Updated • 10
How to use hpcai-tech/OpenSora-VAE-v1.2 with Transformers:
# Load model directly
from transformers import VideoAutoencoderPipeline
model = VideoAutoencoderPipeline.from_pretrained("hpcai-tech/OpenSora-VAE-v1.2", dtype="auto")
This repository stores the weights of the VAE released by the Open-Sora team. You can visit our project at:
The weights are released together with Open-Sora v1.2.
We recommend you to use this weights in the Open-Sora codebase. If you want to use VAE in your own project, you may use the following sample code.
opensorapip install git+https://github.com/hpcaitech/Open-Sora.git
STDiT3 in your own codefrom opensora.models.vae.vae import VideoAutoencoderPipeline
vae = VideoAutoencoderPipeline.from_pretrained("hpcai-tech/OpenSora-VAE-v1.2")
# Load model directly from transformers import VideoAutoencoderPipeline model = VideoAutoencoderPipeline.from_pretrained("hpcai-tech/OpenSora-VAE-v1.2", dtype="auto")