video-effects
Collection
Fine-tunes of open video generation models like CogVideoX to emulate cool video effects like "squish", "dissolve", "cakeify", etc. Pika inspired.
•
8 items
•
Updated
•
7
This is a LoRA fine-tune of the Lightricks/LTX-Video model on the finetrainers/crush-smol dataset.
Code: https://github.com/a-r-r-o-w/finetrainers
This is an experimental checkpoint and its poor generalization is well-known.
Inference code:
import torch
from diffusers import LTXPipeline
from diffusers.utils import export_to_video
pipe = LTXPipeline.from_pretrained(
"Lightricks/LTX-Video", torch_dtype=torch.bfloat16
).to("cuda")
pipe.load_lora_weights("my-awesome-name/my-awesome-lora", adapter_name="ltxv-lora")
pipe.set_adapters(["ltxv-lora"], [0.9])
video = pipe("<my-awesome-prompt>").frames[0]
export_to_video(video, "output.mp4", fps=8)
Training logs are available on WandB here.
Base model
Lightricks/LTX-Video