Update README.md

README.md

@@ -27,7 +27,8 @@ tags:
 <Gallery />
 
 This is a fine-tune of the [THUDM/CogVideoX-5b](https://huggingface.co/THUDM/CogVideoX-5b) model on the
-[finetrainers/cakeify-smol](https://huggingface.co/datasets/finetrainers/cakeify-smol) dataset.
+[finetrainers/cakeify-smol](https://huggingface.co/datasets/finetrainers/cakeify-smol) dataset. We also provide
+a LoRA variant of the params. Check it out [here](#lora).
 
 Code: https://github.com/a-r-r-o-w/finetrainers
 
@@ -61,7 +62,35 @@ video = pipeline(
     width=768,
     num_inference_steps=50
 ).frames[0]
-export_to_video(video, "output_vase.mp4", fps=25)
+export_to_video(video, "output.mp4", fps=25)
 ```
 
-Training logs are available on WandB [here](https://wandb.ai/diffusion-guidance/finetrainers-cogvideox/runs/q7z660f3/).
+Training logs are available on WandB [here](https://wandb.ai/diffusion-guidance/finetrainers-cogvideox/runs/q7z660f3/).
+
+## LoRA
+
+We extracted a 64-rank LoRA from the finetuned checkpoint (script here). This LoRA can be used to emulate the same kind of effect:
+
+```py
+from diffusers import DiffusionPipeline 
+from diffusers.utils import export_to_video
+import torch 
+
+pipeline = DiffusionPipeline.from_pretrained("THUDM/CogVideoX-5b", torch_dtype=torch.bfloat16).to("cuda")
+pipeline.load_lora_weights("finetrainers/cakeify-v0", weight_name="extracted_cakeify_lora_64.safetensors")
+
+prompt = """
+PIKA_CAKEIFY On a gleaming glass display stand, a sleek black purse quietly commands attention. Suddenly, a knife appears and slices through the shoe, revealing a fluffy vanilla sponge at its core. Immediately, it turns into a hyper-realistic prop cake, delighting the senses with its playful juxtaposition of the everyday and the extraordinary.
+"""
+negative_prompt = "inconsistent motion, blurry motion, worse quality, degenerate outputs, deformed outputs"
+
+video = pipeline(
+    prompt=prompt, 
+    negative_prompt=negative_prompt, 
+    num_frames=81, 
+    height=512,
+    width=768,
+    num_inference_steps=50
+).frames[0]
+export_to_video(video, "output_lora.mp4", fps=25)
+```