charlied98 commited on
Commit
a084237
·
verified ·
1 Parent(s): 283bd96

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/sample_0.gif filter=lfs diff=lfs merge=lfs -text
37
+ samples/sample_1.gif filter=lfs diff=lfs merge=lfs -text
38
+ samples/sample_2.gif filter=lfs diff=lfs merge=lfs -text
39
+ samples/sample_3.gif filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-video
4
+ - image-to-video
5
+ pinned: true
6
+ language:
7
+ - en
8
+ license: other
9
+ pipeline_tag: text-to-video
10
+ library_name: diffusers
11
+ ---
12
+
13
+ # ltxv_2b_lora_soft_draw_v1
14
+
15
+ This is a fine-tuned version of [`LTXV_2B_0.9.6_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-2b-0.9.6-dev-04-25.safetensors) trained on custom data.
16
+
17
+ ## Model Details
18
+
19
+ - **Base Model:** [`LTXV_2B_0.9.6_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-2b-0.9.6-dev-04-25.safetensors)
20
+ - **Training Type:** LoRA fine-tuning
21
+ - **Training Steps:** 3000
22
+ - **Learning Rate:** 0.0002
23
+ - **Batch Size:** 2
24
+
25
+ ## Sample Outputs
26
+
27
+ | | | | |
28
+ |:---:|:---:|:---:|:---:|
29
+ | ![example1](./samples/sample_0.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a snowy village square during a gentle snowfall, with twinkling holiday lights, warmly dressed people strolling past market stalls, and a large decorated tree at the center</details> | ![example2](./samples/sample_1.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a deep underwater scene with shafts of light breaking through the surface, illuminating coral reefs and schools of colorful fish swimming gracefully through the blue depths.</details> | ![example3](./samples/sample_2.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a dramatic cliffside overlooking a stormy sea, where crashing waves slam against the rocks below, and dark clouds churn above, hinting at an approaching tempest.</details> | ![example4](./samples/sample_3.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a peaceful rural farm at sunrise, with golden light spilling across open fields, a red barn in the distance, and a few grazing animals starting their day.</details> |
30
+
31
+ ## Usage
32
+
33
+ This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
34
+
35
+ ### 🔌 Using Trained LoRAs in ComfyUI
36
+ In order to use the trained lora in comfy:
37
+ 1. Copy your comfyui trained LoRA weights (`comfyui..safetensors` file) to the `models/loras` folder in your ComfyUI installation.
38
+ 2. In your ComfyUI workflow:
39
+ - Add the "LTXV LoRA Selector" node to choose your LoRA file
40
+ - Connect it to the "LTXV LoRA Loader" node to apply the LoRA to your generation
41
+
42
+ You can find reference Text-to-Video (T2V) and Image-to-Video (I2V) workflows in the [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo).
43
+
44
+ ### Example Prompts
45
+
46
+ Example prompts used during validation:
47
+
48
+ - `a snowy village square during a gentle snowfall, with twinkling holiday lights, warmly dressed people strolling past market stalls, and a large decorated tree at the center`
49
+ - `a deep underwater scene with shafts of light breaking through the surface, illuminating coral reefs and schools of colorful fish swimming gracefully through the blue depths.`
50
+ - `a dramatic cliffside overlooking a stormy sea, where crashing waves slam against the rocks below, and dark clouds churn above, hinting at an approaching tempest.`
51
+ - `a peaceful rural farm at sunrise, with golden light spilling across open fields, a red barn in the distance, and a few grazing animals starting their day.`
52
+
53
+
54
+
55
+ This model inherits the license of the base model ([`LTXV_2B_0.9.6_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-2b-0.9.6-dev-04-25.safetensors)).
56
+
57
+ ## Acknowledgments
58
+
59
+ - Base model by [Lightricks](https://huggingface.co/Lightricks)
60
+ - Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)
comfy_lora_weights_step_03000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15dd73230c93b1870bac418af5fe0d17c8c42742e5fac0aba07f08f558dba065
3
+ size 58780864
lora_weights_step_03000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:094a85345696820bc78cf7fa253da4f000c12264c284cbc35bbb7e46001962a2
3
+ size 58779104
samples/sample_0.gif ADDED

Git LFS Details

  • SHA256: 86ec97a2aed3d073e97f4acd2ec8c390bed6895e3cc8a0fe307f9690667c4cf4
  • Pointer size: 133 Bytes
  • Size of remote file: 11.5 MB
samples/sample_1.gif ADDED

Git LFS Details

  • SHA256: 050dfc6b3996dea60349c6592761f696690700b0079d5fd8060912abe5e3f14a
  • Pointer size: 132 Bytes
  • Size of remote file: 8.73 MB
samples/sample_2.gif ADDED

Git LFS Details

  • SHA256: d66976e143371f4599bf0aa74e24b1c42a4eececd41d799cf7d840b48155a3b8
  • Pointer size: 133 Bytes
  • Size of remote file: 11.9 MB
samples/sample_3.gif ADDED

Git LFS Details

  • SHA256: 653f478d720b8ea29effbf74bb24d53b6410695e93970036012efcec2175c2a4
  • Pointer size: 133 Bytes
  • Size of remote file: 11.8 MB