Sulkin commited on
Commit
5626b8b
·
verified ·
1 Parent(s): 1af3651

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +76 -1
  2. config.yaml +42 -42
  3. lora.safetensors +3 -0
README.md CHANGED
@@ -2,4 +2,79 @@
2
  license: other
3
  license_name: flux-1-dev-non-commercial-license
4
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: other
3
  license_name: flux-1-dev-non-commercial-license
4
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
5
+ language:
6
+ - en
7
+ tags:
8
+ - flux
9
+ - diffusers
10
+ - lora
11
+ - replicate
12
+ base_model: "black-forest-labs/FLUX.1-dev"
13
+ pipeline_tag: text-to-image
14
+ # widget:
15
+ # - text: >-
16
+ # prompt
17
+ # output:
18
+ # url: https://...
19
+ instance_prompt: Sulkin
20
+ ---
21
+
22
+ # Sulkin_Lora
23
+
24
+ <Gallery />
25
+
26
+ ## About this LoRA
27
+
28
+ This is a [LoRA](https://replicate.com/docs/guides/working-with-loras) for the FLUX.1-dev text-to-image model. It can be used with diffusers or ComfyUI.
29
+
30
+ It was trained on [Replicate](https://replicate.com/) using AI toolkit: https://replicate.com/ostris/flux-dev-lora-trainer/train
31
+
32
+
33
+ ## Trigger words
34
+
35
+ You should use `Sulkin` to trigger the image generation.
36
+
37
+
38
+ ## Run this LoRA with an API using Replicate
39
+
40
+ ```py
41
+ import replicate
42
+
43
+ input = {
44
+ "prompt": "Sulkin",
45
+ "lora_weights": "https://huggingface.co/Sulkin/Sulkin_Lora/resolve/main/lora.safetensors"
46
+ }
47
+
48
+ output = replicate.run(
49
+ "black-forest-labs/flux-dev-lora",
50
+ input=input
51
+ )
52
+ for index, item in enumerate(output):
53
+ with open(f"output_{index}.webp", "wb") as file:
54
+ file.write(item.read())
55
+ ```
56
+
57
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
58
+
59
+ ```py
60
+ from diffusers import AutoPipelineForText2Image
61
+ import torch
62
+
63
+ pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
64
+ pipeline.load_lora_weights('Sulkin/Sulkin_Lora', weight_name='lora.safetensors')
65
+ image = pipeline('Sulkin').images[0]
66
+ ```
67
+
68
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
69
+
70
+
71
+ ## Training details
72
+
73
+ - Steps: 2000
74
+ - Learning rate: 0.0004
75
+ - LoRA rank: 16
76
+
77
+
78
+ ## Contribute your own examples
79
+
80
+ You can use the [community tab](https://huggingface.co/Sulkin/Sulkin_Lora/discussions) to add images that show off what you’ve made with this LoRA.
config.yaml CHANGED
@@ -1,60 +1,60 @@
 
1
  config:
2
  name: flux_train_replicate
3
  process:
4
- - datasets:
5
- - cache_latents_to_disk: true
6
- caption_dropout_rate: 0.05
7
- caption_ext: txt
8
- folder_path: input_images
9
- resolution:
10
- - 512
11
- - 768
12
- - 1024
13
- shuffle_tokens: false
14
  device: cuda:0
15
- model:
16
- is_flux: true
17
- name_or_path: black-forest-labs/FLUX.1-schnell
18
- quantize: true
19
  network:
 
20
  linear: 16
21
  linear_alpha: 16
22
- type: lora
23
- sample:
24
- guidance_scale: 4
25
- height: 1024
26
- neg: ''
27
- prompts:
28
- - a sign that says 'I LOVE PROMPTS!' in the style of [trigger]
29
- sample_every: 250
30
- sample_steps: 20
31
- sampler: flowmatch
32
- seed: 42
33
- walk_seed: true
34
- width: 1024
35
  save:
36
  dtype: float16
 
37
  max_step_saves_to_keep: 1
38
- save_every: 1001
 
 
 
 
 
 
 
 
 
 
39
  train:
40
  batch_size: 1
41
- content_or_style: balanced
42
- dtype: bf16
43
- ema_config:
44
- ema_decay: 0.99
45
- use_ema: true
46
  gradient_accumulation_steps: 1
47
- gradient_checkpointing: true
48
- lr: 0.0004
 
 
49
  noise_scheduler: flowmatch
50
  optimizer: adamw8bit
51
- steps: 1000
52
- train_text_encoder: false
53
- train_unet: true
54
- training_folder: output
55
- trigger_word: TOK
56
- type: sd_trainer
57
- job: extension
 
 
 
 
 
 
 
 
 
 
 
 
 
58
  meta:
59
  name: flux_train_replicate
60
  version: '1.0'
 
1
+ job: custom_job
2
  config:
3
  name: flux_train_replicate
4
  process:
5
+ - type: custom_sd_trainer
6
+ training_folder: output
 
 
 
 
 
 
 
 
7
  device: cuda:0
8
+ trigger_word: Sulkin
 
 
 
9
  network:
10
+ type: lora
11
  linear: 16
12
  linear_alpha: 16
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  save:
14
  dtype: float16
15
+ save_every: 2001
16
  max_step_saves_to_keep: 1
17
+ datasets:
18
+ - folder_path: input_images
19
+ caption_ext: txt
20
+ caption_dropout_rate: 0.05
21
+ shuffle_tokens: false
22
+ cache_latents_to_disk: false
23
+ cache_latents: true
24
+ resolution:
25
+ - 512
26
+ - 768
27
+ - 1024
28
  train:
29
  batch_size: 1
30
+ steps: 2000
 
 
 
 
31
  gradient_accumulation_steps: 1
32
+ train_unet: true
33
+ train_text_encoder: false
34
+ content_or_style: balanced
35
+ gradient_checkpointing: false
36
  noise_scheduler: flowmatch
37
  optimizer: adamw8bit
38
+ lr: 0.0004
39
+ ema_config:
40
+ use_ema: true
41
+ ema_decay: 0.99
42
+ dtype: bf16
43
+ model:
44
+ name_or_path: FLUX.1-dev
45
+ is_flux: true
46
+ quantize: false
47
+ sample:
48
+ sampler: flowmatch
49
+ sample_every: 2001
50
+ width: 1024
51
+ height: 1024
52
+ prompts: []
53
+ neg: ''
54
+ seed: 42
55
+ walk_seed: true
56
+ guidance_scale: 3.5
57
+ sample_steps: 28
58
  meta:
59
  name: flux_train_replicate
60
  version: '1.0'
lora.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5241869efa932f389dcfcbc189363245830f5975a4af2038b4e798cb9f951cd5
3
+ size 171969416