|
|
--- |
|
|
pipeline_tag: text-to-image |
|
|
tags: |
|
|
- LoRA |
|
|
- stable-diffusion |
|
|
- diffusers |
|
|
- stable-diffusion-diffusers |
|
|
--- |
|
|
|
|
|
# Totoro LoRA text2image fine-tuning |
|
|
These are LoRA adaption weights for nitrosocke/Ghibli-Diffusion. |
|
|
|
|
|
```python |
|
|
pipe = StableDiffusionPipeline.from_pretrained( |
|
|
model_id, |
|
|
torch_dtype=torch.float16, |
|
|
safety_checker=None, |
|
|
) |
|
|
pipe.enable_xformers_memory_efficient_attention() |
|
|
pipe.load_lora_weights(./lora_weights) |
|
|
pipe = pipe.to('cuda') |
|
|
|
|
|
image = pipe( |
|
|
prompt='Totoro', |
|
|
num_inference_steps=66, |
|
|
guidance_scale=6.9, |
|
|
cross_attention_kwargs={'scale': 0.6 }, |
|
|
).images[0] |
|
|
``` |
|
|
|
|
|
 |
|
|
 |
|
|
 |
|
|
 |
|
|
 |
|
|
 |
|
|
 |
|
|
 |
|
|
 |
|
|
 |
