thedeoxen's picture
add library tag (#5)
8550ad7 verified
---
license: apache-2.0
base_model:
- black-forest-labs/FLUX.1-Kontext-dev
pipeline_tag: image-to-image
tags:
- flux
- depth
- controlnet
- kontext
- flux-kontext
- img2img
- image
- editing
- lora
library_name: diffusers
---
---
license: apache-2.0
base_model:
- black-forest-labs/FLUX.1-Kontext-dev
pipeline_tag: image-to-image
---
# Depth Reference Fusion LoRA
## 📝 Short description
A LoRA for **Flux Kontext Dev** that fuses a **reference image (left)** with a **depth map (right)**.
It preserves **identity and style** from the reference while following the pose and structure from the depth map.
**Trigger word:** `redepthkontext`
[Demo Video](https://youtu.be/cCwoPOkxq5c?si=T4tr3MWi7EUNJXIW)
![Input](https://huggingface.co/thedeoxen/FLUX.1-Kontext-dev-reference-depth-fusion-LORA/resolve/main/examples/1_a.png)
![Output](https://huggingface.co/thedeoxen/FLUX.1-Kontext-dev-reference-depth-fusion-LORA/resolve/main/examples/1_b.png)
---
### Example 2
![Input](https://huggingface.co/thedeoxen/FLUX.1-Kontext-dev-reference-depth-fusion-LORA/resolve/main/examples/2_a.png)
![Output](https://huggingface.co/thedeoxen/FLUX.1-Kontext-dev-reference-depth-fusion-LORA/resolve/main/examples/2_b.png)
---
### Example 3
![Input](https://huggingface.co/thedeoxen/FLUX.1-Kontext-dev-reference-depth-fusion-LORA/resolve/main/examples/3_a.png)
![Output](https://huggingface.co/thedeoxen/FLUX.1-Kontext-dev-reference-depth-fusion-LORA/resolve/main/examples/3_b.png)
---
## 📖 Extended description
This LoRA was primarily trained on **humans**, but it also works with **objects**.
Its main purpose is to **preserve identity** — facial features, clothing, or object characteristics — from the reference image, while adapting them to the pose and composition defined by the depth map.
---
## ⚙️ How to use
- Concatenate two images side by side:
- **Left:** reference image (person or object)
- **Right:** depth map (grayscale or silhouette)
- Add the trigger word **`redepthkontext`** in your prompt.
### ✅ Example prompt
redepthkontext change depth map to photo
---
## 🎯 What it does
- Preserves character or object **identity** across generations.
- Embeds the subject into the new pose/scene defined by the depth map.
- Works best when the depth map has **similar proportions and sizes** to the reference.
---
## ⚡ Tips
- Works better if the depth map is not drastically different in object scale.
- Can be combined with text prompts for additional background/environment control.
---
## 📌 Use cases
- Human portraits in different poses.
- Consistent character design across multiple scenes.
- Object transformations (cars, furniture, props) with depth-guided placement.
- Storyboarding, comics, or animation frame generation.