AlekseyCalvin commited on
Commit
4089f59
·
verified ·
1 Parent(s): f97a00d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +107 -0
README.md ADDED
@@ -0,0 +1,107 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - en
5
+ base_model:
6
+ - black-forest-labs/FLUX.1-dev
7
+ pipeline_tag: text-to-image
8
+ tags:
9
+ - flux
10
+ - FluxDev
11
+ - FluxPipeline
12
+ - Consistency
13
+ ---
14
+
15
+ HF Diffusers Conversion of the [Consistency-V3-Flux-D1](https://civitai.com/models/670244?modelVersionId=750282) model by [AbstractPhila](https://civitai.com/user/AbstractPhila).
16
+
17
+ **V3 Documentation *(by AbstractPhila)*:**
18
+ Tested primarily on the *FLUX.1 Dev e4m3fn* at fp8, so the prepared checkpoint merge will reflect this value when it's upload is complete. https://civitai.com/models/670244/consistency-v3-flux1d-fp8t5vae <br>
19
+ This runs on the base FLUX.1 Dev model, but it will work on other models, merges, and with other loras. The results will be mixed. Experiment with load order, as the model values shift in sequence in varying degrees.<br>
20
+ This is nothing short of a spine to FLUX. It empowers useful tags very similar to danbooru, to establish camera control and assistance that makes it much easier to make very customizable characters in situations that FLUX likely CAN DO, but it requires a great deal more effort to do most of these situations by default.<br>
21
+ I HIGHLY advise running a multiple loopback system to ensure image fidelity. Consistency improves quality and fidelity over multiple iterations.<br>
22
+ This is HEAVILY individual oriented. However, due to the way I structured the resolutions, it can handle MANY people in similar situations. The loras that cause immediate change on the screen without context will often be completely useless, as they generally do nothing to contribute to the context. The loras more specific to adding TRAITS to people or creating contextual interactions between people seem to work just fine. Clothing works, hair types work, gender control works. Most of the loras I tested work, but there are some that do nothing.<br>
23
+ This is not a merge. This is not a combination of loras. This lora was created using synthetic data generated from NAI and AutismPDXL over a period of a year. The image set is quite complex and the choice images used to create this one weren't easy to pick out. It took a lot of trial and error. Like an absolute ton of it.<br>
24
+ There is a SERIES of core tags introduced with this lora. It adds an entire backbone to FLUX that it simply doesn't have by default. The activation pattern is complex, but if you build your character similar to NAI, it'll appear similar to how NAI creates characters.
25
+
26
+ The potential and power of this model isn't to be understated. This is absolute powerhouse of a lora and it's potential is beyond my scope.<br>
27
+ It STILL can produce some abominations if you aren't careful. If you stick with standard prompting and you stick with a logical order, you should be building beautiful art in no time with it.<br>
28
+
29
+ Resolutions are: 512, 768, 816, 1024, 1216<br>
30
+ Suggested steps: 16<br>
31
+ FLUX guidance: 4 or 3-5 if it's stubborn, 15+ if it's very stubborn
32
+ CFG: 1<br>
33
+
34
+ I ran it with 2 loopbacks. The first being an upscale 1.05x and a denoise at 0.72-0.88, and the second being a denoise 0.8 almost never changed, depending how many traits I want introduced or removed.
35
+
36
+ **CORE TAG POOL:**
37
+ - anime - converts the styling of poses, characters, outfits, faces, and so on into anime
38
+ - realistic - converts the styling to realistic
39
+ - from front - a view from the front of a person, shoulder lined-up facing forward towards the viewer situation, where the center mass of the torso is facing the viewer.
40
+ - from side - a view from the side of a person, the shoulder vertical facing the viewer situation, where the shoulders are vertical meaning the character is from the side
41
+ - from behind - a view from directly behind the person
42
+ - straight-on - a straight-on vertical angling view, meant for a horizontal planar angle
43
+ - from above - a 45 to 90 degree tilt facing downward on an individual
44
+ - from below - a 45 to 90 degree tilt facing upward on an individual
45
+ - face - a face detail focused image, good for including face details specifically if they are stubborn
46
+ - full body - a full body view of an individual, good for more complex poses
47
+ - cowboy shot - the standard cowboy shot tag, works fairly well with anime, not so well with realism
48
+ - looking at viewer, looking to the side, looking ahead
49
+ - facing to the side, facing the viewer, facing away
50
+ - looking back, looking forward
51
+
52
+ ***Mixed tags** create the intended mixed results, but they have mixed outcomes:*
53
+ - from side, straight-on - a horizontal planar camera aimed at the side of individual or individuals
54
+ - from front, from above - 45 degree tilt facing downward from camera above front
55
+ - from side, from above - 45 degree tilt facing downward from camera above side
56
+ - from behind, from above - 45 degree tilt facing downward from camera above behind
57
+ - from front, from below
58
+ - from front, from above
59
+ - from front, straight-on
60
+ - from front, from side, from above
61
+ - from front from side, from below
62
+ - from front from side, straight-on
63
+ - from behind, from side, from above
64
+ - from behind, from side, from below
65
+ - from behind, from side, straight-on
66
+ - from side, from behind, from above
67
+ - from side, from behind, from below
68
+ - from side, from behind, straight-on
69
+
70
+ *Those tags may seem similar, but the order will often create very distinctly different outcomes.*
71
+ *Using the* "from behind" *tag ahead of the* "from side" *will, for example, weight the system towards* "behind" *rather than* "side"*, but you'll often see the upper torso twisting and the body angling 45 degrees in either direction...*
72
+ *The outcome is mixed, but it's definitely workable.*
73
+
74
+ ***Traits, coloration, clothes, and so on** also work:*
75
+ - red hair, blue hair, green hair, white hair, black hair, gold hair, silver hair, blonde hair, brown hair, purple hair, pink hair, aqua hair
76
+ - red eyes, blue eyes, green eyes, white eyes, black eyes, gold eyes, silver eyes, yellow eyes, brown eyes, purple eyes, pink eyes, aqua eyes
77
+ - red latex bodysuit, blue latex bodysuit, green latex bodysuit, black latex bodysuit, white latex bodysuit, gold latex bodysuit, silver latex bodysuit, yellow latex bodysuit, brown latex bodysuit, purple latex bodysuit
78
+ - red bikini, blue bikini, green bikini, black bikini, white bikini, yellow bikini, brown bikini, purple bikini, pink bikini
79
+ - red dress, blue dress, green dress, black dress, white dress, yellow dress, brown dress, pink dress, purple dress
80
+ - skirts, shirts, dresses, necklaces, full outfits
81
+ - multiple materials; latex, metallic, denim, cotton, and so on
82
+ *Poses may or may not work in conjunction with the camera, may need tinkering:*
83
+ - all fours
84
+ - kneeling
85
+ - lying
86
+ - lying, on back
87
+ - lying, on side
88
+ - lying, upside down
89
+ - kneeling, from behind
90
+ - kneeling, from front
91
+ - kneeling, from side
92
+ - squatting
93
+ - squatting, from behind
94
+ - squatting, from front
95
+ - squatting, from side
96
+ *Controlling **legs and such** can be really picky, so play with them a bit:*
97
+ - legs
98
+ - legs together
99
+ - legs apart
100
+ - legs spread
101
+ - feet together
102
+ - feet apart
103
+
104
+ ***Hundreds of other tags used and included, millions of potential combinations!***
105
+
106
+ ***Use them** in conjunction ahead of any specifiers for a person's traits, but **after the prompt for Flux itself**.*
107
+