Jingya/FLUX.1-Krea-dev-neuronx-tp8

Exported with (Inferentia 2 only):

optimum-cli export neuron --model black-forest-labs/FLUX.1-Krea-dev --tensor_parallel_size 8 --batch_size 1 --height 1024 --width 1024 --num_images_per_prompt 1 --sequence_length 512 --torch_dtype bfloat16 flux_krea_neuron_1024_tp8/

Inference

from optimum.neuron import NeuronFluxPipeline

pipe = NeuronFluxPipeline.from_pretrained("Jingya/FLUX.1-Krea-dev-neuronx-tp8")
prompt = "A frog holding a sign that says hello world"
image = pipe(
    prompt,
    guidance_scale=4.5,
).images[0]
image.save("flux-krea-dev.png")