Skip to content

ComfyNodePRs/PR-ComfyUI-Fluxtapoz-91c48fe5

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ComfyUI-Fluxtapoz (WIP)

A set of nodes for editing images using Flux in ComfyUI

Examples

See example_workflows directory for examples.

No ControlNets are used in any of the following examples.

Rectified Flow Inversion (Unsampling from RF Inversion)

Admittedly this has some small differences between the example images in the paper, but it's very close. Will be updating as I find the issue. It's currently my recommended way to unsample an image for editing or style transfer.

Use this workflow for RF-Inversion.

rf_inversion

Update [2024.10.16]

Stylization now works! rf_inversion_stylization

It can also be used to mix or style images (although I'm still working out the settings for this) rf_inverse_mix

Node Parameters

Outverse Flux Model Pred Node

  • Ensure "reverse_ode" is set to True on the "Outverse Flux Model Pred" node. Sometimes when users upgrade this repo it doesn't load the workflow correctly.

Flux Reverse ODE Sampler

  • latent_image -- the image to guide the sampling
  • start_step -- the step that the sampler starts guiding the sampling towards the image in "latent_image"
  • end_step -- the last step for guiding the sampling (not inclusive)
  • eta -- the strength of the guidance. The paper does not decrease this below 0.7
  • eta_trend -- how the eta should increase/decrease/stay constant between start_step and end_step

Flux Forward ODE Sampler

  • gamma -- the paper leaves this at 0.5

Guidance Suggestions

  • For sampling normal flux guidance works (~3.5)
  • For unsampling use 0

Common Issues

  • Overlayed images -- try changing your start step and/or Eta. A start step that is too late won't be able to influence the image generation properly
  • Blurry Results -- try lowering denoise to around 0.9 on the sampler (not the unsampling sampler) or increase the unsampling steps (this should be fixed)
  • Not following edits -- try fewer steps (change start/end step) or lower eta

Other Inversion Techniques

Inverse Noise (unsampling via DDIM)

unsampling_example

Inject Inversed Noise

See example workflow for how to use this one. It's similar to inverse noise/unsampling, but has better adherence to the input image.

inject_inversed_noise_example inject_unsampled_noise_cowboy

Reference Sampling (WIP)

This is a different implementation than TDS' and is experimental. Some results can turn out blurry and it is difficult to control. See the updated workflow json for the latest test. Results are typically not good.

ComfyUI_temp_tpfdf_00010_

wolf_ref

anime_ref_example

About

Nodes for image juxtaposition for Flux in ComfyUI

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%