The Most Comprehensive and Detailed Flux User Manual: Learn Everything About Flux in 30 Minutes
Flux is the hottest image generation model recently. It's a 12B parameter model created by the former SD team who left StabilityAI to start their own venture, and it's been called the true SD3. Although the official bf16 version is 23G, making it challenging to use, both ComfyUI and Kijai have created fp8 versions of the model. These versions significantly reduce the memory and VRAM requirements while maintaining excellent image generation quality, making them worth trying.
This video is a very detailed guide to using Flux.
I'll start by introducing the Black Forest team that released the Flux model and their connection to Stable Diffusion—why is it called the true SD3?
Then, I'll discuss model selection: Why are there so many different models, and which one should we download? What are the system resource requirements for different models?
Next, we'll get prepared by updating ComfyUI and some plugins.
Then we'll move on to practical steps:
From a text-to-image perspective, I’ll explain how to use Flux in ComfyUI to generate the first image, the meaning of each node and its parameters, the different resolutions supported by Flux, testing Flux's understanding of prompts, and performing face refinement, face swapping, and upscaling.
For image-to-image generation, I’ll first demonstrate how to achieve anime style transfer, then perform partial redrawing using both Inpainting and Detailer methods.
At the end of the video, I'll cover the open-source community’s support for Flux, including Lora, ControlNet.
Flux Models:
Black Forest's schnell model: https://huggingface.co/black-forest-labs/FLUX.1-schnell/tree/main
Black Forest's dev model: https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/main
Comfy Org's dev model: https://huggingface.co/Comfy-Org/flux1-dev/tree/main
Comfy Org's schnell model: https://huggingface.co/Comfy-Org/flux1-schnell/tree/main
Kijai's dev and schnell models: https://huggingface.co/Kijai/flux-fp8/tree/main
Plugins involved:
https://github.com/kijai/ComfyUI-KJNodes
https://github.com/ltdrdata/ComfyUI-Impact-Pack
Workflows and models:
https://drive.google.com/drive/folders/1Sve6BeLSvRp8gXfLBiqOshE1nwRIgKYg?usp=shar