Quickstart Guide¶
Note: For more advanced configurations, see the tutorial and options reference.
Model Quickstart Guides¶
| Model | Parameters | Guide |
|---|---|---|
| ACE-Step | 3.5B | ACE_STEP.md |
| Anima | Not specified | No dedicated guide |
| Auraflow | 6B | AURAFLOW.md |
| Boogu-Image | Not specified | BOOGU_IMAGE.md |
| Chroma 1 | 8.9B | CHROMA.md |
| Cosmos2 | 2B-14B | COSMOS2IMAGE.md |
| Cosmos3 | 16B-65B | COSMOS3.md |
| DeepFloyd IF | 0.4B-4.3B stages | No dedicated guide |
| ERNIE-Image | Not specified | ERNIE.md |
| Flux.1 | 8B-12B | FLUX.md FLUX_KONTEXT.md |
| Flux.2 | 4B-32B | FLUX2.md |
| HeartMuLa | 3B | HEARTMULA.md |
| HiDream | 17B (8.5B MoE) | HIDREAM.md |
| Hunyuan Video | 8.3B | HUNYUANVIDEO.md |
| Ideogram 4 | 9B | IDEOGRAM4.md |
| InfiniteTalk | 14B | INFINITETALK.md |
| Kandinsky 5.0 Image | 6B (lite) | KANDINSKY5_IMAGE.md |
| Kandinsky 5.0 Video | 2B lite, 19B pro | KANDINSKY5_VIDEO.md |
| Kwai Kolors | 2.7B | KOLORS.md |
| Krea2 | Not specified | KREA2.md |
| LongCat Image | 6B | LONGCAT_IMAGE.md LONGCAT_EDIT.md |
| LongCat Video | 13.6B | LONGCAT_VIDEO.md LONGCAT_VIDEO_EDIT.md |
| LTX Video | ~2.5B | LTXVIDEO.md |
| LTX Video 2 | 19B | LTXVIDEO2.md |
| Lumina2 | 2B | LUMINA2.md |
| Mage-Flow | 4B | MAGEFLOW.md |
| MiniMax H3 | 33B | MINIMAX_H3.md |
| MiniMax Music 3 | 2.4B transformer + 8B AR | MINIMAX_MUSIC.md |
| OmniGen | 3.8B | OMNIGEN.md |
| PixArt Sigma | 0.6B-0.9B | SIGMA.md |
| Qwen Image | 20B | QWEN_IMAGE.md QWEN_EDIT.md |
| Sana | 0.6B-4.8B | SANA.md |
| Sana Video | 2B | SANAVIDEO.md |
| SD 1.x/2.x (Legacy) | 0.9B | No dedicated guide |
| Stable Diffusion 3 | 2B-8B | SD3.md |
| Stable Diffusion XL | 3.5B | SDXL.md |
| Stable Cascade (Stage C) | 1B, 3.6B prior | STABLE_CASCADE_C.md |
| Wan Video | 1.3B-14B | WAN.md |
| Wan S2V | 14B | WAN_S2V.md |
| Z-Image | 6B | ZIMAGE.md |
| Z-Image Omni | 6B | ZIMAGE.md |
| ZLab I1 | 3B | ZLAB_i1.md |
Feature Compatibility¶
The complete compatibility matrix is split by feature area so each table stays readable.
Training support
| Model | PEFT LoRA | LyCORIS | Full-Rank | ControlNet | Ref Inputs | | --- | :---: | :---: | :---: | :---: | :---: | | ACE-Step | ✓ | ✓ | ✓* | ✗ | ✗ | | Anima | ✓ | ✓ | ✓* | ✗ | ✗ | | Auraflow | ✓ | ✓ | ✓* | ✓ | ✗ | | Boogu-Image | ✓ | ✓ | ✓* | ✗ | ✓ edit | | Chroma 1 | ✓ | ✓ | ✓* | ✗ | ✗ | | Cosmos2 | ✓ | ✓ | ✓ | ✗ | ✗ | | Cosmos3 | ✓ | ✓ | ✓* | ✗ | audio opt | | DeepFloyd IF | ✓ | ✓ | ✓ | ✗ | ✗ | | ERNIE-Image | ✓ | ✓ | ✓* | ✗ | ✗ | | Flux.1 | ✓ | ✓ | ✓* | ✓ | ✓ opt (Kontext) | | Flux.2 | ✓ | ✓ | ✓* | ✗ | ✓ opt | | HeartMuLa | ✓ | ✓ | ✓* | ✗ | ✗ | | HiDream | ✓ | ✓ | ✓* | ✓ | ✗ | | Hunyuan Video | ✓ | ✓ | ✓* | ✗ | ✓ I2V | | Ideogram 4 | ✓ | ✓ | ✓* | ✗ | ✗ | | InfiniteTalk | ✓ | ✓ | ✓* | ✗ | audio + I2V req | | Kandinsky 5.0 Image | ✓ | ✓ | ✓* | ✗ | ✓ I2I | | Kandinsky 5.0 Video | ✓ | ✓ | ✓* | ✗ | ✓ I2V | | Kwai Kolors | ✓ | ✓ | ✓ | ✗ | ✗ | | Krea2 | ✓ | ✓ | ✓* | ✗ | ✓ opt | | LongCat Image | ✓ | ✓ | ✓* | ✗ | ✓ req (Edit) | | LongCat Video | ✓ | ✓ | ✓* | ✗ | ✓ opt/edit | | LTX Video | ✓ | ✓ | ✓ | ✗ | ✓ I2V | | LTX Video 2 | ✓ | ✓ | ✓* | ✗ | ✓ opt | | Lumina2 | ✓ | ✓ | ✓ | ✗ | ✗ | | Mage-Flow | ✓ | ✓ | ✓* | ✗ | ✓ edit | | MiniMax H3 | ✓ | ✓ | ✓* | ✗ | ✓ opt (FL2VA/Ref2VA) | | MiniMax Music 3 | ✓ | ✓ | ✓* | ✗ | lyrics | | OmniGen | ✓ | ✓ | ✓ | ✗ | ✗ | | PixArt Sigma | ✗ | ✓ | ✓ | ✓ | ✗ | | Qwen Image | ✓ | ✓ | ✓* | ✗ | ✓ req (Edit) | | Sana | ✗ | ✓ | ✓ | ✗ | ✗ | | Sana Video | ✓ | ✓ | ✓ | ✗ | ✗ | | SD 1.x/2.x (Legacy) | ✓ | ✓ | ✓ | ✓ | ✗ | | Stable Diffusion 3 | ✓ | ✓ | ✓* | ✓ | ✗ | | Stable Diffusion XL | ✓ | ✓ | ✓ | ✓ | ✗ | | Stable Cascade (Stage C) | ✓ | ✓ | ✓* | ✗ | ✗ | | Wan Video | ✓ | ✓ | ✓* | ✗ | ✓ I2V/VACE | | Wan S2V | ✓ | ✓ | ✓* | ✗ | ✗ | | Z-Image | ✓ | ✓ | ✓* | ✗ | ✗ | | Z-Image Omni | ✓ | ✓ | ✓* | ✗ | ✓ opt (Edit) | | ZLab I1 | ✓ | ✓ | ✓ | ✗ | ✗ |Precision level support
| Model | Quantization | Mixed Precision | | --- | --- | --- | | ACE-Step | int8 optional | bf16 | | Anima | not specified | bf16 | | Auraflow | int8/fp8/nf4 optional | bf16 | | Boogu-Image | fp8 optional | bf16 | | Chroma 1 | int8/fp8/nf4 optional | bf16 | | Cosmos2 | int8 optional | bf16 | | Cosmos3 | no_change first; int8 optional | bf16 | | DeepFloyd IF | not recommended | bf16 | | ERNIE-Image | int8 optional | bf16 | | Flux.1 | int8/fp8/nf4 optional | bf16 | | Flux.2 | int8/fp8/nf4 optional | bf16 | | HeartMuLa | int8 optional | bf16 | | HiDream | int8/fp8/nf4 optional | bf16 | | Hunyuan Video | int8 optional | bf16 | | Ideogram 4 | fp8 default, nf4 optional | bf16 | | InfiniteTalk | int8 optional | bf16 | | Kandinsky 5.0 Image | int8 optional | bf16 | | Kandinsky 5.0 Video | int8 optional | bf16 | | Kwai Kolors | not recommended | bf16 | | Krea2 | int8 optional | bf16 | | LongCat Image | int8/fp8 optional | bf16 | | LongCat Video | int8/fp8 optional | bf16 | | LTX Video | int8/fp8 optional | bf16 | | LTX Video 2 | int8/fp8 optional | bf16 | | Lumina2 | int8 optional | bf16 | | Mage-Flow | fp8 optional | bf16 | | MiniMax H3 | int8/fp8 optional; convrot-int8 | bf16 | | MiniMax Music 3 | int8 optional | bf16 | | OmniGen | int8/fp8 optional | bf16 | | PixArt Sigma | int8 optional | bf16 | | Qwen Image | required (int8/nf4) | bf16 | | Sana | int8 optional | bf16 | | Sana Video | not recommended for full | bf16 | | SD 1.x/2.x (Legacy) | int8/nf4 optional | bf16 | | Stable Diffusion 3 | int8/fp8/nf4 optional | bf16 | | Stable Diffusion XL | int8/nf4 optional | bf16 | | Stable Cascade (Stage C) | not supported | fp32 required | | Wan Video | int8 optional | bf16 | | Wan S2V | int8 optional | bf16 | | Z-Image | int8 optional | bf16 | | Z-Image Omni | int8 optional | bf16 | | ZLab I1 | int8 optional | bf16 |Checkpointing granularity
| Model | Gradient Checkpoint | Interval | Segment Stride | Attention Offload | | --- | :---: | :---: | :---: | :---: | | ACE-Step | ✓ | ✓ | ✓ | ✗ | | Anima | ✓ | ✗ | ✗ | ✗ | | Auraflow | ✓ | ✓ | ✓ | ✗ | | Boogu-Image | ✓ | ✓ | ✓ | ✗ | | Chroma 1 | ✓ | ✓ | ✓ | ✓ | | Cosmos2 | ✓ | ✓ | ✓ | ✗ | | Cosmos3 | ✓ | ✓ | ✓ | ✗ | | DeepFloyd IF | ✓ | ✗ | ✗ | ✗ | | ERNIE-Image | ✓ | ✓ | ✓ | ✗ | | Flux.1 | ✓ | ✓ | ✓ | ✓ | | Flux.2 | ✓ | ✓ | ✓ | ✓ | | HeartMuLa | ✓ | ✗ | ✗ | ✗ | | HiDream | ✓ | ✓ | ✓ | ✗ | | Hunyuan Video | ✓ | ✓ | ✓ | ✓ | | Ideogram 4 | ✓ | ✓ | ✓ | ✗ | | InfiniteTalk | ✓ | ✓ | ✓ | ✓ | | Kandinsky 5.0 Image | ✓ | ✓ | ✓ | ✓ | | Kandinsky 5.0 Video | ✓ | ✓ | ✓ | ✓ | | Kwai Kolors | ✓ | ✗ | ✗ | ✗ | | Krea2 | ✓ | ✓ | ✓ | ✓ | | LongCat Image | ✓ | ✓ | ✓ | ✓ | | LongCat Video | ✓ | ✓ | ✓ | ✓ | | LTX Video | ✓ | ✓ | ✓ | ✗ | | LTX Video 2 | ✓ | ✓ | ✓ | ✓ | | Lumina2 | ✓ | ✓ | ✓ | ✗ | | Mage-Flow | ✓ | ✓ | ✓ | ✓ | | MiniMax H3 | ✓ | ✓ | ✓ | ✓ | | MiniMax Music 3 | ✓ | ✓ | ✓ | ✗ | | OmniGen | ✓ | ✗ | ✗ | ✗ | | PixArt Sigma | ✓ | ✓ | ✓ | ✗ | | Qwen Image | ✓ | ✓ | ✓ | ✗ | | Sana | ✓ | ✓ | ✓ | ✗ | | Sana Video | ✓ | ✓ | ✓ | ✗ | | SD 1.x/2.x (Legacy) | ✓ | ✗ | ✗ | ✗ | | Stable Diffusion 3 | ✓ | ✓ | ✓ | ✓ | | Stable Diffusion XL | ✓ | ✗ | ✗ | ✗ | | Stable Cascade (Stage C) | ✓ | ✓ | ✓ | ✗ | | Wan Video | ✓ | ✓ | ✓ | ✓ | | Wan S2V | ✓ | ✓ | ✓ | ✗ | | Z-Image | ✓ | ✓ | ✓ | ✓ | | Z-Image Omni | ✓ | ✗ | ✗ | ✗ | | ZLab I1 | ✓ | ✓ | ✓ | ✗ |Flow, distillation, and alignment
MixFlow post-training is available for every `flow matching` row below. See the [MixFlow guide](experimental/MIXFLOW.md). | Model | Prediction | Flow Shift | TwinFlow | Self-Flow | LayerSync | NextLat | XM | Internal Guidance | Sliders | | --- | --- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | | ACE-Step | flow matching | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ v1 | ✓ | | Anima | flow matching | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Auraflow | flow matching | ✓ (SLG) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Boogu-Image | flow matching | ✓ | ✗ | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | | Chroma 1 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Cosmos2 | sample | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Cosmos3 | flow matching | ✓ | ✗ | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | | DeepFloyd IF | epsilon | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | ✓ | | ERNIE-Image | flow matching | ✓ | ✓ | ✗ | ✓ | ✓ | ✗ | ✓ | ✓ | | Flux.1 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Flux.2 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | HeartMuLa | autoregressive next-token | ✗ | ✗ | ✗ | ✗ | ✓ | ✓ | ✗ | ✗ | | HiDream | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Hunyuan Video | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Ideogram 4 | flow matching | ✓ | ✗ | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | | InfiniteTalk | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Kandinsky 5.0 Image | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Kandinsky 5.0 Video | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Kwai Kolors | epsilon | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | | Krea2 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | LongCat Image | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | LongCat Video | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | LTX Video | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | | LTX Video 2 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Lumina2 | flow matching | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Mage-Flow | flow matching | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | | MiniMax H3 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | MiniMax Music 3 | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | OmniGen | flow matching | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | PixArt Sigma | epsilon | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Qwen Image | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Sana | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Sana Video | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | | SD 1.x/2.x (Legacy) | epsilon / v-pred | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | ✓ | | Stable Diffusion 3 | flow matching | ✓ (SLG) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Stable Diffusion XL | epsilon | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | ✓ | | Stable Cascade (Stage C) | epsilon | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | ✓ | | Wan Video | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Wan S2V | flow matching | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Z-Image | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | | Z-Image Omni | flow matching | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | | ZLab I1 | flow matching | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |Text encoders and VAE types
| Model | Text Encoders | Text Encoder Params | VAE | | --- | --- | --- | --- | | ACE-Step | UMT5 Encoder | 0.6B | Music DCAE | | Anima | Qwen3 0.6B | 0.6B | Qwen Image VAE | | Auraflow | Pile T5 | not specified | AutoencoderKL | | Boogu-Image | Qwen3-VL | not specified | AutoencoderKL | | Chroma 1 | T5 XXL v1.1 | 11B | AutoencoderKL | | Cosmos2 | T5 11B | 11B | Wan VAE | | Cosmos3 | Cosmos3 reasoner | not specified | Wan/Cosmos VAE | | DeepFloyd IF | T5 XXL v1.1 | 11B | None | | ERNIE-Image | ERNIE text encoder | not specified | Flux.2 VAE | | Flux.1 | CLIP-L/14 + T5 XXL v1.1 | 123M + 11B | AutoencoderKL | | Flux.2 | Mistral-Small-3.1-24B | 24B | Flux.2 VAE | | HeartMuLa | None | N/A | HeartCodec tokens | | HiDream | CLIP-L/14 + CLIP-G/14 + T5 XXL v1.1 + Llama | 123M + 694M + 11B + not specified | AutoencoderKL | | Hunyuan Video | Hunyuan LLM | not specified | Hunyuan Video 3D VAE | | Ideogram 4 | Qwen3-VL-8B-Instruct | 8B | Ideogram AutoEncoder | | InfiniteTalk | UMT5 + Wav2Vec2 | not specified + 95M | Wan VAE | | Kandinsky 5.0 Image | Qwen2.5-VL + CLIP-L/14 | 7B + 123M | Flux VAE (AutoencoderKL) | | Kandinsky 5.0 Video | Qwen2.5-VL + CLIP-L/14 | 7B + 123M | Hunyuan Video VAE | | Kwai Kolors | ChatGLM-6B | 6B | AutoencoderKL | | Krea2 | Qwen3VL | not specified | Qwen Image VAE | | LongCat Image | Qwen2.5-VL | 7B | AutoencoderKL | | LongCat Video | Qwen2.5-VL | 7B | Wan VAE | | LTX Video | T5 XXL v1.1 | 11B | LTX Video VAE | | LTX Video 2 | Gemma3 / Gemma4 | not specified | LTX Video 2 VAE | | Lumina2 | Gemma2 | 2B | AutoencoderKL | | Mage-Flow | Qwen3-VL | not specified | Mage-VAE | | MiniMax H3 | Qwen3-VL | not specified | MiniMax H3 Video VAE + Audio VAE | | MiniMax Music 3 | Qwen3 AR | 8B | DAV audio autoencoder + vocoder decoder | | OmniGen | Integrated OmniGen encoder | not specified | AutoencoderKL | | PixArt Sigma | T5 XXL v1.1 | 11B | AutoencoderKL | | Qwen Image | Qwen2.5-VL | 7B | Qwen Image VAE | | Sana | Gemma2 2B-IT | 2B | Sana AutoencoderDC | | Sana Video | Gemma 2 | 2B | Wan VAE | | SD 1.x/2.x (Legacy) | CLIP-L/14 | 123M | AutoencoderKL | | Stable Diffusion 3 | CLIP-L/14 + CLIP-G/14 + T5 XXL v1.1 | 123M + 694M + 11B | AutoencoderKL | | Stable Diffusion XL | CLIP-L/14 + CLIP-G/14 | 123M + 694M | AutoencoderKL | | Stable Cascade (Stage C) | CLIP-ViT-bigG-14 | 694M | Stable Cascade Stage C VAE | | Wan Video | UMT5 | not specified | Wan VAE | | Wan S2V | UMT5 | not specified | Wan VAE | | Z-Image | Qwen3 4B | 4B | AutoencoderKL | | Z-Image Omni | Qwen3 4B | 4B | AutoencoderKL | | ZLab I1 | T5Gemma 2B | 2B | AutoencoderKL |✓ = supported, ✓ = supported but usually requires DeepSpeed/FSDP2 for full-rank training, ✗ = not supported. Ref Inputs marks existing reference/edit/I2V conditioning paths; opt means optional and req means the edit/I2V flavour requires it.*
TwinFlow support is native when twinflow_enabled=true; diffusion models still require diff2flow_enabled=true plus twinflow_allow_diff2flow=true. Self-Flow refers to CREPA self-flow support. Internal Guidance covers diffusion transformers with an auxiliary denoising head. LayerSync marks backbones that expose hidden states for alignment. NextLat uses captured hidden states for the auxiliary next-latent objective. XM marks Explorative Modeling support: noise-candidate selection for diffusion models and route selection for autoregressive token models.
Fast paths: Z-Image Turbo & Flux Schnell¶
- Z-Image Turbo: Fully supported LoRA with TREAD; runs fast on NVIDIA and macOS even without quant (int8 works too). Often the bottleneck is just trainer setup.
- Flux Schnell: The quickstart config handles the fast noise schedule and assistant LoRA stack automatically; no extra flags needed to train Schnell LoRAs.
Advanced Experimental Features¶
- Diff2Flow: Allows training standard epsilon/v-prediction models (SD1.5, SDXL, DeepFloyd, etc.) using a Flow Matching loss objective. This bridges the gap between older architectures and modern flow-based training.
- Scheduled Sampling: Reduces exposure bias by letting the model generate its own intermediate noisy latents during training ("rollout"). This helps the model learn to recover from its own generation errors.
Common Issues¶
Dataset has fewer samples than expected¶
If your dataset ends up with fewer usable samples than you expected, files may have been filtered during processing. Common reasons include:
- Files too small: Images below
minimum_image_sizeare filtered out - Aspect ratio out of range: Images outside
minimum_aspect_ratio/maximum_aspect_ratiobounds are excluded - Duration limits: Audio/video files exceeding duration limits are skipped
Viewing filtering statistics:
- In the WebUI, browse to your dataset directory and select it to see filtering statistics
- Check the logs during dataset processing for statistics like: Sample processing statistics: {'total_processed': 100, 'skipped': {'too_small': 15, ...}}
For detailed troubleshooting, see Troubleshooting filtered datasets in the dataloader documentation.