r/comfyui • • 1h ago

News Why?

0 Upvotes

I love comfy but why do we need a new look for the startup screen? It doesn't add anything, the old one was fine, please improve core features but not appearance no one asked for.


r/comfyui • • 2h ago

Help Needed So this happened after the latest update.

2 Upvotes

heres the deal, i already had working builds yesterday, i had a crash and everything is gone.

it doesnt even let me make a new build.

it doesnt even go further from that

or Add build.


r/comfyui • • 2h ago

Show and Tell A Minor Disagreement — original instrumental music and animated shadow puppets, made with AI-assisted workflows

0 Upvotes

I've been experimenting with original instrumental music using ACE-Step 1.5 in ComfyUI and LTX.

This track started as a playful chamber-jazz experiment, with the instruments almost arguing with one another. After several attempts to refine or reinterpret it, I ended up keeping the original generation because its little rhythmic irregularities felt more natural.

For the visual, I developed an antique shadow-puppet scene with two characters exchanging small, slightly argumentative gestures.

The idea was to give the music a visual companion without turning it into a conventional music video.

I'd be interested in feedback on the musical result and how well the restrained puppet animation supports it.


r/comfyui • • 3h ago

Workflow Included Updated my subject+environment showcase workflow and ran some tests! still have lots planned but it's working well!...it's getting there!

5 Upvotes

WORKFLOW

https://drive.google.com/file/d/1APWiEugf0wE96o9b790Q7YntKos0Ighp/view?usp=drive_link

I will let Claude explain this! Lemme know if you have any questions or wanna chit-chat about it or have any suggestions

1A1Bonkers1A1: One ComfyUI Workflow, a Character Image + Two Environment Images → Character Turnaround → 360° Cylindrical Panorama → Walk/Turn Video (MiniMax H3 image + video)

This workflow is everything I've learned in ComfyUI, in one graph. I threw every trick in the book at it.

**Inputs:** one character image + two environment images.

**What it does, all in one run:**

  1. Generates a full **4-view character turnaround sheet** (front / right / back / left) from virtually any subject. It doesn't have to be a person: a car, a plane, or multiple characters all work.
  2. Builds a **seamless 360° cylindrical panorama** (4 panels) from just the two environment images by outpainting the two gaps between them.
  3. **Composites the character into keyframes** cut from that panorama, then blends it into the scene so it sits *in* the environment, not on top of it.
  4. Uses **first/last-keyframe video generation** to produce turn-in-place clips and an 8-piece walk that travels around the full 360° environment.

> ⚠️ **Heads up:** this one is heavy. It needs a beefy PC and takes a long time. I haven't fully tested the latest revision yet and there's a lot more I want to do to it. If you try it, please share your results and tell me what I can improve.

**Latest improvements:** raised the character on the ground line, added a blend pass to all keyframes, extended the ground past the bottom of the scene, and made it flat and fully walkable.

**Next up:** a separate F2L workflow with pose and motion interpolation, so I can drop random animations into these environments and bring everything to life.

---

## Workflow at a glance

| | |

|---|---|

| Nodes | ~504 |

| Groups | 51 (organized into numbered stages) |

| Image sampler passes | 24 (`KSampler`, 6 steps, CFG 1, euler / simple) |

| Image working size | 3360 × 5024 (2:3, ~16.9 MP) per panel |

| Panorama | 4 panels = 13,440 × 5024 ring |

| Video clips generated | 13 (8 walk + 3 turn + 1 transition + 1 reference walk), built from 3 video subgraphs |

| **Frames generated** | **1,000** (927 across the 12 clips that feed the final video + 73 in the reference walk, which is used only as a control signal) |

| **Final video** | **914 frames at 24 fps ≈ 38 seconds** after trimming the duplicate keyframe at each join, one seamless loop |

| Video size | 832 × 1248 (2:3) at the default 1 MP, adjustable |

---

## Models

All are from the Comfy-Org MiniMax H3 repos unless noted. The workflow embeds the download URLs, so ComfyUI should offer to fetch missing models.

### Image stages (turnaround, plates, seams, blend passes)

| Model | Folder | Size | Link |

|---|---|---|---|

| `minimax_h3_image_pruned_int8_convrot.safetensors` | `diffusion_models` | ~21 GB | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3-Image/resolve/main/diffusion_models/minimax_h3_image_pruned_int8_convrot.safetensors) |

| `qwen3vl_32b_minimax_h3_int8_convrot.safetensors` | `text_encoders` | ~25.3 GB | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/text_encoders/qwen3vl_32b_minimax_h3_int8_convrot.safetensors) |

| `minimax_h3_image_vae_fp16.safetensors` | `vae` | n/a | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3-Image/resolve/main/vae/minimax_h3_image_vae_fp16.safetensors) |

| `qwen3.5_9b_w4a8_gptq.safetensors` (prompt enhancer LLM for the plates + turnaround) | `text_encoders` | n/a | [HF](https://huggingface.co/Comfy-Org/Qwen3.5/resolve/main/text_encoders/qwen3.5_9b_w4a8_gptq.safetensors) |

### Video stages (turns, walk, transitions)

| Model | Folder | Link |

|---|---|---|

| `minimax_h3_fl2va_pruned_int8_convrot.safetensors` (first/last-frame → video + audio) | `diffusion_models` | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/diffusion_models/minimax_h3_fl2va_pruned_int8_convrot.safetensors) |

| `qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors` | `text_encoders` | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/text_encoders/qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors) |

| `minimax_h3_video_vae_int8_convrot.safetensors` | `vae` | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_video_vae_int8_convrot.safetensors) |

| `minimax_h3_audio_vae_fp32.safetensors` | `vae` | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_audio_vae_fp32.safetensors) |

| `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_bf16.safetensors` (optional "Turbo" LoRA, 8-step speed-up) | `loras` | [HF (lightx2v)](https://huggingface.co/lightx2v/Minimax-h3-Turbo/resolve/main/minimax_h3_fl2v_turbo_8step_v1.0_comfyui_bf16.safetensors) |

| `minimax_h3_fun_controlnet_union_pruned_int8_convrot.safetensors` (Fun ControlNet Union, used for pose/depth-guided walk) | `model_patches` | [HF](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/model_patches/minimax_h3_fun_controlnet_union_pruned_int8_convrot.safetensors) |

### Auto-downloaded on first run

- **BiRefNet-general**: background removal (character cutouts)

- **DWPose** and **Depth Anything V2**: preprocessors for the walk control path

---

## Custom node packs

Most of the graph is **ComfyUI core**, so update ComfyUI first. It needs a recent build with the MiniMax H3 nodes (`MiniMaxH3ImageConditioning`, `MiniMaxH3ImageToVideo`, `MiniMaxH3FunControlNetApply`), `TextGenerateV2`, `ComfyMathExpression`, `ComfySwitchNode`, and subgraph support.

Custom packs:

| Pack | Used for |

|---|---|

| **rgthree-comfy** | `Fast Groups Bypasser`, the **STAGE BYPASS TOGGLES** that let you switch whole stages on/off |

| **ComfyUI-VideoHelperSuite** | `VHS_VideoCombine` for the video outputs |

| **ComfyUI-RMBG** (provides `BiRefNetRMBG`) | character cutouts at every angle |

| **comfyui_controlnet_aux** | `AIO_Preprocessor` (DWPose skeleton + Depth Anything V2) |

*If any node shows up red, use ComfyUI-Manager's "Install Missing Custom Nodes".*

---

## Technical breakdown

### Stage 1: Character turnaround sheet → ANGLES

- A single reference image (any size or aspect ratio) goes through a **Qwen3.5 prompt-enhancer** (`TextGenerateV2`), which expands a terse instruction into a rich, reference-conditioned caption.

- MiniMax H3 image-edit generates a **5120 × 1920 sheet**: 4 columns × 1 row, each cell 2:3, front / right profile / back / left profile on one shared ground line. No 3/4 views.

- That sheet becomes the reference for the **ANGLES** stage, which generates each view at 3360 × 5024.

- **Consistency trick:** right, back and left are generated *from the front result*, not the original reference, so the character stays locked across angles.

- The side-profile prompts are deliberately blunt ("WHOLE BODY in side profile, NOT three-quarter, NOT a head-turn on a front body") because image models love cheating profiles.

- Each view is cut out with BiRefNet to an alpha cutout.

- A separate **mid-stride right-profile walk pose** is generated with the rear foot planted and the front foot lifted, which becomes the walk keyframe.

### Stage 2: 360° cylindrical panorama from two images

- Environment A and B each go through an **environment-plate pass**: rebuilt to exactly 2:3 (3360 × 5024) without stretching or letterboxing, with outpainting where needed.

- One shared **sky reference** feeds both plates (conditioning + prompt enhancer) so A and B share a sky.

- The bottom of every plate is extended with a **flat, level, walkable surface**. The material is set in one shared `ground_surface` box, and each plate has its own "changes" override box.

- **Seam fill:** a 3872 × 5024 canvas (~19.5 MP, near the 20 MP limit) is built as `[256px strip of A][3360px magenta gap][256px strip of B]`. The model fills the magenta gap as a seamless continuation, with the sky prioritized first so there's one continuous sky.

- Seam 1 fills **A|B** and seam 2 fills **B|A**, which wraps the ring.

- **Edge-matched panels:** the filled seam edges are feathered (96 px) and pasted back over the originals' edges, so panels meet edge to edge with no overlap or visible seam.

- Result: four 3360 × 5024 panels, **1 = A, 2 = new, 3 = B, 4 = new**, plus a 13,440 px ring preview.

### Stage 3: Place the character on the background

- **Cylindrical windows:** the four 90° panels give front/right/back/left. The in-between **45° / 135° / 225° / 315° windows** are cut by joining the right half (1680 px) of one panel with the left half of the next.

- All 8 composites **auto-centre** and share one **GROUND LINE** (feet at y = 4900, with per-angle Y offsets). Change a SIZE value and the character scales around its centre with feet pinned to the line.

- **Blend pass:** each composite goes through an image-edit pass with a shared prompt. It settles the soles slightly into the ground, covers the bottom edge of the feet with dirt and dust, removes bright or dark cutout halos, and is told explicitly **not to change size, pose, position or background**. This fixes the "sticker" look of straight alpha composites.

- Ground-line math is plain expression nodes (`round(b - 5024 * a) + c`), so everything is parametric.

### Stage 4: Video

All clips are first/last-keyframe (F2L) generations with the MiniMax H3 `fl2va` model, run from three video subgraphs (plain F2L, F2L + control video, and the reference walk). Keyframes are the blended composites from stage 3.

**The timeline (one continuous, looping video):**

| Segment | Clips | Raw frames | Frames kept after trimming |

|---|---|---|---|

| Walk around the full 360° environment | 8 pieces (0→45°, 45→90° … 315→360°), 3 s each | 8 × 73 = 584 | 73 + 6 × 72 + 71 = **576** |

| Turn 1: walk end → back view | 1 piece, 3.25 s | 90 | **89** |

| Turn 2: back → left view | 1 piece, 3.25 s | 90 | **89** |

| Turn 3: left → front view | 1 piece, 3.25 s | 90 | **88** |

| Transition A: front-facing → turns and steps into the first stride | 1 piece, 3 s | 73 | **72** |

| **Total** | 12 clips | **927** | **914 frames ≈ 38 s @ 24 fps** |

Each clip's first frame duplicates the previous clip's last frame, so the workflow drops one frame at each join (the trim values are exposed as primitives). The final clip is trimmed so the last frame doesn't repeat the first, which makes the loop seamless. Transition A ends on the walk-start keyframe, so the video loops straight back into the walk.

The reference walk adds another 73 frames of generation (1,000 in total), but it never appears in the final video. It exists only as a control signal (see below).

**Frame-count math:** durations in seconds are converted by expression nodes to frame counts of the form 17n + 5 (3 s → 73 frames, 3.25 s → 90 frames at 24 fps), which is what the video model expects. Change a duration and the counts, trims and audio length follow.

#### The motion-template trick: a reference walk drives all 8 walk pieces

To keep the gait identical across 8 separately generated clips, I generate **one reference walk first and use it as the animation for everything else**:

  1. A plain F2L clip runs between the **0° and 45° keyframes** of the subject in side profile (no control video). This is the "reference walk".
  2. **BiRefNet** removes the background from every frame of that clip, giving a clean subject matte.
  3. The matte is used to paste the subject onto a **solid black canvas** with the same frame count and size, so the control signal contains only the subject.
  4. **Depth Anything V2** turns that into a depth video of the subject's silhouette. (A **DWPose skeleton** path is wired in as an alternative, switched with one boolean.)
  5. That control video goes through the **MiniMax H3 Fun ControlNet Union** patch into all 8 walk pieces, so each piece follows the same walk cycle (stride length, arm and leg swing, weight shift) while the keyframes and the prompt decide the environment.

Because the control signal contains no background, it sets the *subject's animation* without telling the model what the environment should look like. The walk prompts also tell the model to follow the motion guidance exactly and to start and end each piece on the same mid-stride pose, so the pieces cut together without a visible hitch.

#### Other video details

- **Turn pieces:** locked camera, one 90° turn per clip, its own seed per piece. Prompts describe an eased "head and eyes first, then shoulders, then hips and feet" turn with the feet planted and no sliding.

- **Walk pieces:** the subject stays small, in strict right profile and uncropped, while the camera pans 45° per piece. The prompts spell out the parallax and wind behavior so the environment slides consistently from piece to piece.

- **Turbo LoRA toggle** in the video subgraphs: roughly 30 steps normally, or 6–8 steps with the Turbo LoRA enabled, using `res_multistep`.

- **Audio:** MiniMax H3's own audio can be kept, replaced with a custom audio file (trimmed to the video length), or muted.

- Every clip has an **instant preview** output, so you can check each piece as soon as it finishes instead of waiting for the full assembly.

### Quality-of-life

- **STAGE BYPASS TOGGLES** (rgthree) let you run just stage 1, or stage 1+2, etc., without touching the graph.

- **Every stage owns its own models**, so bypassing one stage never removes another stage's loaders.

- Only images and videos pass between stages.

- All tunables (sizes, ground line, offsets, durations, seeds) are exposed as primitives with descriptive titles.

---

## Tricks I'm proudest of

  1. **One ground line drives everything.** Every composite, walk keyframe and rotate keyframe reads the same Y value.
  2. **Cylinder windows from half-panels.** This gives 8 evenly spaced camera positions from only 4 generated panels.
  3. **Magenta-gap outpainting with feathered paste-back.** The model only generates the gap, and the originals stay pixel-exact.
  4. **Generating profile views from the front result.** It keeps identity locked.
  5. **Blend pass with explicit "don't move or resize anything."** The model fixes only contact and edge issues.
  6. **F2L reference walk as a motion template.** One walk is generated first, background-removed with BiRefNet, put on black, run through Depth Anything V2 (or DWPose), and used as the control video for all 8 walk pieces. The gait stays identical all the way around the ring.
  7. **Frame-count expression nodes.** Durations in seconds are converted automatically to valid frame counts, and the join trims are exposed as primitives.
  8. **Bypassable stages with self-contained model loaders.**

---

## Requirements and expectations

- This is a **high-VRAM, long-runtime** workflow. The image model alone is ~21 GB and the text encoder ~25 GB (int8 / convrot). 16.9 MP generations × 24 sampler passes add up, and the video stage multiplies that.

- Run stages **one at a time** using the bypass toggles, and check the intermediate images before committing to video.

- Prefer SSD storage and plenty of system RAM.


r/comfyui • • 3h ago

Tutorial Need full tutorial from you

0 Upvotes

So as i said i am new and want to know how to make existed photos like editing or image to image,i have i52400f rtx 3070 8gb ddr4 16 so need help


r/comfyui • • 3h ago

No workflow Created with Z Image Turbo

Post image
0 Upvotes

r/comfyui • • 5h ago

Workflow Included Wan 2.2 I2V (14B) Start/End Frame + Auto Last-Frame Saver for 8GB VRAM (4 steps)

0 Upvotes

Hey everyone! I put together a clean, beginner-friendly Wan 2.2 I2V-A14B workflow specifically tuned for 8GB VRAM cards (tested on RTX 4060 + 32GB RAM) using Q4_K_M GGUF quants and LightX2V 4-step LoRAs.

What it does:

  • Start + Optional End Frame: Animate a single image or lock the final pose/face with an anchor end frame (toggle it off with Ctrl+B anytime).
  • Automatic Last-Frame Saver: Saves the final frame of every generation straight to your output folder, and the load node can pull it back with one click to chain 3–4 clips into a 20+ second sequence.
  • Fast 4-step generation: Renders a ~7s clip (480×832, 113 frames at 16 fps) in 4 steps (2 high-noise + 2 low-noise).
  • Built-in notes: Full setup and chaining tips (including how to refresh faces between long clips) are written right inside the workflow.

Download workflow & model links (Civitai):
https://civitai.com/models/3060831/wan-22-i2v-startend-frame-last-frame-saver-8gb-vram-4-steps


r/comfyui • • 5h ago

Workflow Included Made a pose-to-video workflow with ControlNet and zero custom nodes for fashion

Post image
10 Upvotes

Hey all, I've been building a little pipeline for fashion videos and put it up on GitHub in case anyone wants to use it or mess with it.

Basically you give it a reference video of someone moving and a photo of a model wearing a product, and it puts that model into the same movement. Video attached so you can see it (original / skeleton / result / upscaled).

The part I'm happiest about is that it's all native ComfyUI nodes. No custom nodes, nothing to install besides the models. Drag the JSON in and you're good. It uses SDPose for the skeleton, FLUX.2 klein for the first frame, MiniMax H3 + its Fun ControlNet for the video, and RelayVSR for the upscale.

Repo: https://github.com/LuanVelo/fashion-pose-to-video

It has the 3 workflows ready to import, links to all the models, a step-by-step, and a changelog of everything I tried (a lot of it didn't work). Runs on a 4090, about 27 min per 5s clip at this point.

Feel free to use it, fork it, break it, whatever. If you try it with your own poses or products I'd love to see what comes out, and issues/PRs are welcome if something doesn't work on your setup.

If anyone knows how to optimize and make this faster without losing quality i would love to hear more.

I used llm for creating the changelog, organizing files, changes and helping me with everything that is not actually creating. So, changuing workflows that already exists.

The final idea is to built it into a open-source open cava i modified and use daily for clients generating images and videos for testing. Nothing is actually production ready at this stage but is the final test and approve before running into a paid API for generating.


r/comfyui • • 9h ago

News Finally China going to destroy monopoly of NVIDIA FINALLY. 64GB consumer GPU, will be probably 50% cheaper than RTX 5090 maybe even more cheaper. AI will code any library you need or kernel for running apps on this GPU

347 Upvotes

r/comfyui • • 10h ago

Resource krea2-prompting skill with huge references library (including adult), now with inpainting, reference images, and LoRAs instructions

Thumbnail
github.com
116 Upvotes

Hi there, I published this skill a while ago, but from that moment it was improved a lot, adding new stuff, like inpainting, reference images, and LoRAs instructions.

Skill targets Krea 2 Turbo, and the purpose is: I'm bad at writing prompts, so I want my agent to do that for me instead.

Here is what's inside:

FileWhat it does
SKILL.mdThe entrypoint. Mental model, ComfyUI defaults, prompt order, workflow, the six checks every prompt gets, and a table of tested traps that points at the right reference. Start here.
references/photoreal.mdCamera, lens, film, light, texture. Skin tone and light temperature. Portraits, products, landscapes, architecture, heroes.
references/krea2-core.mdPoster text, speech bubbles, screens and app UI, staged props, character replacement, character consistency, composition modules, negative families, resolution table, reference reverse-engineering.
references/reference-images.mdCharacter and style references: two core-node wirings, Picture N prompts, the 0.25 layout split and its limits, reference-sheet rules, failure table.
references/inpainting.mdchanging a picture that already exists. The edit LoRA and Ostris patch stack, the whole-picture prompt rule, removal and contradictions, what a mask cannot do, crop-render-composite for detail, framing the black fill, a failure table.
references/comfyui-setup.mdModel files, the RAW checkpoint, Krea2PromptWeight, LoRA strength, the enhancer, troubleshooting.
references/poses.mdThe 11-field pose schema, usage, taxonomy, the field findings, and hands and held objects.
references/pose-library.md30 ready-to-paste pose blocks. Copy, paste, stop inventing poses from scratch.
references/styles.md289 style names, four full examples, two authoring formulas.
references/adult.md18+. The explicit (and the biggest) one. You know why you're here.
references/megastructure.mdColossal architecture, megacities, orbital structures.
references/colossal-monsters.mdKaiju, giant beasts, alien fauna.
references/cosmic-horror.mdEldritch entities, impossible anatomy, dread.
references/pure-organic-monsters.mdStrictly biological giants. No metal, no mineral, no cheating.
examples/Ten topics, each prompted twice (generic versus skill), with both renders side by side.
evals/Maintenance harness. trigger-queries.json says what should activate the skill; evals.json says what a correct answer contains; lint.py fails when the body outgrows its budget or the same quoted phrase turns up in two files.

r/comfyui • • 10h ago

Help Needed H3 Image face swap likeness

Thumbnail reddit.com
0 Upvotes

r/comfyui • • 12h ago

Help Needed Will turning off monitor help speeding up the generation?

0 Upvotes

I have a 5080, but I also have a dual 4k curve 5x inch monitor. Do you think that turning it off will speed up the process?


r/comfyui • • 14h ago

Resource I made a ComfyUI node that runs your prompts in order from a spreadsheet, with {wildcard|support}

Post image
5 Upvotes

r/comfyui • • 15h ago

Help Needed New to ComfyUI and local rendering. Any suggestions for my setup?

0 Upvotes

I have a 2070 8gb vram. 32gb ram, i9. I can get renders in about 5 minutes... closer to 1-2 minutes after the first render of a prompt. Are there any workflows for me that may be good for my limited hardware?

Im running Krea 2 Turbo


r/comfyui • • 16h ago

Show and Tell Minimax Cinestill 800T emulation for a 'Bladerunner' vibe

Thumbnail
reddit.com
0 Upvotes

r/comfyui • • 17h ago

Show and Tell indie music video using local AI on my DGX Spark (Wan2GP + MiniMax H3)

Thumbnail
youtu.be
0 Upvotes

I've been experimenting with AI video generation on my DGX Spark and finally managed to finish a full music video.

It's for a fictional indie band called The Stochastic Parrots. Basically, a bunch of guys dressed as parrots playing psychedelic indie pop and getting into ridiculous situations.

The video is about 3 minutes long, made from roughly 20 main clips plus a dozen extra shots. Everything was generated locally using wan2gp nd MiniMax H3, then edited in davinci. Also it was coordinated by pi coding agent using glm 5.3 fast locally using wan2gp as an api.

I started with the song and used chatgpt to brainstorm the concept and generate around 60 reference images. The band performs in all sorts of places, from rooftops and supermarkets to airports and random backstage situations.

The hardest part was keeping the characters consistent. Faces changed, costumes mutated, instruments became weird objects, and sometimes people just disappeared halfway through a shot.

I used MiniMax H3 Ref2VA / FL2VA to animate the images. I also fed the corresponding sections of the song into the video generation process to help synchronize the performances.

Most clips were around 10 seconds long at 1280×704 and 24 fps, using 8 steps. Each took roughly 16 minutes on the Spark, although some needed several attempts before they looked decent.

One thing I learned is that simpler scenes work much better. A single character doing something funny was usually more convincing than having the entire band performing together. The black-and-white backstage footage also helped a lot, both visually and as a way to hide inconsistencies.

I used faster whisper to map the actual sung lyrics to the timeline, since the generated song didn't always follow the original lyrics exactly. Then I assembled everything in resolve, synced the cuts to the music, and added the extra footage.

I ended up with around 43 video takes for 20 main scenes, plus the additional cutaways. Total GPU generation and experimentation was somewhere around 20–30 hours.

I'm pretty happy with the result. It's not perfect, and there are definitely moments where you can tell it's AI-generated, but I think the editing and the absurd concept help bring it together.


r/comfyui • • 17h ago

News [Release] 8-step Turbo LoRA for Qwen-Image-2.1 Uncensored Omni—CFG 1.0, 6.8× faster, generation + editing

Thumbnail
gallery
48 Upvotes

We’ve released an 8-step Turbo LoRA for Qwen-Image-2.1 Uncensored Omni.

It reduces the standard workflow from 35 steps with CFG 5.0 to 8 steps with CFG 1.0, while supporting both text-to-image generation and instruction-based image editing.

Download

Direct Turbo LoRA download:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-LoRA-v0.1/

Uncensored Omni models and quantized builds:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized

Complete Turbo instructions and benchmarks:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized#turbo-lora-8-steps-cfg-10

ComfyUI setup

  1. Download chatrlabs-omni-turbo-8step-fp32.safetensors.
  2. Place it in:

    ComfyUI/models/loras/

  3. Load a supported Uncensored Omni transformer build from:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized

  1. Add LoraLoaderModelOnly immediately after the model loader.
  2. Use these starting settings:

    LoRA strength: 1.0 Steps: 8 CFG: 1.0 Sampler: Euler Negative prompt: Not required Resolution: Approximately 1 megapixel

Our tested ComfyUI workflow uses the Euler sampler with the Diffusers sigma schedule entered through ManualSigmas. Other scheduler configurations may work, but we have not benchmarked them yet.

The Turbo LoRA successfully attached to all 224 adapted modules on the following ComfyUI builds:

  • BF16
  • FP8
  • INT8 ConvRot
  • NVFP4

The same LoRA file works for both generation and image editing.

Speed

On our Playground server using two RTX A6000 48 GB GPUs:

ConfigurationAverage time per image
Omni, 35 steps, CFG 5.054.9 seconds
Turbo, 8 steps, CFG 1.08.1 seconds

That is a measured 6.8× speedup in our deployment.

Your timing will depend on the transformer format, GPU, resolution, offloading and workflow.

Quality benchmark

We compared Turbo at 8 steps against the same Omni model at 35 steps.

Benchmark35-step Omni8-step Turbo
Adult prompt adherence89.789.1
Anatomy69.472.9
General SFW prompts79.679.0
Image editing78.981.6
Identity preservation in human editing55.872.1

Prompt adherence and general SFW quality were within statistical noise of the 35-step model. Anatomy, editing quality and identity preservation improved in our evaluation.

One known limitation: some adult images can show over-sharpened skin or small speckled artifacts.

Source and inference code

https://github.com/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-LoRA

Try the 8-step model online

https://thechatr.ai/playground

I’d especially appreciate feedback from anyone testing it with different ComfyUI versions, quantized transformers, samplers or sigma schedules.

Please include your model format, GPU, workflow and settings if you encounter a problem—it will make reproducing issues much easier.


r/comfyui • • 19h ago

Help Needed How to make continuous videos and stich them.

1 Upvotes

Hi, So I'm new to this stuff. And I've been trying to learn a lot of community posts, LLM(s) and blogs. I am now successfully able to preserve the characters in the videos I make with Minimax H3 ref2v (the one that's possible to load on a 3090 (24 gb vram). I think its the int8 version. So, I make character sheets and location sheets so that the video model hallucination is reduced. But if I generate 720p, how can I continue the video from the exact frame on the next part? Please guide me someone, I've been trying to achieve this for months. If you have a workflow for this and ahare with me I'd really appreciate it. Although my current config is i5 12400, 32gb ddr4 3200 and a 3090 (gpu unlock enabled). I am able to generate 720p videos in around 2800s. My objective is to stich them and make short movie type things or reels where I can continue the story maybe by episodes or something. Please help me out (crying at this point).


r/comfyui • • 19h ago

News Steppe-Wan2.1: SOTA latent upscaler for Wan 2.1, Krea 2 and Qwen Image that support both images and videos, spatial and temporal upscaling, precise control over sharpness (ComfyUI nodes, demo Space)

Thumbnail
gallery
7 Upvotes

Hi! Steppe-Wan2.1 is my new generative latent upscaler for Wan 2.1 latent space, which also include Krea 2, Qwen Image (don't confuse with Qwen Image 2.1, it has other VAE) and some other models. It is set of model of different scales trained from scratch on a large dataset of images and video (millions of samples, ~300 GPU hours) to perform 2x super-resolution task directly in latent space. Unlike the "traditional" two stage approach where a first deterministic latent upscaler makes blurry latents and then large generative model fixes it through some denoising steps, this model's output can be decoded directly (pic 3). This is much faster and also keeps more information from low resolution latents while achieving best fidelity, reconstruction and some other metrics (pic 4, 5).

- ComfyUI nodes: https://github.com/tensorforger/ComfyUI-Steppe (or simply search "steppe" in manager)

- Hugging Face demo space (you can try it in browser on your images): https://huggingface.co/spaces/TensorForger/Steppe

- Weights: https://huggingface.co/TensorForger/Steppe-Wan2.1 (ComfyUI node downloads required weights automatically)

Key features:

- Support images and videos.

- For video it can do both spatial and temporal upscaling, even both in a single forward pass

- You can control the output sharpness through High Frequency Features Conditioning (HFF), pic 6. It works like a "prompt" describing how sharp details should be in the output. The model doesn't take prompt by the way, it understand image content from input low resolution sample alone (pic 7).

- There are three models in this release: multi-step 200M parameter base model (best control, can use CFG over the HFF), it's distilled single step version (also 200M, best for most tasks) and light 20M distilled single step model (for extremely high resolution upscaling or real-time video upscaling).

- Support different aspect ratios, resolutions and video lengths because it it trained on there different combinations.

Deeper implementation details:

Development codebase: https://github.com/tensorforger/STDev

- The model's architecture was discovered through long agentic autoresearch loop (pic 9). Claude Opus 5.5 run ~120 experiments trying everything starting from convolutional UNets with different configurations, transformers, various hybrid architectures, training losses, objectives, batch and lr schedules... It was inspired with https://github.com/karpathy/autoresearch, but adapted to the task and run in parallel on 8 GPUs. The agent's task was to achieve best patch_fid metric while having 30 minutes of RTX5090 compute. Then best runs was scaled to 2 hour training, best in total was scaled up and used for base model pretrain. You can read the logs of autoresearch in dev repository.

- The resulted architecture is some combination of Swin transformer with local window attention, convolutional layers, two input low resolution sample paths (learned and not) and some actually novel training stability improvements.

- The model is local both in space and time: the window attention can be computed in chunks and temporal path is fully causal (so it can be used for frame by frame streaming). These optimizations reduce VRAM usage and they are implemented in ComfyUI nodes.

- To reproduce benchmarks see dev repository.

Now some thoughts about all this

It is quite surprising how many different approaches are there to get high resolution image from generated latents. Conceptually, they are "Decode, then Upscale", "Upscale, then Decode" and "Upscale during Decode". "Decode, then Upscale" hits several problems of expensive high resolution compute and sensitivity to AI-generated artifacts. Any small mistake of decoder becomes larger. "Upscale during Decode" is quite interesting. It is spacepxl/Wan2.1-VAE-upscale2x and Nvidia-Pid. I can't say it is bad or something, it is a good direction too. And if the latency is critical for you spacepxl/Wan2.1-VAE-upscale2x is still a great alternative. Nvidia-Pid is just bad) It completely changes structure and has huge color shift, so it was not even benchmarked here. "Upscale, then Decode" can also be done in many ways. I already mentioned "traditional" approach above. But there is another one: fuse upscaler with large generative model. Examples are "Hildegard" for Flux.2 and new Nvidia's Open-H3-Regenerate-2K. My model is another point in this space, and I believe this is a good direction.


r/comfyui • • 19h ago

Show and Tell Just a couple more tweaks to my workflow and I'll have my perfect 360° subject and environment! It's everything I've ever wanted of out of a workflow, and I'm so proud of it. I just had to share because I'm sitting here at work, and it's literally all I can think about! 😂

46 Upvotes

It's all one workflow, and it runs using just a character image and two environment images! It generates a complete character turnaround sheet from virtually any subject, then composites the character into the keyframes of a 360° cylindrical panorama created from the two environment images.

The possibilities are pretty much endless! You could use anything as the subject, a person, a car, a plane, or even multiple characters!

I just made a few more improvements by raising the character, adding a bending pass to all the keyframes, extending the ground beyond the bottom of the scene, and making it flat and fully walkable. I'm just waiting to get a chance to test it out!

Next up is a separate F2L workflow with pose and motion interpolation, so I can introduce random animations into these environments and bring everything to life!

I'm getting SO close to having this exactly how I've always envisioned it! 😂

I haven't tested this one out yet and I got alot more to do to it but its minimax image and video if you try it you gotta share you results and let me know what I can do to improve it you probably won't like it it takes a beefy PC and a long time to make.

https://drive.google.com/file/d/1VHYGOUbi0L-I8oIUuOMfDxl8D_pGW_Eo/view?usp=drivesdk


r/comfyui • • 21h ago

Workflow Included DFlow2 - 50 -> 4 Step Distillation LoRA, eDMD + LADD (with Torch and MLX ComfyUI Workflows)

Thumbnail gallery
0 Upvotes

r/comfyui • • 22h ago

News ComfyUI just released model rankings by usage

Thumbnail
gallery
118 Upvotes

Z-image is probably highest because it's the default. Krea 2 is higher than I thought though. Not sure how accurate this is

Check it out: https://router.comfy.org/#rankings


r/comfyui • • 22h ago

Workflow Included MiniMax H3 + An Underwater World = One of My Favorite AI Videos So Far

17 Upvotes

r/comfyui • • 23h ago

Workflow Included [Workflow] FLUX.2 Klein 9B (GGUF) — 6-in-1 Reference Pipeline (Text2Img / Face / Body / Location / Swap) running on 8GB VRAM in 4 steps

Thumbnail
gallery
7 Upvotes