r/comfyui • • 13h ago

Show and Tell indie music video using local AI on my DGX Spark (Wan2GP + MiniMax H3)

Thumbnail
youtu.be
0 Upvotes

I've been experimenting with AI video generation on my DGX Spark and finally managed to finish a full music video.

It's for a fictional indie band called The Stochastic Parrots. Basically, a bunch of guys dressed as parrots playing psychedelic indie pop and getting into ridiculous situations.

The video is about 3 minutes long, made from roughly 20 main clips plus a dozen extra shots. Everything was generated locally using wan2gp nd MiniMax H3, then edited in davinci. Also it was coordinated by pi coding agent using glm 5.3 fast locally using wan2gp as an api.

I started with the song and used chatgpt to brainstorm the concept and generate around 60 reference images. The band performs in all sorts of places, from rooftops and supermarkets to airports and random backstage situations.

The hardest part was keeping the characters consistent. Faces changed, costumes mutated, instruments became weird objects, and sometimes people just disappeared halfway through a shot.

I used MiniMax H3 Ref2VA / FL2VA to animate the images. I also fed the corresponding sections of the song into the video generation process to help synchronize the performances.

Most clips were around 10 seconds long at 1280×704 and 24 fps, using 8 steps. Each took roughly 16 minutes on the Spark, although some needed several attempts before they looked decent.

One thing I learned is that simpler scenes work much better. A single character doing something funny was usually more convincing than having the entire band performing together. The black-and-white backstage footage also helped a lot, both visually and as a way to hide inconsistencies.

I used faster whisper to map the actual sung lyrics to the timeline, since the generated song didn't always follow the original lyrics exactly. Then I assembled everything in resolve, synced the cuts to the music, and added the extra footage.

I ended up with around 43 video takes for 20 main scenes, plus the additional cutaways. Total GPU generation and experimentation was somewhere around 20–30 hours.

I'm pretty happy with the result. It's not perfect, and there are definitely moments where you can tell it's AI-generated, but I think the editing and the absurd concept help bring it together.


r/comfyui • • 20h ago

Show and Tell I still love ZIT. Trying out style LoRAs has become my new hobby. TIS the season!

Thumbnail
gallery
0 Upvotes

All but one image use the same prompt and character LoRA. From there I wanted to play around with different style LoRAs. Clicking that "Run" button is an addictive roulette wheel for me. 😂

An Anime-style digital painting of a cute young woman, blonde hair, soft red lips, long toned legs,and blue eyes. She wanders through a bustling Christmas market at twilight, wearing her winter Santa themed sexy mini-dress, sexy red high-heels, and a plush white fur-trimmed red capelet as her hair catches the warm glow from festive lanterns strung between wooden market stalls.

Her high-heel shoes crunch on freshly fallen snow covering cobblestone streets, while her green-and-red ribbon bow with golden bell jingles softly.

The market features tall timber-framed stalls with peaked red and white striped awnings, each adorned with twinkling fairy lights. Steam billows from vendors selling roasted chestnuts in black cast iron pans, their rich scent mingling with pine from garlands draping wooden archways. In the background, a towering Christmas tree decorated with colored ornaments stands before historic stone buildings with Gothic arches, their windows glowing golden from within. Market stalls sell handcrafted wooden toys, intricate glass ornaments catching the lantern light, and steaming beverages in ceramic mugs. Her eyes sparkle as she examines a display of retro gaming themed ornaments, her hairclip tilted just above her right ear. Snow continues to fall in large fluffy flakes, creating a magical atmosphere as street lamps with wrought iron bases cast warm pools of light on the snowy ground.


r/comfyui • • 12h ago

Help Needed New to ComfyUI and local rendering. Any suggestions for my setup?

0 Upvotes

I have a 2070 8gb vram. 32gb ram, i9. I can get renders in about 5 minutes... closer to 1-2 minutes after the first render of a prompt. Are there any workflows for me that may be good for my limited hardware?

Im running Krea 2 Turbo


r/comfyui • • 18h ago

Workflow Included DFlow2 - 50 -> 4 Step Distillation LoRA, eDMD + LADD (with Torch and MLX ComfyUI Workflows)

Thumbnail gallery
0 Upvotes

r/comfyui • • 6h ago

News Finally China going to destroy monopoly of NVIDIA FINALLY. 64GB consumer GPU, will be probably 50% cheaper than RTX 5090 maybe even more cheaper. AI will code any library you need or kernel for running apps on this GPU

247 Upvotes

r/comfyui • • 9h ago

Help Needed Will turning off monitor help speeding up the generation?

0 Upvotes

I have a 5080, but I also have a dual 4k curve 5x inch monitor. Do you think that turning it off will speed up the process?


r/comfyui • • 12h ago

Show and Tell Minimax Cinestill 800T emulation for a 'Bladerunner' vibe

Thumbnail
reddit.com
0 Upvotes

r/comfyui • • 2h ago

Workflow Included Wan 2.2 I2V (14B) Start/End Frame + Auto Last-Frame Saver for 8GB VRAM (4 steps)

0 Upvotes

Hey everyone! I put together a clean, beginner-friendly Wan 2.2 I2V-A14B workflow specifically tuned for 8GB VRAM cards (tested on RTX 4060 + 32GB RAM) using Q4_K_M GGUF quants and LightX2V 4-step LoRAs.

What it does:

  • Start + Optional End Frame: Animate a single image or lock the final pose/face with an anchor end frame (toggle it off with Ctrl+B anytime).
  • Automatic Last-Frame Saver: Saves the final frame of every generation straight to your output folder, and the load node can pull it back with one click to chain 3–4 clips into a 20+ second sequence.
  • Fast 4-step generation: Renders a ~7s clip (480×832, 113 frames at 16 fps) in 4 steps (2 high-noise + 2 low-noise).
  • Built-in notes: Full setup and chaining tips (including how to refresh faces between long clips) are written right inside the workflow.

Download workflow & model links (Civitai):
https://civitai.com/models/3060831/wan-22-i2v-startend-frame-last-frame-saver-8gb-vram-4-steps


r/comfyui • • 23h ago

Workflow Included 2-step pi-h3 out and working with Sulphur 3 and refmod

22 Upvotes

Thank you for Lakonik team for releasing pi-h3, it generates videos in 2 steps and without a vae decoder. Even though it's trained on first-frame conditioning, it seems to work fine in ref mode. End-to-end generation of a 5s long 1280x736 video is 84.11s on an RTX5080.

PI-H3: https://huggingface.co/Lakonik/pi-H3
Sulphur 3: https://huggingface.co/SulphurAI/Sulphur-3
Workflow: https://pastebin.com/k1kKaJhs

And of course there is no free lunch, but it certainly has it's use-cases.


r/comfyui • • 19h ago

Workflow Included MiniMax H3 + An Underwater World = One of My Favorite AI Videos So Far

16 Upvotes

r/comfyui • • 19h ago

Workflow Included Nodes to use Rumble2Flash amazing transcriber model

0 Upvotes

I just uploaded the nodes necessary to run this transcriber tool, based in Qwen3 ASR but faster and more precise. The node has a /examples folder with two workflows. Any issue post here I will take a look from time to time.

Node in Github:
https://github.com/jmbbao/ComfyUI-Rumble2Flash

To download the zip in Github click the green button "Code" if you don't want to use git command to download it.

The Load Model node will download the small 1.5 GB model to /models/rumble_asr or use it if already present. Alll is explained in the help of the nodes, just put the mouse to read the tooltips.


r/comfyui • • 15h ago

Help Needed How to make continuous videos and stich them.

1 Upvotes

Hi, So I'm new to this stuff. And I've been trying to learn a lot of community posts, LLM(s) and blogs. I am now successfully able to preserve the characters in the videos I make with Minimax H3 ref2v (the one that's possible to load on a 3090 (24 gb vram). I think its the int8 version. So, I make character sheets and location sheets so that the video model hallucination is reduced. But if I generate 720p, how can I continue the video from the exact frame on the next part? Please guide me someone, I've been trying to achieve this for months. If you have a workflow for this and ahare with me I'd really appreciate it. Although my current config is i5 12400, 32gb ddr4 3200 and a 3090 (gpu unlock enabled). I am able to generate 720p videos in around 2800s. My objective is to stich them and make short movie type things or reels where I can continue the story maybe by episodes or something. Please help me out (crying at this point).


r/comfyui • • 21h ago

Help Needed Anyone made a relight / light fusion LoRA for MiniMax H3 Image? Or got a working ai-toolkit config?

0 Upvotes

Salut tout le monde, petite question. J'ai utilisé un LoRA de fusion légère (le genre relight, où il intègre le sujet dans le nouvel éclairage de l'arrière-plan) sur Qwen Image 2.1 et ça fonctionne vraiment bien pour mes shoots de produits. Maintenant, je déplace beaucoup de mes trucs vers MiniMax H3 Image et je ne trouve rien de similaire pour ça.

Est-ce que quelqu'un a vu un LoRA relight ou de fusion légère pour H3 Image ? Même un à peu près correct me suffirait, je ne suis pas difficile à ce stade.

Si personne n'en a fait un, je vais probablement juste entraîner le mien avec Ostris ai-toolkit. J'ai une 4090 et 64 Go de RAM, donc je devrais y arriver, mais je n'ai encore rien entraîné sur H3. Si quelqu'un a une config qui fonctionne vraiment (rank, taux d'apprentissage, étapes, si vous avez besoin de cet adaptateur d'entraînement d'image de circlestone-labs), j'apprécierais vraiment que vous la partagiez. Même des réglages approximatifs qui vous ont donné des résultats décents me feraient gagner un temps fou en essais et erreurs.

Merci d'avance, et désolé si ça a déjà été demandé, j'ai cherché mais je n'ai pas trouvé grand-chose.

The lora for qwen image 2.1: https://huggingface.co/badraymen/Object_Fusion_Frompysj666_V0


r/comfyui • • 13h ago

No workflow Good GoodBye by HWASA

0 Upvotes

The female character I created sings Hwasa’s "Good GoodBye" in a very sexy dance.

The facial acting is especially sexy! haha!

ps: I am a Comfyui's beginner and my 1st work!


r/comfyui • • 7h ago

Help Needed H3 Image face swap likeness

Thumbnail reddit.com
0 Upvotes

r/comfyui • • 14h ago

News [Release] 8-step Turbo LoRA for Qwen-Image-2.1 Uncensored Omni—CFG 1.0, 6.8× faster, generation + editing

Thumbnail
gallery
43 Upvotes

We’ve released an 8-step Turbo LoRA for Qwen-Image-2.1 Uncensored Omni.

It reduces the standard workflow from 35 steps with CFG 5.0 to 8 steps with CFG 1.0, while supporting both text-to-image generation and instruction-based image editing.

Download

Direct Turbo LoRA download:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-LoRA-v0.1/

Uncensored Omni models and quantized builds:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized

Complete Turbo instructions and benchmarks:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized#turbo-lora-8-steps-cfg-10

ComfyUI setup

  1. Download chatrlabs-omni-turbo-8step-fp32.safetensors.
  2. Place it in:

    ComfyUI/models/loras/

  3. Load a supported Uncensored Omni transformer build from:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized

  1. Add LoraLoaderModelOnly immediately after the model loader.
  2. Use these starting settings:

    LoRA strength: 1.0 Steps: 8 CFG: 1.0 Sampler: Euler Negative prompt: Not required Resolution: Approximately 1 megapixel

Our tested ComfyUI workflow uses the Euler sampler with the Diffusers sigma schedule entered through ManualSigmas. Other scheduler configurations may work, but we have not benchmarked them yet.

The Turbo LoRA successfully attached to all 224 adapted modules on the following ComfyUI builds:

  • BF16
  • FP8
  • INT8 ConvRot
  • NVFP4

The same LoRA file works for both generation and image editing.

Speed

On our Playground server using two RTX A6000 48 GB GPUs:

ConfigurationAverage time per image
Omni, 35 steps, CFG 5.054.9 seconds
Turbo, 8 steps, CFG 1.08.1 seconds

That is a measured 6.8× speedup in our deployment.

Your timing will depend on the transformer format, GPU, resolution, offloading and workflow.

Quality benchmark

We compared Turbo at 8 steps against the same Omni model at 35 steps.

Benchmark35-step Omni8-step Turbo
Adult prompt adherence89.789.1
Anatomy69.472.9
General SFW prompts79.679.0
Image editing78.981.6
Identity preservation in human editing55.872.1

Prompt adherence and general SFW quality were within statistical noise of the 35-step model. Anatomy, editing quality and identity preservation improved in our evaluation.

One known limitation: some adult images can show over-sharpened skin or small speckled artifacts.

Source and inference code

https://github.com/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-LoRA

Try the 8-step model online

https://thechatr.ai/playground

I’d especially appreciate feedback from anyone testing it with different ComfyUI versions, quantized transformers, samplers or sigma schedules.

Please include your model format, GPU, workflow and settings if you encounter a problem—it will make reproducing issues much easier.


r/comfyui • • 19h ago

Workflow Included [Workflow] FLUX.2 Klein 9B (GGUF) — 6-in-1 Reference Pipeline (Text2Img / Face / Body / Location / Swap) running on 8GB VRAM in 4 steps

Thumbnail
gallery
5 Upvotes

r/comfyui • • 16h ago

Show and Tell Just a couple more tweaks to my workflow and I'll have my perfect 360° subject and environment! It's everything I've ever wanted of out of a workflow, and I'm so proud of it. I just had to share because I'm sitting here at work, and it's literally all I can think about! 😂

37 Upvotes

It's all one workflow, and it runs using just a character image and two environment images! It generates a complete character turnaround sheet from virtually any subject, then composites the character into the keyframes of a 360° cylindrical panorama created from the two environment images.

The possibilities are pretty much endless! You could use anything as the subject, a person, a car, a plane, or even multiple characters!

I just made a few more improvements by raising the character, adding a bending pass to all the keyframes, extending the ground beyond the bottom of the scene, and making it flat and fully walkable. I'm just waiting to get a chance to test it out!

Next up is a separate F2L workflow with pose and motion interpolation, so I can introduce random animations into these environments and bring everything to life!

I'm getting SO close to having this exactly how I've always envisioned it! 😂

I haven't tested this one out yet and I got alot more to do to it but its minimax image and video if you try it you gotta share you results and let me know what I can do to improve it you probably won't like it it takes a beefy PC and a long time to make.

https://drive.google.com/file/d/1VHYGOUbi0L-I8oIUuOMfDxl8D_pGW_Eo/view?usp=drivesdk


r/comfyui • • 7h ago

Resource krea2-prompting skill with huge references library (including adult), now with inpainting, reference images, and LoRAs instructions

Thumbnail
github.com
93 Upvotes

Hi there, I published this skill a while ago, but from that moment it was improved a lot, adding new stuff, like inpainting, reference images, and LoRAs instructions.

Skill targets Krea 2 Turbo, and the purpose is: I'm bad at writing prompts, so I want my agent to do that for me instead.

Here is what's inside:

FileWhat it does
SKILL.mdThe entrypoint. Mental model, ComfyUI defaults, prompt order, workflow, the six checks every prompt gets, and a table of tested traps that points at the right reference. Start here.
references/photoreal.mdCamera, lens, film, light, texture. Skin tone and light temperature. Portraits, products, landscapes, architecture, heroes.
references/krea2-core.mdPoster text, speech bubbles, screens and app UI, staged props, character replacement, character consistency, composition modules, negative families, resolution table, reference reverse-engineering.
references/reference-images.mdCharacter and style references: two core-node wirings, Picture N prompts, the 0.25 layout split and its limits, reference-sheet rules, failure table.
references/inpainting.mdchanging a picture that already exists. The edit LoRA and Ostris patch stack, the whole-picture prompt rule, removal and contradictions, what a mask cannot do, crop-render-composite for detail, framing the black fill, a failure table.
references/comfyui-setup.mdModel files, the RAW checkpoint, Krea2PromptWeight, LoRA strength, the enhancer, troubleshooting.
references/poses.mdThe 11-field pose schema, usage, taxonomy, the field findings, and hands and held objects.
references/pose-library.md30 ready-to-paste pose blocks. Copy, paste, stop inventing poses from scratch.
references/styles.md289 style names, four full examples, two authoring formulas.
references/adult.md18+. The explicit (and the biggest) one. You know why you're here.
references/megastructure.mdColossal architecture, megacities, orbital structures.
references/colossal-monsters.mdKaiju, giant beasts, alien fauna.
references/cosmic-horror.mdEldritch entities, impossible anatomy, dread.
references/pure-organic-monsters.mdStrictly biological giants. No metal, no mineral, no cheating.
examples/Ten topics, each prompted twice (generic versus skill), with both renders side by side.
evals/Maintenance harness. trigger-queries.json says what should activate the skill; evals.json says what a correct answer contains; lint.py fails when the body outgrows its budget or the same quoted phrase turns up in two files.

r/comfyui • • 19h ago

News ComfyUI just released model rankings by usage

Thumbnail
gallery
111 Upvotes

Z-image is probably highest because it's the default. Krea 2 is higher than I thought though. Not sure how accurate this is

Check it out: https://router.comfy.org/#rankings


r/comfyui • • 16h ago

News Steppe-Wan2.1: SOTA latent upscaler for Wan 2.1, Krea 2 and Qwen Image that support both images and videos, spatial and temporal upscaling, precise control over sharpness (ComfyUI nodes, demo Space)

Thumbnail
gallery
7 Upvotes

Hi! Steppe-Wan2.1 is my new generative latent upscaler for Wan 2.1 latent space, which also include Krea 2, Qwen Image (don't confuse with Qwen Image 2.1, it has other VAE) and some other models. It is set of model of different scales trained from scratch on a large dataset of images and video (millions of samples, ~300 GPU hours) to perform 2x super-resolution task directly in latent space. Unlike the "traditional" two stage approach where a first deterministic latent upscaler makes blurry latents and then large generative model fixes it through some denoising steps, this model's output can be decoded directly (pic 3). This is much faster and also keeps more information from low resolution latents while achieving best fidelity, reconstruction and some other metrics (pic 4, 5).

- ComfyUI nodes: https://github.com/tensorforger/ComfyUI-Steppe (or simply search "steppe" in manager)

- Hugging Face demo space (you can try it in browser on your images): https://huggingface.co/spaces/TensorForger/Steppe

- Weights: https://huggingface.co/TensorForger/Steppe-Wan2.1 (ComfyUI node downloads required weights automatically)

Key features:

- Support images and videos.

- For video it can do both spatial and temporal upscaling, even both in a single forward pass

- You can control the output sharpness through High Frequency Features Conditioning (HFF), pic 6. It works like a "prompt" describing how sharp details should be in the output. The model doesn't take prompt by the way, it understand image content from input low resolution sample alone (pic 7).

- There are three models in this release: multi-step 200M parameter base model (best control, can use CFG over the HFF), it's distilled single step version (also 200M, best for most tasks) and light 20M distilled single step model (for extremely high resolution upscaling or real-time video upscaling).

- Support different aspect ratios, resolutions and video lengths because it it trained on there different combinations.

Deeper implementation details:

Development codebase: https://github.com/tensorforger/STDev

- The model's architecture was discovered through long agentic autoresearch loop (pic 9). Claude Opus 5.5 run ~120 experiments trying everything starting from convolutional UNets with different configurations, transformers, various hybrid architectures, training losses, objectives, batch and lr schedules... It was inspired with https://github.com/karpathy/autoresearch, but adapted to the task and run in parallel on 8 GPUs. The agent's task was to achieve best patch_fid metric while having 30 minutes of RTX5090 compute. Then best runs was scaled to 2 hour training, best in total was scaled up and used for base model pretrain. You can read the logs of autoresearch in dev repository.

- The resulted architecture is some combination of Swin transformer with local window attention, convolutional layers, two input low resolution sample paths (learned and not) and some actually novel training stability improvements.

- The model is local both in space and time: the window attention can be computed in chunks and temporal path is fully causal (so it can be used for frame by frame streaming). These optimizations reduce VRAM usage and they are implemented in ComfyUI nodes.

- To reproduce benchmarks see dev repository.

Now some thoughts about all this

It is quite surprising how many different approaches are there to get high resolution image from generated latents. Conceptually, they are "Decode, then Upscale", "Upscale, then Decode" and "Upscale during Decode". "Decode, then Upscale" hits several problems of expensive high resolution compute and sensitivity to AI-generated artifacts. Any small mistake of decoder becomes larger. "Upscale during Decode" is quite interesting. It is spacepxl/Wan2.1-VAE-upscale2x and Nvidia-Pid. I can't say it is bad or something, it is a good direction too. And if the latency is critical for you spacepxl/Wan2.1-VAE-upscale2x is still a great alternative. Nvidia-Pid is just bad) It completely changes structure and has huge color shift, so it was not even benchmarked here. "Upscale, then Decode" can also be done in many ways. I already mentioned "traditional" approach above. But there is another one: fuse upscaler with large generative model. Examples are "Hildegard" for Flux.2 and new Nvidia's Open-H3-Regenerate-2K. My model is another point in this space, and I believe this is a good direction.


r/comfyui • • 11h ago

Resource I made a ComfyUI node that runs your prompts in order from a spreadsheet, with {wildcard|support}

Post image
7 Upvotes

r/comfyui • • 2h ago

Workflow Included Made a pose-to-video workflow with ControlNet and zero custom nodes for fashion

Post image
3 Upvotes

Hey all, I've been building a little pipeline for fashion videos and put it up on GitHub in case anyone wants to use it or mess with it.

Basically you give it a reference video of someone moving and a photo of a model wearing a product, and it puts that model into the same movement. Video attached so you can see it (original / skeleton / result / upscaled).

The part I'm happiest about is that it's all native ComfyUI nodes. No custom nodes, nothing to install besides the models. Drag the JSON in and you're good. It uses SDPose for the skeleton, FLUX.2 klein for the first frame, MiniMax H3 + its Fun ControlNet for the video, and RelayVSR for the upscale.

Repo: https://github.com/LuanVelo/fashion-pose-to-video

It has the 3 workflows ready to import, links to all the models, a step-by-step, and a changelog of everything I tried (a lot of it didn't work). Runs on a 4090, about 27 min per 5s clip at this point.

Feel free to use it, fork it, break it, whatever. If you try it with your own poses or products I'd love to see what comes out, and issues/PRs are welcome if something doesn't work on your setup.

If anyone knows how to optimize and make this faster without losing quality i would love to hear more.

I used llm for creating the changelog, organizing files, changes and helping me with everything that is not actually creating. So, changuing workflows that already exists.

The final idea is to built it into a open-source open cava i modified and use daily for clients generating images and videos for testing. Nothing is actually production ready at this stage but is the final test and approve before running into a paid API for generating.