r/StableDiffusion • • 43m ago

Resource - Update MOSS_HDR Lora

Thumbnail
gallery
1 Upvotes

r/StableDiffusion • • 1h ago

Question - Help Ltx 2.5 WONT work

0 Upvotes

Hi guys, so, Im on AMD 9070 XT, already using minimax H3 with 0 problems, and recently I wanted to try LTX 2.5 but wow, I just can't get it to run, always a gray video with static sound after a driver timeout, I tried many models, no matter what, always the driver will time out and I get fray outputs with no sound, all of that while minimax H3 runs perfectly.


r/StableDiffusion • • 3h ago

Discussion Update: Krea-2-Turbo now runs inside ComfyUI on my GTX 1650 Super (4 GB). ~30 s per image

60 Upvotes

Follow-up to my last post. A lot of you asked if this was real or a one-off script, so here it is running in ComfyUI.

  • GTX 1650 Super, 4 GB VRAM, 16 GB RAM
  • 8 steps, generated at 768, saved at 1024
  • 29–34 s per image once the model is loaded. The first one takes ~90 s on my (pretty slow) SSD; a faster drive should cut that
  • Single custom node, same workflow as any other model
  • LoRAs work, up to 2 at once
  • There's also a face-reference edit mode (~40 s); I'll show that next

Still not at my target (<10 s), working on it.

I'll release it to the public down the line, so stay tuned. It should run on most NVIDIA cards with 4 GB+ of VRAM: GTX 1650 / 1650 Super, GTX 1660 / 1660 Super / 1660 Ti, RTX 2060, RTX 3050, RTX 3060, RTX 4060 (laptop versions too).


r/StableDiffusion • • 3h ago

Question - Help Changing music genre locally possible? Like that blues version of 'move (b word), get out of the way'.

1 Upvotes

r/StableDiffusion • • 4h ago

Question - Help Hello! I'm looking for good AI servers or communities to join!

0 Upvotes

Hello! I've been looking for communities that deal with AI images or videos that I can join :p For example discord servers! And ones that aren't tied to one service and allow local generations as well, and also ones that are okay with explicit content. Similar to the Unstable Diffusion server or Civitai server :D if anyone has any recommendations do let me know!


r/StableDiffusion • • 4h ago

Resource - Update I made a ComfyUI node that runs your prompts in order from a spreadsheet, with {wildcard|support}

Post image
8 Upvotes

I made a custom node called Sequential CSV Wildcard because I wanted a better way then wildcards to run multiple prompts, since I felt like sometimes one version of the prompt would get selected way more than the others.

With this node, you write your prompts in a spreadsheet, one per row, and the node steps through them, one row per generation. Queue a batch and walk away.

A few things it does:

  • Reads prompts from a CSV saved out of Excel, LibreOffice Calc or Google Sheets
  • Supports wildcards inside each row, like a {red|blue|green} car on a beach
  • Lets you choose which column to read, skip a header row, and loop back to the start at the end
  • Has optional prefix and suffix boxes, so you don't have to repeat your quality tags on every row

One tip that'll save you some pain: save the CSV as UTF-8. Some programs (OpenOffice, for one) don't do that by default, and the node won't read the file. In LibreOffice, choose Text CSV, tick "Edit filter settings", and pick Unicode (UTF-8).

It's free and open source, and you can install it through ComfyUI-Manager.

Feedback is welcome!


r/StableDiffusion • • 4h ago

Workflow Included My updated character lora config AND Kromoss workflow

Thumbnail
gallery
57 Upvotes

Hi all!

I wanted to come share my updated Moss LoRa training config and also share some pics done with Kromoss, the finetune of MOSS done by Chroma creator, Lodestone. I've been using it a lot, and it's fantastic--even better, you can use LoRas trained on regular MOSS base with it without losing any likeness, which I love.

I've adapted the custom Er-SDE sampler from the other popular workflow that was shared here recently, which does improve image quality. I made a few small adjustments, including using a turbo LoRa at a low strength, and doing 15 to 20 steps. I've been using Kromoss BF16, but INT8 works just as well. I also finally found where I originally downloaded "lora_latest.safetensors" from--I knew it was made by Lodestone, but couldn't locate it in my last post. I realize now that it was made for SFT, that's why I couldn't find it in the base turbo lora huggingface page. Even though it's made for SFT, it works great with base MOSS and Kromoss.

I updated my LoRa training config a bit. My last one I shared was LoKr 4, and although I'm a HUGE fan of LoKr, I noticed with smaller datasets, it sometimes seems to affect the model itself when generating images. I played around with it a bit, and made another config that does LoRa 32, and works really well--all images seen here were done with LoRas trained using the rank 32 config linked here, except for the ones of Noel Fielding. For some reason, his face is a bit too complex for a rank 32 to get, so I continued to use my OG LoKr 4 for the images of him. For large datasets over 100 images, I still recommend using LoKr 4.

Other LoRas used for some of these images include the Canon and Lenovo LoRas by Danrisi. I encourage you guys to give Kromoss a try--it's pretty great.

Kromoss: https://huggingface.co/lodestones/Kromoss/blob/main/diffusion_models/kromoss_int8_convrot.safetensors

lora_latest.safetensors: https://huggingface.co/lodestones/MOSS-Image-SFT-8-steps-dmd/blob/main/lora_latest.safetensors

Lenovo: https://huggingface.co/Danrisi/lenovo_moss

Canon: https://huggingface.co/Danrisi/canon_moss

My current workflow and training config: https://gofile.io/d/YivgKOqV


r/StableDiffusion • • 6h ago

Animation - Video indie music video using local AI on my DGX Spark (Wan2GP + MiniMax H3)

Thumbnail
youtu.be
1 Upvotes

I've been experimenting with AI video generation on my DGX Spark and finally managed to finish a full music video.

It's for a fictional indie band called The Stochastic Parrots. Basically, a bunch of guys dressed as parrots playing psychedelic indie pop and getting into ridiculous situations.

The video is about 3 minutes long, made from roughly 20 main clips plus a dozen extra shots. Everything was generated locally using wan2gp nd MiniMax H3, then edited in davinci. Also it was coordinated by pi coding agent using glm 5.3 fast locally using wan2gp as an api.

I started with the song and used chatgpt to brainstorm the concept and generate around 60 reference images. The band performs in all sorts of places, from rooftops and supermarkets to airports and random backstage situations.

The hardest part was keeping the characters consistent. Faces changed, costumes mutated, instruments became weird objects, and sometimes people just disappeared halfway through a shot.

I used MiniMax H3 Ref2VA / FL2VA to animate the images. I also fed the corresponding sections of the song into the video generation process to help synchronize the performances.

Most clips were around 10 seconds long at 1280×704 and 24 fps, using 8 steps. Each took roughly 16 minutes on the Spark, although some needed several attempts before they looked decent.

One thing I learned is that simpler scenes work much better. A single character doing something funny was usually more convincing than having the entire band performing together. The black-and-white backstage footage also helped a lot, both visually and as a way to hide inconsistencies.

I used faster whisper to map the actual sung lyrics to the timeline, since the generated song didn't always follow the original lyrics exactly. Then I assembled everything in resolve, synced the cuts to the music, and added the extra footage.

I ended up with around 43 video takes for 20 main scenes, plus the additional cutaways. Total GPU generation and experimentation was somewhere around 20–30 hours.

I'm pretty happy with the result. It's not perfect, and there are definitely moments where you can tell it's AI-generated, but I think the editing and the absurd concept help bring it together.


r/StableDiffusion • • 7h ago

News 8 days ago, Reddit helped take our unrestricted Qwen Omni model to #8 out of 3M+ models. Today, we’re open-sourcing the Turbo LoRA-6.8× faster

Thumbnail
gallery
195 Upvotes

Eight days ago, I shared our Qwen-Image-2.1 Uncensored Omni release here.

What happened next was honestly insane.

You downloaded it, tested it, broke it, shared generations, reported problems, and helped push it to #8 trending out of more than 3 million models on Hugging Face.

So today, we’re releasing the next part:

Qwen-Image-2.1 Uncensored Omni — Turbo LoRA

The new Turbo LoRA runs in 8 steps with CFG 1.0, compared with the standard 35-step, CFG 5.0 workflow.

On our Playground hardware:

  • Standard Omni: 54.9 seconds per image
  • Omni + Turbo LoRA: 8.1 seconds per image
  • Speedup: 6.8×

It works for both:

  • Text-to-image generation
  • Instruction-based image editing
  • Approximately 1-megapixel output
  • ComfyUI and Diffusers workflows
  • GGUF, BF16, FP8, NF4, INT8 ConvRot and NVFP4 Omni builds

The release does not add a prompt filter or output safety checker.

What happened to quality?

We benchmarked Turbo at 8 steps against the same Omni model at 35 steps, using the same evaluation sets.

BenchmarkOmni, 35 stepsTurbo, 8 steps
Adult prompt adherence89.789.1
Anatomy69.472.9
General SFW prompts79.679.0
Image editing78.981.6
Identity preservation in human editing55.872.1

Prompt adherence and general SFW quality were within the statistical noise of the 35-step model, while anatomy, editing quality and identity preservation improved in our benchmark.

This is not intended to replace the original Qwen base model for every possible workflow. Its primary strength is unrestricted generation and editing—now with much faster iteration.

Download

Turbo LoRA — weights, settings, ComfyUI and Diffusers instructions:

https://huggingface.co/chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized#turbo-lora-8-steps-cfg-10

Starting settings:

  • Turbo LoRA strength: 1.0
  • Sampling steps: 8
  • True CFG: 1.0
  • No negative-prompt pass required

Add the Turbo LoRA on top of a supported Uncensored Omni build. The model card includes the exact workflow, benchmark methodology, checksums, compatibility notes and known limitations.

Try it free

https://thechatr.ai/playground

Our free Playground now generates more than 10,000 images every day.

Training new models, maintaining the infrastructure and keeping the Playground available require substantial GPU resources.

If you find our work useful, please support us in any way you can:

  • Star and share the repositories
  • Test the release and report issues
  • Post your generations and workflows
  • Help other users get it running
  • Contribute engineering or GPU resources
  • Sponsor future research

Every bit of support helps us keep the Playground running and continue releasing open-weight models for the community.

Thank you to everyone who helped turn this from an experiment into the #8 trending model out of more than 3 million models on Hugging Face.

The community made this happen. ❤️


r/StableDiffusion • • 8h ago

Question - Help Has anyone tried viggle remake?

0 Upvotes

Does anyone know whats the difference between viggle animate?


r/StableDiffusion • • 8h ago

Question - Help How to make continuous videos and stich them

1 Upvotes

Hi, So I'm new to this stuff. And I've been trying to learn a lot of community posts, LLM(s) and blogs. I am now successfully able to preserve the characters in the videos I make with Minimax H3 ref2v (the one that's possible to load on a 3090 (24 gb vram). I think its the int8 version. So, I make character sheets and location sheets so that the video model hallucination is reduced. But if I generate 720p, how can I continue the video from the exact frame on the next part? Please guide me someone, I've been trying to achieve this for months. If you have a workflow for this and ahare with me I'd really appreciate it. Although my current config is i5 12400, 32gb ddr4 3200 and a 3090 (gpu unlock enabled). I am able to generate 720p videos in around 2800s. My objective is to stich them and make short movie type things or reels where I can continue the story maybe by episodes or something. Please help me out (crying at this point).


r/StableDiffusion • • 8h ago

News Steppe-Wan2.1: SOTA latent upscaler for Wan 2.1, Krea 2 and Qwen Image that support both images and videos, spatial and temporal upscaling, precise control over sharpness (ComfyUI nodes, demo Space)

Thumbnail
gallery
37 Upvotes

Hi! Steppe-Wan2.1 is my new generative latent upscaler for Wan 2.1 latent space, which also include Krea 2, Qwen Image (don't confuse with Qwen Image 2.1, it has other VAE) and some other models. It is set of model of different scales trained from scratch on a large dataset of images and video (millions of samples, ~300 GPU hours) to perform 2x super-resolution task directly in latent space. Unlike the "traditional" two stage approach where a first deterministic latent upscaler makes blurry latents and then large generative model fixes it through some denoising steps, this model's output can be decoded directly. This is much faster and also keeps more information from low resolution latents while achieving best fidelity, reconstruction and some other metrics (pic 2, 3).

- ComfyUI nodes: https://github.com/tensorforger/ComfyUI-Steppe (or simply search "steppe" in manager)

- Hugging Face demo space (you can try it in browser on your images): https://huggingface.co/spaces/TensorForger/Steppe

- Weights: https://huggingface.co/TensorForger/Steppe-Wan2.1 (ComfyUI node downloads required weights automatically)

Key features:

- Support images and videos.

- For video it can do both spatial and temporal upscaling, even both in a single forward pass

- You can control the output sharpness through High Frequency Features Conditioning (HFF), pic 4. It works like a "prompt" describing how sharp details should be in the output. The model doesn't take prompt by the way, it understand image content from input low resolution sample alone (pic 5).

- There are three models in this release: multi-step 200M parameter base model (best control, can use CFG over the HFF), it's distilled single step version (also 200M, best for most tasks) and light 20M distilled single step model (for extremely high resolution upscaling or real-time video upscaling).

- Support different aspect ratios, resolutions and video lengths because it it trained on there different combinations.

Deeper implementation details:

Development codebase: https://github.com/tensorforger/STDev

- The model's architecture was discovered through long agentic autoresearch loop (pic 7). Claude Opus 5.5 run ~120 experiments trying everything starting from convolutional UNets with different configurations, transformers, various hybrid architectures, training losses, objectives, batch and lr schedules... It was inspired with https://github.com/karpathy/autoresearch, but adapted to the task and run in parallel on 8 GPUs. The agent's task was to achieve best patch_fid metric while having 30 minutes of RTX5090 compute. Then best runs was scaled to 2 hour training, best in total was scaled up and used for base model pretrain. You can read the logs of autoresearch in dev repository.

- The resulted architecture is some combination of Swin transformer with local window attention, convolutional layers, two input low resolution sample paths (learned and not) and some actually novel training stability improvements.

- The model is local both in space and time: the window attention can be computed in chunks and temporal path is fully causal (so it can be used for frame by frame streaming). These optimizations reduce VRAM usage and they are implemented in ComfyUI nodes.

- To reproduce benchmarks see dev repository.

Now some thoughts about all this

It is quite surprising how many different approaches are there to get high resolution image from generated latents. Conceptually, they are "Decode, then Upscale", "Upscale, then Decode" and "Upscale during Decode". "Decode, then Upscale" hits several problems of expensive high resolution compute and sensitivity to AI-generated artifacts. Any small mistake of decoder becomes larger. "Upscale during Decode" is quite interesting. It is spacepxl/Wan2.1-VAE-upscale2x and Nvidia-Pid. I can't say it is bad or something, it is a good direction too. And if the latency is critical for you spacepxl/Wan2.1-VAE-upscale2x is still a great alternative. Nvidia-Pid is just bad) It completely changes structure and has huge color shift, so it was not even benchmarked here. "Upscale, then Decode" can also be done in many ways. I already mentioned "traditional" approach above. But there is another one: fuse upscaler with large generative model. Examples are "Hildegard" for Flux.2 and new Nvidia's Open-H3-Regenerate-2K. My model is another point in this space, and I believe this is a good direction.


r/StableDiffusion • • 10h ago

Question - Help Is a 4080 Super worth it for local video generation or wait? (Currently on a 5060 Ti 16GB)

1 Upvotes

I got a pretty good deal on my 5060 Ti 16GB last year. I’d already done quite a bit of image generation and played around with video too. When MiniMax H3 came out, I tried it, but the clips didn’t turn out as good as I wanted. Before I could get better at it, my screen started going black under heavy GPU load. (It first happened while I was playing a game, but that’s beside the point.). After playing around with when and how it blacks out, I think it happens when my VR offloads into normal ram so I can’t really test out video degeneration to its full extent anymore.

I found a 4080 Super in my price range, but I’ve pretty much used up my fun-money budget for the year. Normally I’d wait for the next gen, but with that whole Jensen Huang scandal, who knows when the next GeForce cards are coming out.

I know the 4080 Super is faster, but 16GB is still 16GB. If you’ve made a similar jump, did the extra speed make heavier video workflows feel doable?
What I’m really wondering is whether video models are going to keep getting bigger until 24GB becomes the norm. Do you guys see that happening over the next few years, or do you think stuff like quantization will keep 16GB usable for a while?

I’ve been kinda “out of the game” with local video, even back when I was trying H3 Mini Max, so I’m not really sure where things are headed. (I remember when 16GB of system RAM was the norm and then 32GB started feeling normal. I wonder if we’ll see the same escalation with VRAM.)

(I’m leaning toward skipping the 4080 Super and saving up, but I’d like to hear where people think things are headed before I decide.)

P.S. Anyone here tried a modded GPU with double the VRAM for local video? How’s it been?

A few extra details:

* I’m planning to keep the 5060 Ti. If I do sell it, I’ll probably just give my brother a good deal and call it a day.
I have a pretty high-end spare PC just sitting there waiting for a GPU, so it’s tempting to throw the 4080 Super in there and actually use it.
I have somewhere to run it where I don’t have to worry about the electric bill lol.


r/StableDiffusion • • 10h ago

News DFlow2 - 50 -> 4 Step Distillation LoRA, eDMD + LADD (with Torch and MLX ComfyUI Workflows)

Thumbnail
gallery
4 Upvotes

Earlier today u/quantiler posted about a small (2B) indie text to image work in progress model, which runs at 50 steps cfg 2.5 by default. Even if still work in progress, I think the model is great already (especially for the size of 2B), so all credit goes to u/quantiler for a job well done!

I, on the other hand, made a 4 Step CFG 1 Distillation LoRA using eDMD + LaDD. I also made available custom ComfyUI nodes allowing LoRA to load on DFlow2 model and run in either Torch or MLX (as part of my LVNodes pack).

LoRA, Workflows and Details at: https://huggingface.co/lvladikov/DFlow2-Distill-4steps-eDMD-LADD-LoRA

Enjoy, and keep in mind both the model and the LoRA are still in progress, so issues are possible, but it's still a very good 2B model.

We should all keep an eye on DFlow2 and how it progresses further.


r/StableDiffusion • • 11h ago

Question - Help WanGP installation problems

Post image
0 Upvotes

Hey guys, I'm trying to install an AI program/app for the first time but I've hit a block. I heard about WanGP and decided to use the manager to install everything and after it downloaded some prerequisite files, when I click Install WanGP, it says the file already exists and I'm not sure what's the problem. I know absolutely nothing about programming, coding or using any AI program. I'm a total newbie, lol. Any help would be greatly appreciated.


r/StableDiffusion • • 11h ago

News ComfyUI just released model rankings by usage

Thumbnail
gallery
123 Upvotes

Z-image is probably highest because it's the default. Krea 2 is higher than I thought though. Not sure how accurate this is.

Source: https://router.comfy.org/#rankings


r/StableDiffusion • • 11h ago

Question - Help Inquiry regarding GPUs and local image generation

1 Upvotes

Hey all,

So, I'm interested in image generation and image editing locally using AI. I have two devices that I currently believe could be useful to this end, though I'm not certain which would be best, and was hoping someone experienced could give their thoughts.

For the reference, my goal is that I'd be able to generate high quality, photorealistic images and editing of such images with a reference object that are accurate. The quality is really my biggest criterion. I'm okay with waiting many minutes for generation itself, and don't need super fast generation. Please let me know if this is possible with what I list below, or if I should try/buy something else.

The first device I have is an older one, from around ~2020. It's a Lenovo P73 laptop with 128 GB DDR4 RAM (3200 MHz iirc), and a Quadro RTX 5000M with 16 GB of VRAM (note that this is the M version, not the full desktop version). It has an i7 from that time, and SSD and HDD from that time as well, so nothing particularly modern. I'm uncertain how good/effective this would be for my goals and current models.

The other device I have is a newer one, a laptop with 96 GB of DDR5 RAM (5600 MHz) and 2GB of VRAM from the integrated graphics of the AMD 8845HS processor. Has a modern SSD, if that matters. I imagine that if I wanted to use this one, I'd need to get an eGPU or something, though I'm not certain how useful eGPUs are for performance in image generation.

Ideally, I'd like to not spend a significant amount of money (1k would be best, but up to 1.5k or maybe 2k USD might be alright). Please let me know your thoughts.

Thanks in advance!


r/StableDiffusion • • 12h ago

Discussion I’m not sure if adaptive optimizers work well with the new generation of models. In many cases, it seems that using a fixed learning rate is better.

0 Upvotes

I know they were very important back in the SDXL era.

However, it seems that with flow-matching models (I believe all models released after Flux use this distribution), adaptive optimizers tend to underestimate learning rates.

The graph doesn't follow the same logic as it does for diffusion models.


r/StableDiffusion • • 12h ago

Discussion Feedback wanted on my new Ekphrasis Prompt Bench tool

Thumbnail
gallery
2 Upvotes

I've been building a tool for my own Krea 2 work, and it has grown into something others might find useful, so I've put it on GitHub.

Ekphrasis Prompt Bench is a local web app that drives vision models in LM Studio. Everything runs on your own machine – no cloud, no accounts.

What it does

  • Describe – turns folders of images into prompts written in each target model's own format: Krea 2, MOSS-Image, Ideogram 4 (JSON with boxes), Wan 2.2 and more. Modifier chips change style, setting, era, medium and lighting; a trigger word and training-caption output for LoRA datasets.
  • Photobash – fuse 2–4 pictures (or random picks from folders and hand-picked pools) into one coherent new picture. Blend them by weight, or draw each aspect (subject, pose, light, palette, era …) from a different source per mix. Great for creative accidents you'd never think of.
  • Ideas – prompts with no source image: many takes on a brief, random dice rolls of genre / era / medium / light, or full wildcard templates with a searchable browser for your wildcard library.
  • Rewrite – convert old SDXL tag prompts, or any kind of prompt, into any other format, including proper natural-language prompts; restyle a whole list ("make it a professional photograph", "more surreal"), refine against the source image, or make minimal-edit twin pairs.
  • Render – a render button on every prompt sends it to your own ComfyUI workflow (local models, or any API service your workflow uses) and shows the image right under the prompt, so you can edit and iterate.
  • Review – for sweeps: rate renders, grade the prompts themselves (great / ok / duff), keep a library of your best prompts, and let a vision model check whether renders follow their prompt – including whether a photobash failed because of the prompt, the combination of sources, or the image model.

Requirements

Windows, Python and LM Studio with a vision model (the Qwen-VL family works well). ComfyUI is optional, for rendering.

License and feedback

Free for non-commercial use (dual license). It's built for my own workflow first, so I'd love feedback from people who work differently – what's missing, what's confusing, what breaks.

GitHub: https://github.com/EricRollei/Ekphrasis-Prompt-Bench

(The name: ekphrasis is the old Greek art of describing a work of art in words.)


r/StableDiffusion • • 12h ago

News pi-H3: 2–4 Steps Without a VAE Decoder (model released)

Thumbnail
github.com
55 Upvotes

Disclaimer: I am not associated with the project in any way.

An update on my earlier post: https://www.reddit.com/r/StableDiffusion/comments/1xt8tsf/pih3_24_steps_without_a_vae_decoder_will_be/

So as promised by the developers, the model weights and the codes and workflow for running it has been released. Please follow the instruction on how to set it up in ComfyUI: https://github.com/Lakonik/ComfyUI-piFlow/blob/main/docs/piH3.md

The announcement: https://hanshengchen.com/blog/pi-h3/

We announce pi-H3, the fastest version of MiniMax H3 [1] yet. pi-H3 generates video in just 2 or 4 sampling steps and directly predicts pixels at the final step, skipping the video VAE decoder. On a single B200 it produces 5-second HD videos in 3.8 seconds (sub real-time) and 15-second videos in 18.6 seconds, more than twice as fast as Sol-H3 [4].

pi-H3 is an open-source research project. The Hugging Face demo, the model weights and the inference code in LakonLab [2] are available now, with ComfyUI support through the ComfyUI-piFlow [3] extension. The training code will follow in LakonLab.


r/StableDiffusion • • 13h ago

Question - Help Am I doing anything wrong or H3 Image edit is just that bad?

3 Upvotes

I'm trying the official workflow in ComfyUI and I'm getting pretty bad results. I don't know if it is me doing something stupid or just the model being just bad (I really doub it).

This is one of the pictures I made using 8MP (The workflow should be in it)r:

The prompt was:

Aspect ratio: 16:9
Request: Create an image showing the entrance to a magnificient castle. The entrance is a bit to the right and on the left a bit of a forest can be seen by the stone way that leads to the castle. High detail. Use image 1 for a style reference. Extract lineart, colors and mood and just that.

I used prompt upsampler.

The picture I used as a style reference in the image 1 slot was:

As you can see the output picture lacks detail and it is really blurry for a 8MP image. Is there anything I could do about it?

Thanks in advance!


r/StableDiffusion • • 13h ago

Question - Help is there a way to upscale/fix a region partially from video?

0 Upvotes

like you're inpainting, or just enhancing a specific part of the image for more details, with 2d models.
i'm talking about minimax h3 for this, but if there are other video models that can do this i'd like to know


r/StableDiffusion • • 14h ago

Question - Help How are you guys getting Minimax H3 ref to do decent dialog with input reference voices?

2 Upvotes

With or without turbo LoRA's using the Int8_convrot I always get kind of clippy bad audio when using a reference voice.

When I extend a clip, even following the voice reference, it can sound "too" different, unless the latent before that it extends ALSO has that character speaking.

Any tips?

So far what I've been doing is running low res seeds until I get a nice once, then use that as the definitive audio for the clip and run it again high res. But that can get tedious running seeds until the voice actually matches. Chatterbox and stuff works, but not for natural UGC style clips with background noise and so on.

Yes I am prompting it all correctly.


r/StableDiffusion • • 14h ago Bravo

Workflow Included MiniMax H3 + An Underwater World = One of My Favorite AI Videos So Far

41 Upvotes

Watch on YouTube if still pending - Watch On YouTube
I've been playing around with my AI music video builder in ComfyUI, and this time I decided to create an entire music video that takes place underwater.

Please leave your rude and disrespectful comments to yourself, they help no one.

I wasn't sure how it would all come together since Minimax probably wasn't trained on singing or speaking underwater, but IMO I think the underwater environments, lighting, and movement turned out really neat besides some lip sync issues here and there.

The video was generated using my Video builder UI inside ComfyUI.

Just wanted to share because I thought the results were pretty cool!

Here is a post on how to get the video builder up and running locally and fully open source on your PC HERE

Nodes: Go to my GitHub

Discord Community to share video's you create using the builder or to get support: Join here

More Video's I created using the video builder Playlist

Model settings I used for this video

Models

  • Video model: Minimax-h3_Singularity_ref2va_Pruned_v1.3_int8.safetensor

Output Res = 2K 1920x1080

Pass 1

  • Steps: 25
  • Sampler: res_multistep
  • Scheduler: simple

Pass 2 (using the latent upscaler)

  • LoRA: minimax_h3_open_regenerate_2k_refiner_rank_16_bf16.safetensors
  • LoRA strength: 1.0
  • Steps: 3
  • Denoise: 0.20
  • Sampler: res_multistep
  • Scheduler: simple

A 2 pass workflow can be found HERE just swap out the lora with the one above.

Note: I did run this through a topaz enhance pass to help with some of the far away faces but it really was not even needed. Just sharpened stuff up a bit.

ALSO:

I'm sharing this because I like what I created, not because I'm asking for rude criticism or unsolicited advice. Just because something isn't to your personal taste doesn't automatically make it bad. I made this the way I wanted it, and I'm happy with how it turned out. If you would have done it differently, that's perfectly fine! You're welcome to create your own version. Not everything someone shares needs to be picked apart just because it's not how you would have done it.


r/StableDiffusion • • 14h ago Bravo

Resource - Update New voice isolation model from Inworld

233 Upvotes

Inworld Voice Isolator is a speech enhancement model that separates foreground speech from background noise, music, and chatter. It aims to preserve the speaker’s voice and natural sounds such as breaths and laughter.

It provides two checkpoints: an offline model for processing recordings and a causal model for real-time streaming. Both operate at 48 kHz.

Support is now available in audio.cpp v0.9.6, with GGUF models and local inference across various backends, including WebGPU.

Repo: https://huggingface.co/inworld/voice-isolator/tree/main