r/comfyui • u/Inevitable_Emu2722 • 13h ago
Show and Tell indie music video using local AI on my DGX Spark (Wan2GP + MiniMax H3)
I've been experimenting with AI video generation on my DGX Spark and finally managed to finish a full music video.
It's for a fictional indie band called The Stochastic Parrots. Basically, a bunch of guys dressed as parrots playing psychedelic indie pop and getting into ridiculous situations.
The video is about 3 minutes long, made from roughly 20 main clips plus a dozen extra shots. Everything was generated locally using wan2gp nd MiniMax H3, then edited in davinci. Also it was coordinated by pi coding agent using glm 5.3 fast locally using wan2gp as an api.
I started with the song and used chatgpt to brainstorm the concept and generate around 60 reference images. The band performs in all sorts of places, from rooftops and supermarkets to airports and random backstage situations.
The hardest part was keeping the characters consistent. Faces changed, costumes mutated, instruments became weird objects, and sometimes people just disappeared halfway through a shot.
I used MiniMax H3 Ref2VA / FL2VA to animate the images. I also fed the corresponding sections of the song into the video generation process to help synchronize the performances.
Most clips were around 10 seconds long at 1280×704 and 24 fps, using 8 steps. Each took roughly 16 minutes on the Spark, although some needed several attempts before they looked decent.
One thing I learned is that simpler scenes work much better. A single character doing something funny was usually more convincing than having the entire band performing together. The black-and-white backstage footage also helped a lot, both visually and as a way to hide inconsistencies.
I used faster whisper to map the actual sung lyrics to the timeline, since the generated song didn't always follow the original lyrics exactly. Then I assembled everything in resolve, synced the cuts to the music, and added the extra footage.
I ended up with around 43 video takes for 20 main scenes, plus the additional cutaways. Total GPU generation and experimentation was somewhere around 20–30 hours.
I'm pretty happy with the result. It's not perfect, and there are definitely moments where you can tell it's AI-generated, but I think the editing and the absurd concept help bring it together.
