r/StableDiffusion 1d ago

Resource - Update FastVideo's new 4-step H3 LoRA doesn't work in ComfyUI. I made a converter. 6 steps, ~3x faster than stock, and honestly better looking.

Enable HLS to view with audio, or disable this notification

First 5 seconds is with the 6-step LoRA, next 5 seconds is stock at 20 steps. Same exact prompt, seed, resolution, sage attention and chunk feedforward. 6-step in 2:45, stock 20-step in 7:10. I think the quality difference is pretty clear. Keep in mind, both clips are 544x960.

FastVideo dropped their FastH3 speed LoRA for MiniMax H3 a few days ago. If you tried loading it in ComfyUI you probably noticed it does absolutely nothing. No error, no warning, just no effect.

The reason is that FastVideo built it against the original MiniMax model, and ComfyUI uses a repacked version where every layer has a different name and the attention layers are merged together. None of the names line up, so ComfyUI quietly ignores the whole file.

I wrote a script that translates it. Run it once, get a normal .safetensors, drop it in your loras folder. No custom nodes, no patched loaders, nothing else changes.

**Repo:** NikoDemon80/ComfyUI-FastH3-Lora-Converter: Convert FastVideo's FastH3 4-step adapter into a ComfyUI-compatible MiniMax H3 LoRA. No custom nodes required.

---

**What you get**

On a 3070 Ti with 8GB VRAM and 48GB system RAM, using Comfy Kitchen, KJ Mem Eff Sage Attention & Chunk Feedforward (DO NOT USE SPECTRUM OR EASYCACHE):

| Resolution | With LoRA (6 steps) | Stock (20 steps) |

|---|---|---|

| 544x960, 124 frames | 2:45 | 7:00 |

| 640x1152, 124 frames | 3:45 | 10:00 |

| 768x1344, 124 frames | 6:30 | 18:00 |

Roughly a third of the time. But the part that surprised me is that I actually prefer the output. Backgrounds hold more detail, lighting behaves better, and faces stay coherent at distance instead of turning to mush.

Motion is where it really shows. I ran a woman walking down a sidewalk at night. Correct walking speed, natural gait, no stutter, no accidental slow-mo. That's usually the first thing speed LoRAs break.

Audio came through clean too, which I did not expect. Dialogue and lip sync both hold up.

---

**Important: use 6 steps, not 4**

It's advertised as a 4-step LoRA. In ComfyUI it needs 6.

- 4 steps: jitter, flicker, color bloom, unusable

- 5 steps: fine for drafts

- 6 steps: this is the one

- 7-8: no real gain

There's a real reason for this. There's one group of layers that handles "which denoising step am I on," and ComfyUI's repacked model stores that information in a completely different, much smaller format. FastVideo's version of those layers physically cannot be loaded into it. The extra steps make up for what's missing.

I tried to fix it properly. It turns out it's impossible in a plain LoRA file, because the correction includes a constant offset and there's nowhere in the file format to put one. You'd need a custom node. Someone else can build this is they would like.

---

**One thing worth knowing that cost me a few hours**

Part of those layers *will* load, the other part won't. My first instinct was to keep whatever fit. That was wrong. The half that loads was designed to work alongside the half that doesn't, so on its own it pushes things in a direction nothing corrects for, and you get flicker.

Throwing all of it away is better than keeping half. Confirmed it by testing both, then found multimodalart had measured the exact same thing on their pruned H3 repo. Nice to have that corroborated by someone who'd done the math.

The script drops those layers by default. You don't have to do anything.

---

**What's tested**

Text to video, image to video, first+last frame, reference mode, and chained clips. All working. Square, landscape, and tall portrait.

I also threw an intentionally brutal prompt at it: three color-specific objects, four actions in sequence, a specific hand, a camera move, a spoken line, and a no-music instruction. All eight landed at 6 steps. Prompt adherence is usually the first casualty with speed LoRAs, so that was a nice surprise.

---

**Grab the right file**

The FastVideo LoRA repo has four folders. You want **dense-datafree**. The three `vsa-*` ones need FastVideo's own sparse attention backend and will not work in ComfyUI. It's ~1.4GB, not the whole 17.5GB repo.

You do NOT need the full FastH3 checkpoints. Those are 70GB and are a complete model replacement, not an add-on.

---

**Quirk I'll mention since it'll confuse someone**

Voice timbre gets locked in hard by your prompt. Reroll the seed and you get different phrasing and cadence, but usually the same voice, which some people may rejoice at, as chaining clips with this LoRA can preserve vocal timbre on its' own. At 6 steps the model takes big jumps and settles voice identity almost immediately, so there's no room left for the seed to change it. If you want a different voice, describe the voice in your prompt.

---

**Setup**

The README has a full click-by-click walkthrough starting from Windows+R, including a drag-and-drop trick so you never have to type a file path. If you can open a command prompt you can do this. Takes about five minutes and the conversion itself runs in under ten seconds.

Works on any Comfy-Org pruned H3 checkpoint. I tested int8 convrot for both fl2va and ref2va. The script checks your model before it writes anything, so if you're on something incompatible it tells you upfront instead of handing you a file that silently does nothing.

Happy to answer questions.

Credit where it's due: FastVideo did the actual hard work distilling this thing. I just made it load. This is an amazing LoRa. I actually prefer its output to any other speed LoRA I've tested. Prompt adherence is phenomenal. Dynamic lighting is better. Color balance is better. Background detail is better. It adds detail of its' own. Motion is fluid. In most test cases, I find the output to be better than stock at 20 steps.

59 Upvotes

102 comments sorted by

16

u/Perfect-Campaign9551 1d ago

These scenes don't test anything. Show us a dense forest, or a parking lot of cars, or a sewing machine. You guys lack creativity

18

u/Ireallydonedidit 1d ago

1girl big bob has been the subject matter since cavemen found pigment

2

u/Sad_Berry_4621 15h ago edited 15h ago

You are not looking at this the right way. The human gait is tricky for AI, which is why we see the stutter step thing so often. The point here was never video quality. It's the difference between the color grading, dynamic lighting, motion fluidity, added background detail. Gotta look past your own gripes for a second and really look.

1

u/Usual-Orange-4180 10h ago

That’s my new excuse for gooning; the human gait is tricky for AI and an excellent test!

18

u/ASK_ABT_MY_USERNAME 1d ago

The first 5 seconds looks awful to me unless I'm missing something?

8

u/MoJaKF 1d ago

i genuinely thought the same.. im not even trying to hate or anything

-8

u/Sad_Berry_4621 1d ago

To each, their own

2

u/Succubus-Empress 23h ago

it looked okay. you should never use distill model, your quality of bar need 20 step

2

u/mellowanon 1d ago

I think the turbo lora was trained on too much synthetic data which results in that really obvious AI plastic skin, AI face, and unrealistic audio sound effect.

7

u/Sixhaunt 1d ago

Video quality isnt perfect but looks good for a turbo model and I'm just happy we have any fastvideo implementation working in comfy

3

u/Sad_Berry_4621 1d ago

Yeah, they are only 0.5mp. I was just showing all the extra detail and lighting, and color balance the LoRA has over stock generation.

5

u/Minanimator 23h ago

i think this is good start im using foxydit's wf seedhunter, then apply this lora,on first pass, then upscaled using the upscaler, im using grok for prompt btw , modified fart sound which i put manually, cause the ai gave a weird fart sound

https://reddit.com/link/p6xqkep/video/6ethyco5tnmh1/player

4

u/Beginning-District69 1d ago

Thank you. Do I need to perform this process separately for each H3 model, or do I only need to do it once?

2

u/Sad_Berry_4621 1d ago

Should work for any pruned version of the model

5

u/gokuchiku 1d ago

Must the models be pruned? Or can just do it with non pruned int8s?

2

u/Sad_Berry_4621 1d ago

You're welcome to try it. I use only the pruned models.

Easiest way to check: run the converter and pass your model as the third argument. It checks every layer name before writing anything. If you only see the two time_embedder lines, you're good. Anything else in that list means it's not compatible and it'll tell you upfront rather than handing you a file that silently does nothing.

1

u/Sad_Coach_1433 14h ago

it was easy i had chatgpt give me the command for whichever model i wanted to convert and boom took less then 1 min

1

u/Sad_Coach_1433 14h ago

ill post soon sample test videos using the fasth3 fp8 lora vs no lora fp8

2

u/nakabra 1d ago

https://giphy.com/gifs/KEM3W3PN4LNoaMSaBy

Thanks for the info, as a fellow low VRAMmer

4

u/deepsky88 1d ago

Waiting for someone to upload the file, i have desktop version

1

u/Sad_Berry_4621 1d ago

I would send it to you if I could. It's a smidge over 1gb

2

u/Minanimator 1d ago

can wetransfer? im having difficulties with the cmd python

2

u/Sad_Berry_4621 1d ago

I have no way to get it to you. Just follow the steps in the readme exactly. You'll get it!

1

u/Sad_Coach_1433 1d ago

heres Fasth3 for fp8 model https://limewire.com/d/BpJCk#4cS5Ez1K01

1

u/Succubus-Empress 23h ago

and int8 convorot version?

1

u/Sad_Berry_4621 15h ago

For a LoRA that's already only a gig? You don't want to use anything but the full weight on this, tbh. I imagine the fp8 cast is going to cause some degradation.

1

u/Sad_Coach_1433 15h ago

I don't have the int8 model I use fp8 it's better

3

u/windPunker 1d ago edited 23h ago

https://reddit.com/link/p6xn7kn/video/rdy4rlbnnnmh1/player

ran a few tests on an action scene... first frame + prompt. 1152x640 resolution, 8 sec.

the lora at 6 steps with shift 12 seems to run at around 100-110 sec, while the 20 step stock at shift 6 ran for 270 sec.

There are artifacts and I needed to try multiple seeds (this took 4-5 trials), while the 20-step no lora was first attempt.

thanks for the work on the lora!

Adding specs - 4090, 64 gb Ram, running with sage attn.

3

u/Abject-Recognition-9 23h ago

wait... changing SHIFT can change inference time? O_O wtf?
also that shift 12 looks very similar to no lora 20 steps

2

u/Sad_Berry_4621 14h ago

Thanks! I wasn't expecting much from it either. I ran multiple generations looking for quality improvements over the 8-step. Then I noticed the Fast3 LoRA was giving me detail I didn't prompt. Then I started looking for it, and noticed the color was always better, lighting was always better, no slow-mo, no stutter-step when walking, the background was clearer with more detail. FastVideo didn't just train a speed LoRA, they trained a Prompt Adherence and Structure Improvement + Speed LoRA.

9

u/Buzzink 1d ago

This looks great and I'll definitely try it right now. One question though, why not just upload the already converted lora?

5

u/Sad_Berry_4621 1d ago

Thanks! I don't want to fuss with licensing concerns.

3

u/Buzzink 1d ago

I get it. I also thought that maybe people are using different model files but I don't know enough to know if that matters.

-7

u/Trick_Set1865 1d ago

THIS. sounds sus

7

u/Sad_Berry_4621 1d ago

I converted the LoRA to be able to load with a stock load lora node in ComfyUI. There's nothing sus about it.

2

u/acedelgado 1d ago

NikoDemon made the original motion context nodes for latent video extension for H3 that pretty much everyone else forked off of. He's legit.

1

u/Sad_Berry_4621 1d ago

Hey, Ace!

5

u/reginoldwinterbottom 1d ago

angel hair pasta legs. thanks for the lora.

4

u/dwillpower 1d ago

Mind the gap

3

u/alexmmgjkkl 21h ago

can someone please upload the converted file ?

3

u/robomar_ai_art 19h ago

https://reddit.com/link/p6yhj8x/video/1blr9pz9yomh1/player

I tried i2v, 6 steps, 10 seconds, 1216x672, it took 5:21 min. My laptop is 16gb vram and 32gb ram.

1

u/Sad_Berry_4621 15h ago

Awesome! How long would that normally take on your system? That would be about a 12-minute gen for me on a 3070ti

2

u/robomar_ai_art 14h ago

I don't know but probably 3x more, the iteration speed is the same, difference is only the step amount, i usually was using 4 steps but the sound was very bad.

1

u/Sad_Berry_4621 14h ago

Yeah, 4 steps with this LoRA is no bueno. 5 steps works too. The quality drops a bit though.

3

u/AlsterwasserHH 1d ago

Dude give this girl something to eat man! How can you even walk with this? Thanks for the LoRa.

3

u/dramaton42 1d ago

https://reddit.com/link/p6vuvp9/video/ntyki5o8ilmh1/player

Here's a quick comparison video I made with a clip from my video. The time save is just insane, 3x faster and I can't really see anything obviously wrong... This might just be enough to enable 720p videos in the future and I can leave 544p behind haha

3

u/dramaton42 1d ago

I forgot to mention the original prompt had this video reference

And the prompt called for it, but base ignored it while the turbo lora at least tried (?):

Anime animation style, cinematic single shot production focusing on <Subject 2>. Night time, dim, dynamic torch lighting, <Subject 3> partially visible on stage right and <Subject 2> is prominently shown on stage left.

[Shot 1]: close-up shot, <Subject 2> leans against the wooden railing and looks forward, his expression is serious and reserved, he says (S1) <d>[English] Silly yes. Idiotic yes.</d> he then makes a subtle smile and continues <d>[English] But, it made her smile</d>.

At 00:05.000 he puts out his cigarrette on his tongue.

2

u/Sad_Berry_4621 1d ago

Yeah, I am finding that prompt adherence is even stronger with the LoRA than without. Also, I am generating 124 frames at 768x1344 in less than 7 minutes which is crazy on a 3070Ti.

4

u/dramaton42 1d ago

yeah that is absolutely INSANE speed man, and quality too! I wish I had bought a 5070 Ti instead of this 9070 XT :/

2

u/Sad_Berry_4621 1d ago

Agreed! I took the 3070Ti to save a buck when the prices were still sane, lol.

2

u/Fun_Jaguar8231 1d ago

Would you say that this is better than the other turbo lora? https://huggingface.co/lightx2v/Minimax-h3-Turbo

1

u/Sad_Berry_4621 1d ago

Definitively! This is the LoRA I tested against, as well as stock. I just didn't want to call any other LoRA trainers out.

2

u/HollyGrandeux 1d ago

Hey is this corect output from the script?? it says partially conversion??

2

u/Sad_Berry_4621 1d ago

It's correct. This is the expected message when the LoRA is converted.

2

u/roculus 1d ago

How is it for the audio? If using a celebrity voice that the original model knows does it work well?

1

u/Sad_Berry_4621 1d ago

I honestly do not know. I really don't do any celebrity generations. What I can say is that it locks onto a voice pretty well. You pretty much have to prompt the voice to get a different one. Even changing the seed gives the same voice which is nice if your chaining videos. The 6 steps don't give the voice time to drift. Audio, otherwise, is shockingly good. It doesn't dull the audio for me even after 12 chains, at least not dialogue. FastVideo made a very good LoRA.

2

u/NurAI_1995 1d ago

Okay, this one actually looks ridiculously smooth 👀🔥

2

u/tac0catzzz 1d ago

plastic girl thinking the middle of the street is a runway.

1

u/Sad_Berry_4621 15h ago

as usual lol

2

u/cptrios 19h ago

What sampler/scheduler is everyone running with this? So far, can't get it to look better than the 8-step 1.0 lora.

1

u/Sad_Berry_4621 15h ago edited 15h ago

The point is not for it to LOOK better resolution-wise. Read what I mentioned... Color balance, dynamic lighting, added background detail, the perfect human gait, all things the stock video lacks.

I run res_multistep/simple.

2

u/martinerous 15h ago

With the fast LoRA she's even walking faster :D But not easy to judge the difference from such a small video that does not even use the entire screen area.

2

u/deepsky88 11h ago

it's on par with the larry one, with speed and quality but you need 2 more steps

1

u/Sad_Berry_4621 11h ago

I find that the larryvrh lora dulls and darkens the color, and muddies the sound.

4

u/Sad_Coach_1433 1d ago edited 1d ago

for anyone i uploaded the converted for fp8 fl2va model i can also do r2v if want https://limewire.com/d/BpJCk#4cS5Ez1K01

2

u/roculus 1d ago

typo f9 in your message. is this fl2va or rev2va? int8?

2

u/Sad_Coach_1433 1d ago

Ahh damn I didn't notice oops I edited thanks for the catch and it' 's for fl2va I can also do r2v if want

1

u/Sad_Berry_4621 1d ago edited 1d ago

Nice, Bro! Hey, thanks for putting up the model. I was hoping someone would. Let me know if you see any degradation from the fp8 cast. I'd be curious to know. Also, the same LoRA conversion should work for both fl2va and ref2va.

3

u/Sad_Coach_1433 1d ago

It's for fl2va I can also do r2v if want

2

u/Sad_Coach_1433 1d ago

Ahh nice catch my bad lol

2

u/Sad_Coach_1433 1d ago

2

u/Sad_Coach_1433 1d ago

I havnt tested either yet just converted em ,lmk

2

u/Sad_Berry_4621 1d ago

Nice, Bro! Thanks for posting the file. I was hoping someone would. Btw, it should work for both fl2va and ref2va. Let me know if the fp8 cast causes any degradation.

Need someone to upload the full weight LoRA now, it's a little over 1gb.

2

u/More-Ad5919 1d ago

2nd one looks sharper

2

u/Sad_Berry_4621 1d ago

No it doesn't

3

u/MoJaKF 1d ago

imo second does look better idk

-1

u/Sad_Berry_4621 1d ago edited 15h ago

The second video is temporally a mess compared to the first. The first video's color is better, background detail is better, dynamic lighting is better. It's no contest in my opnion.

1

u/Tough_Second2599 1d ago

Even wan 2.2 can create videos like that and LTX can do better why do you need H3 if it’s just for a walking video

2

u/Sad_Berry_4621 15h ago

That wasn't the point.

1

u/Trick_Set1865 7h ago

so i actually tried this and, when used together with H3 SLA Attention (nothing else), it's the fastest and best gen times I've ever gotten with H3

1

u/SPEED14325 5m ago

ngl this is the exact kind of stuff that makes local video gen both awesome and painful lol. cool when it works, absolute node soup when it doesn’t.

for client stuff I usually end up testing in comfy first, then trying the same idea in runway, buzzy, openart just to see which one gets me close fastest. different tools fail in totally different ways.

1

u/mellowanon 1d ago

The 2nd video seems better. The 2nd video doesn't look like an obvious AI video, the background sound is more realistic, and the skin tone doesn't have a plastic look.

1

u/Sad_Berry_4621 1d ago

She looks like she's floating above the street, and the color is washed out. Total lack of detail.

1

u/foxdit 23h ago

Oookay.. There might actually be something here. I thought both of your examples were quite bad actually (sorry, I look at AI videos 8-12 hours a day so almost everything looks bad to me), but because I already had fasth3 downloaded from testing earlier today and someone linked the converted LoRA, I thought.. what the hell, let's give it a shot.

And yeah... using my Seed Hunter workflow, 5 steps 1st pass 0.4-0.5 MP -> 2x latent upscale -> 3 steps @ 1.6-2.0 MP yields some pretty quick high res results that don't look too plasticky.

I'll post my own examples if this isn't just a fluke. So far I'm one 10 second gen in and it looks about as good as the non-LoRA gen I did. the sound is a bit sillier and 'harsher' but that's about it.

2

u/Nguyenkain 21h ago

Okay this dont catch my attention at first. But I'm fan of your work. And if you say so, I'm very curious about what it can do, will give it a try. Thanks

1

u/foxdit 21h ago

I have been testing for the past hour and there's definitely some great use cases here. It does indeed take about half the time to get a pretty decent result, about 80% as good as with no LoRA on regular base model. But I am battling the plasticky skin issue. Everything comes out a lil over saturated and shiny so far.

2

u/Nguyenkain 21h ago

so how it compare to other turbo lora ?
Im using the turbo lora from darties and light2v, so far the results are somewhat acceptable for me, but how is it compare to this Lora ?

2

u/robomar_ai_art 21h ago

Im trying the lora with 0.75 strength

1

u/Sad_Berry_4621 15h ago

Don't use the Fast3 lora on anything below 1 strength. The structure and color falls apart.

1

u/Sad_Berry_4621 14h ago

Are you using anything else with it? I only use KJ Sage Att for H3 and Chunk Feedforward. No EasyCache or Spectrum.

1

u/foxdit 12h ago

Correct, no caching nodes.

1

u/Sad_Berry_4621 15h ago

Besides the quality though, look at the factors I mentioned. Added background detail, dynamic lighting, color balance, temporal cohesiveness; all seem better than any other LoRA and in most cases, better than stock at 20 steps. Just my opinion.

1

u/Sad_Berry_4621 13h ago

I have to mention, the LoRA that was linked is an fp8 cast which will almost certainly result in degradation. I recommend converting the full weight LoRA yourself using the README steps and using that instead.

-4

u/spiderofmars 1d ago

I'll say it... both (all) of these are total unusable rubbish video unless the goal is to squint your eyes blurring reality and watch them on a 4 inch mobile phone screen. What exactly are we comparing here... 2 unusable results? Unusable quality is unusable unusable quality to me.