Text-to-Video
MiniMax H3
Safetensors
lora
adapter
comfyui
reference-to-video
audio-video
synchronized-audio
few-step
turbo
accelerated-inference
lightx2v
dynamic-rank
svd
bfloat16
pruned-model
curve-form
Instructions to use drbaph/MiniMax-H3-Turbo-Lora-ComfyUI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,246 +8,214 @@ tags:
|
|
| 8 |
- lora
|
| 9 |
- adapter
|
| 10 |
- comfyui
|
| 11 |
-
- pruned
|
| 12 |
- pruned-model
|
| 13 |
- curve-form
|
| 14 |
- text-to-video
|
| 15 |
-
- text-to-audio
|
| 16 |
- audio-video
|
| 17 |
-
- video-generation
|
| 18 |
-
- audio-generation
|
| 19 |
- synchronized-audio
|
| 20 |
- few-step
|
| 21 |
-
- four-step
|
| 22 |
-
- 4-step
|
| 23 |
- turbo
|
| 24 |
- accelerated-inference
|
| 25 |
-
-
|
| 26 |
-
-
|
| 27 |
-
-
|
| 28 |
-
- checkpoint-850
|
| 29 |
-
- v4
|
| 30 |
-
- ema
|
| 31 |
-
- euler
|
| 32 |
-
- beta-scheduler
|
| 33 |
- safetensors
|
| 34 |
- bfloat16
|
| 35 |
-
- bf16
|
| 36 |
-
- partial-conversion
|
| 37 |
---
|
| 38 |
|
| 39 |
-
# MiniMax-H3 Turbo
|
| 40 |
|
| 41 |
-
This repository contains third-party
|
| 42 |
|
| 43 |
-
|
|
|
|
| 44 |
|
| 45 |
-
|
| 46 |
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
> **Recommended checkpoint:** `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
|
| 50 |
>
|
| 51 |
-
> **Recommended settings:**
|
|
|
|
| 52 |
|
| 53 |
---
|
| 54 |
|
| 55 |
-
#
|
| 56 |
|
| 57 |
-
|
| 58 |
|
| 59 |
-
|
| 60 |
|
| 61 |
-
|
| 62 |
-
src="https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4"
|
| 63 |
-
controls
|
| 64 |
-
loop
|
| 65 |
-
width="100%"> </video>
|
| 66 |
|
| 67 |
-
|
|
|
|
|
|
|
|
|
|
| 68 |
|
| 69 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
|
| 71 |
-
The
|
| 72 |
|
| 73 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 74 |
|
| 75 |
-
|
| 76 |
|
| 77 |
```text
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
LoRA strength: 1.0
|
| 83 |
```
|
| 84 |
|
| 85 |
-
|
| 86 |
|
| 87 |
-
##
|
| 88 |
|
| 89 |
-
|
|
|
|
|
|
|
|
|
|
| 90 |
|
| 91 |
-
|
|
|
|
|
|
|
| 92 |
|
| 93 |
-
|
| 94 |
|
| 95 |
-
|
|
| 96 |
-
| ---
|
| 97 |
-
|
|
| 98 |
-
|
|
| 99 |
-
|
|
| 100 |
-
|
|
| 101 |
-
|
|
| 102 |
|
| 103 |
-
|
| 104 |
|
| 105 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
|
| 107 |
---
|
| 108 |
|
| 109 |
-
##
|
| 110 |
|
| 111 |
-
The following
|
| 112 |
|
| 113 |
<video
|
| 114 |
-
src="https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/
|
| 115 |
controls
|
| 116 |
loop
|
| 117 |
width="100%"> </video>
|
| 118 |
|
| 119 |
-
###
|
| 120 |
-
|
| 121 |
-
[Download the old ComfyUI workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
|
| 122 |
-
|
| 123 |
-
The previous workflow has been renamed to:
|
| 124 |
-
|
| 125 |
-
`fl_minimax_h3_turbo_lora_example_workflow_old.json`
|
| 126 |
-
|
| 127 |
-

|
| 128 |
-
|
| 129 |
-
---
|
| 130 |
|
| 131 |
-
|
| 132 |
|
| 133 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 134 |
|
| 135 |
-
|
| 136 |
-
[larryvrh/MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)
|
| 137 |
|
| 138 |
-
|
| 139 |
|
| 140 |
-
|
| 141 |
|
| 142 |
-
|
| 143 |
|
| 144 |
---
|
| 145 |
|
| 146 |
## Included Files
|
| 147 |
|
| 148 |
-
|
| 149 |
-
| --------------------------------------------------------------- | ------------------------------------------------------------------------------------------------- |
|
| 150 |
-
| `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors` | **Recommended.** Pruned-model ComfyUI compatibility conversion of the v4 step-600 EMA checkpoint. |
|
| 151 |
-
| `minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors` | Non-EMA version of the v4 step-600 checkpoint for comparison. |
|
| 152 |
-
| `minimax_h3_turbo_4step_ema_ckpt850_pruned_comfyui.safetensors` | EMA compatibility conversion of the checkpoint-850 weights. |
|
| 153 |
-
| `minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors` | Non-EMA compatibility conversion of the checkpoint-850 weights. |
|
| 154 |
-
| `minimax_h3_turbo_4step_ema_ckpt500_pruned_comfyui.safetensors` | Further-trained checkpoint-500 EMA variant in the pruned-model ComfyUI format. |
|
| 155 |
-
| `minimax_h3_turbo_4step_ckpt500_pruned_comfyui.safetensors` | Further-trained checkpoint-500 non-EMA variant in the pruned-model ComfyUI format. |
|
| 156 |
-
| `minimax_h3_turbo_4step_ema_pruned_comfyui.safetensors` | Compatibility conversion of the initial EMA Turbo release. |
|
| 157 |
-
| `minimax_h3_turbo_4step_pruned_comfyui.safetensors` | Compatibility conversion of the initial non-EMA Turbo release. |
|
| 158 |
-
| `fl_minimax_h3_turbo_lora_example_workflow.json` | **Current recommended ComfyUI example workflow.** |
|
| 159 |
-
| `fl_minimax_h3_turbo_lora_example_workflow_old.json` | Previous example workflow, retained for reference and comparison. |
|
| 160 |
-
| `assets/MiniMax_H3_audio.mp4` | Output video from the **new recommended workflow**. |
|
| 161 |
-
| `assets/MiniMax_H3_00060-audio.mp4` | Output video from the previous workflow. |
|
| 162 |
-
|
| 163 |
-
The EMA and non-EMA files remain separate and contain different tensor values.
|
| 164 |
-
|
| 165 |
-
The files without checkpoint identifiers preserve the earlier preview weights.
|
| 166 |
-
|
| 167 |
-
The `ckpt500` and `ckpt850` files belong to the older training line, while the `v4_step600` files use the newer **v4 training recipe**.
|
| 168 |
-
|
| 169 |
-
These files are partial compatibility versions of the original full-model Turbo LoRAs for use with the pruned/curve-form MiniMax-H3 architecture.
|
| 170 |
-
|
| 171 |
-
---
|
| 172 |
-
|
| 173 |
-
## Which File Should I Use?
|
| 174 |
-
|
| 175 |
-
### Recommended — v4 Step-600 EMA
|
| 176 |
-
|
| 177 |
-
Start with:
|
| 178 |
-
|
| 179 |
-
`minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
|
| 180 |
-
|
| 181 |
-
Recommended configuration:
|
| 182 |
-
|
| 183 |
-
* **Steps:** `6-8`
|
| 184 |
-
* **Sampler:** `euler`
|
| 185 |
-
* **Scheduler:** `beta`
|
| 186 |
-
* **LoRA strength:** start at `1.0`
|
| 187 |
-
|
| 188 |
-
This is the **recommended checkpoint for most generations**.
|
| 189 |
-
|
| 190 |
-
### v4 Step-600 non-EMA
|
| 191 |
-
|
| 192 |
-
For comparison:
|
| 193 |
-
|
| 194 |
-
`minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors`
|
| 195 |
-
|
| 196 |
-
The non-EMA weights are provided primarily for testing and comparison against the recommended EMA checkpoint.
|
| 197 |
-
|
| 198 |
-
### Checkpoint-850
|
| 199 |
-
|
| 200 |
-
EMA:
|
| 201 |
-
|
| 202 |
-
`minimax_h3_turbo_4step_ema_ckpt850_pruned_comfyui.safetensors`
|
| 203 |
-
|
| 204 |
-
Non-EMA:
|
| 205 |
-
|
| 206 |
-
`minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors`
|
| 207 |
|
| 208 |
-
|
|
|
|
|
|
|
|
|
|
| 209 |
|
| 210 |
-
###
|
| 211 |
|
| 212 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 213 |
|
| 214 |
-
|
| 215 |
|
| 216 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 217 |
|
| 218 |
-
|
| 219 |
|
| 220 |
-
|
| 221 |
|
| 222 |
-
##
|
| 223 |
|
| 224 |
-
|
| 225 |
|
| 226 |
-
|
| 227 |
-
* `minimax_h3_turbo_4step_ema_pruned_comfyui.safetensors`
|
| 228 |
|
| 229 |
-
|
| 230 |
|
| 231 |
-
-
|
| 232 |
|
| 233 |
-
##
|
| 234 |
|
| 235 |
-
|
| 236 |
|
| 237 |
-
`
|
| 238 |
|
| 239 |
-
|
| 240 |
|
| 241 |
-
|
| 242 |
|
| 243 |
-
|
| 244 |
|
| 245 |
`minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
|
| 246 |
|
| 247 |
-
Recommended
|
| 248 |
|
| 249 |
```text
|
| 250 |
-
Steps: 8
|
| 251 |
Sampler: euler
|
| 252 |
Scheduler: beta
|
| 253 |
LoRA strength: 1.0
|
|
@@ -255,221 +223,102 @@ Video sigma shift: 12
|
|
| 255 |
Audio sigma shift: 4-6
|
| 256 |
```
|
| 257 |
|
| 258 |
-
The
|
| 259 |
-
|
| 260 |
-
`assets/MiniMax_H3_audio.mp4`
|
| 261 |
-
|
| 262 |
-
[View / download MiniMax_H3_audio.mp4](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4)
|
| 263 |
-
|
| 264 |
-
---
|
| 265 |
-
|
| 266 |
-
## Previous Workflow
|
| 267 |
-
|
| 268 |
-
The previous example workflow is retained as:
|
| 269 |
-
|
| 270 |
-
`fl_minimax_h3_turbo_lora_example_workflow_old.json`
|
| 271 |
-
|
| 272 |
-
Download:
|
| 273 |
-
|
| 274 |
-
[fl_minimax_h3_turbo_lora_example_workflow_old.json](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
|
| 275 |
-
|
| 276 |
-
Its corresponding example output is:
|
| 277 |
-
|
| 278 |
-
`assets/MiniMax_H3_00060-audio.mp4`
|
| 279 |
-
|
| 280 |
-
[View / download MiniMax_H3_00060-audio.mp4](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4)
|
| 281 |
|
| 282 |
---
|
| 283 |
|
| 284 |
-
##
|
| 285 |
-
|
| 286 |
-
The MiniMax-H3 Turbo LoRA is designed to generate joint video and synchronized stereo audio using dramatically fewer sampling steps than the standard MiniMax-H3 generation process.
|
| 287 |
-
|
| 288 |
-
The original project demonstrated generation using substantially fewer sampling steps than the normal MiniMax-H3 workflow, providing a large reduction in sampling time.
|
| 289 |
|
| 290 |
-
The
|
| 291 |
-
|
| 292 |
-
Refer to the original repository for the author's current documentation, training updates, standalone generation implementation and sampling recommendations:
|
| 293 |
-
|
| 294 |
-
[larryvrh/MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)
|
| 295 |
-
|
| 296 |
-
---
|
| 297 |
-
|
| 298 |
-
## Why This Conversion Was Made
|
| 299 |
-
|
| 300 |
-
The original Turbo LoRA files use tensor keys such as:
|
| 301 |
|
| 302 |
`blocks.0.attn.qkv_proj.lora_A.weight`
|
| 303 |
|
| 304 |
-
ComfyUI
|
| 305 |
|
| 306 |
`diffusion_model.blocks.0.attn.qkv_proj.lora_A.weight`
|
| 307 |
|
| 308 |
-
|
| 309 |
-
|
| 310 |
-
`[WARNING] lora key not loaded: blocks.0.attn.out_proj.lora_A.weight`
|
| 311 |
-
|
| 312 |
-
The following namespace conversion was applied to the retained tensors:
|
| 313 |
-
|
| 314 |
-
* `blocks.*` → `diffusion_model.blocks.*`
|
| 315 |
-
* `token_refiner.*` → `diffusion_model.token_refiner.*`
|
| 316 |
-
|
| 317 |
-
The retained tensor values, BF16 dtype, tensor shapes, LoRA rank and A/B orientation were preserved.
|
| 318 |
-
|
| 319 |
-
---
|
| 320 |
-
|
| 321 |
-
## Conversion Details
|
| 322 |
|
| 323 |
-
|
|
|
|
| 324 |
|
| 325 |
-
|
| 326 |
-
| --------------------- | ----: |
|
| 327 |
-
| Source tensors | 518 |
|
| 328 |
-
| Source LoRA A/B pairs | 259 |
|
| 329 |
|
| 330 |
-
|
| 331 |
|
| 332 |
-
| Component
|
| 333 |
-
| ---
|
| 334 |
-
|
|
| 335 |
-
|
|
| 336 |
-
|
|
| 337 |
-
|
|
| 338 |
-
|
| 339 |
-
|
| 340 |
-
|
| 341 |
-
* 50 AdaLN projection pairs from `blocks.0` through `blocks.49`;
|
| 342 |
-
* 1 AdaLN projection pair from `final_layer.adaln_proj.linear`.
|
| 343 |
|
| 344 |
The retained adapters include:
|
| 345 |
|
| 346 |
-
|
| 347 |
-
|
| 348 |
-
|
| 349 |
-
|
| 350 |
-
|
| 351 |
-
The retained attention, MLP and token-refiner tensors have dimensions compatible with the pruned/curve-form MiniMax-H3 checkpoint.
|
| 352 |
|
| 353 |
-
|
| 354 |
-
|
| 355 |
-
## Validation
|
| 356 |
|
| 357 |
-
|
|
|
|
| 358 |
|
| 359 |
-
|
| 360 |
-
* no orphan A or B tensors;
|
| 361 |
-
* retained keys using the `diffusion_model.*` namespace;
|
| 362 |
-
* no duplicated `diffusion_model.diffusion_model.*` prefixes;
|
| 363 |
-
* no incompatible `adaln_proj` tensors;
|
| 364 |
-
* preserved BF16 dtype;
|
| 365 |
-
* preserved tensor shapes;
|
| 366 |
-
* preserved LoRA ranks;
|
| 367 |
-
* separate EMA and non-EMA weights;
|
| 368 |
-
* no unresolved retained keys during ComfyUI loader-level validation.
|
| 369 |
|
| 370 |
-
The
|
| 371 |
-
|
| 372 |
-
---
|
| 373 |
-
|
| 374 |
-
## Optional Acceleration
|
| 375 |
-
|
| 376 |
-
The LoRAs have been tested working in ComfyUI with optional acceleration methods including:
|
| 377 |
-
|
| 378 |
-
* **SageAttention**
|
| 379 |
-
* **Sol Attention**
|
| 380 |
-
* **Gradient**
|
| 381 |
-
* **Spectrum**
|
| 382 |
-
|
| 383 |
-
These acceleration methods are optional and are not included in this repository.
|
| 384 |
-
|
| 385 |
-
They may also be combined with the Turbo LoRA depending on your ComfyUI workflow and available custom nodes.
|
| 386 |
-
|
| 387 |
-
---
|
| 388 |
-
|
| 389 |
-
## Important Limitation
|
| 390 |
-
|
| 391 |
-
These files are **partial ComfyUI compatibility conversions intended specifically for the pruned/curve-form MiniMax-H3 architecture**.
|
| 392 |
-
|
| 393 |
-
The original full-model Turbo LoRAs contain AdaLN adapters that do not directly match the corresponding dimensions of the pruned/curve-form MiniMax-H3 checkpoint.
|
| 394 |
-
|
| 395 |
-
Those incompatible AdaLN tensors are therefore excluded from these compatibility versions.
|
| 396 |
-
|
| 397 |
-
The retained attention, MLP and token-refiner LoRA tensors remain compatible with the pruned architecture.
|
| 398 |
-
|
| 399 |
-
Because these are partial compatibility conversions, they should not be assumed to be numerically identical in behaviour to using the original full Turbo LoRA with its intended full MiniMax-H3 base.
|
| 400 |
|
| 401 |
---
|
| 402 |
|
| 403 |
## Usage
|
| 404 |
|
| 405 |
-
Place the LoRA files
|
| 406 |
|
| 407 |
`ComfyUI/models/loras/`
|
| 408 |
|
| 409 |
-
|
| 410 |
-
|
| 411 |
-
### Recommended LoRA
|
| 412 |
-
|
| 413 |
-
`minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
|
| 414 |
-
|
| 415 |
-
### Recommended settings
|
| 416 |
-
|
| 417 |
-
* **Steps:** `8`
|
| 418 |
-
* **Sampler:** `euler`
|
| 419 |
-
* **Scheduler:** `beta`
|
| 420 |
-
* **Video sigma shift:** `12`
|
| 421 |
-
* **Audio sigma shift:** `4-6`
|
| 422 |
-
* **LoRA strength:** `1.0` recommended starting point
|
| 423 |
-
|
| 424 |
-
The recommended workflow for these settings is:
|
| 425 |
-
|
| 426 |
-
[Download `fl_minimax_h3_turbo_lora_example_workflow.json`](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
|
| 427 |
-
|
| 428 |
-
The corresponding example output is:
|
| 429 |
|
| 430 |
-
|
| 431 |
|
| 432 |
-
|
| 433 |
|
| 434 |
-
|
| 435 |
|
| 436 |
`0.8-1.2`
|
| 437 |
|
| 438 |
-
When comparing
|
| 439 |
|
| 440 |
-
|
| 441 |
-
|
| 442 |
-
|
| 443 |
-
|
| 444 |
-
|
| 445 |
-
|
| 446 |
-
|
| 447 |
-
|
| 448 |
-
|
| 449 |
-
|
| 450 |
-
This gives a meaningful comparison between checkpoint versions.
|
| 451 |
|
| 452 |
---
|
| 453 |
|
| 454 |
-
## Sampling
|
| 455 |
-
|
| 456 |
-
The Turbo LoRA can operate at extremely low step counts, but image quality and motion consistency generally improve when moving beyond the minimum.
|
| 457 |
|
| 458 |
### 4 steps
|
| 459 |
|
| 460 |
-
Maximum speed.
|
| 461 |
-
|
| 462 |
-
Useful for testing and rapid previews.
|
| 463 |
|
| 464 |
### 6 steps
|
| 465 |
|
| 466 |
-
|
| 467 |
|
| 468 |
### 8 steps
|
| 469 |
|
| 470 |
-
|
| 471 |
|
| 472 |
-
|
| 473 |
|
| 474 |
```text
|
| 475 |
8 steps
|
|
@@ -477,7 +326,9 @@ Euler sampler
|
|
| 477 |
Beta scheduler
|
| 478 |
```
|
| 479 |
|
| 480 |
-
|
|
|
|
|
|
|
| 481 |
|
| 482 |
---
|
| 483 |
|
|
@@ -485,176 +336,82 @@ This is the recommended configuration used by the current example workflow.
|
|
| 485 |
|
| 486 |
MiniMax-H3 generates video and synchronized audio as separate streams with different scheduling requirements.
|
| 487 |
|
| 488 |
-
Incorrect audio scheduling
|
| 489 |
|
| 490 |
-
|
| 491 |
-
|
| 492 |
-
|
| 493 |
-
|
| 494 |
-
|
| 495 |
|
| 496 |
-
|
| 497 |
|
| 498 |
-
|
| 499 |
-
|
| 500 |
-
|
| 501 |
-
|
| 502 |
-
|
| 503 |
-
|
| 504 |
-
|
| 505 |
-
LoRA strength: 1.0
|
| 506 |
-
```
|
| 507 |
-
|
| 508 |
-
Do not automatically assume broken audio is caused by the LoRA.
|
| 509 |
-
|
| 510 |
-
Check:
|
| 511 |
|
| 512 |
-
|
| 513 |
-
* scheduler configuration;
|
| 514 |
-
* audio sigma shift;
|
| 515 |
-
* video sigma shift;
|
| 516 |
-
* ComfyUI version;
|
| 517 |
-
* MiniMax-H3 sampling implementation;
|
| 518 |
-
* custom sampler nodes.
|
| 519 |
|
| 520 |
---
|
| 521 |
|
| 522 |
-
##
|
| 523 |
-
|
| 524 |
-
The original Turbo author also provides a dedicated ComfyUI custom node:
|
| 525 |
-
|
| 526 |
-
[GitHub — Larryvrh/ComfyUI-MiniMax-H3-Turbo](https://github.com/Larryvrh/ComfyUI-MiniMax-H3-Turbo)
|
| 527 |
-
|
| 528 |
-
The node includes a MiniMax-H3 Turbo LoRA loader and dedicated sampling functionality designed for MiniMax-H3's video/audio scheduling behaviour.
|
| 529 |
-
|
| 530 |
-
A workflow is also included in the custom-node repository.
|
| 531 |
-
|
| 532 |
-
The custom node evolves alongside the upstream Turbo weights, so users choosing that implementation should follow the settings documented in its current README.
|
| 533 |
-
|
| 534 |
-
The settings documented in this repository refer to the tested **pruned-model compatibility workflow**, where the recommended starting point is:
|
| 535 |
-
|
| 536 |
-
**v4 step-600 EMA · 8 steps · Euler · Beta scheduler**
|
| 537 |
-
|
| 538 |
-
---
|
| 539 |
-
|
| 540 |
-
## Compatibility
|
| 541 |
-
|
| 542 |
-
These LoRAs are intended for the **pruned/curve-form MiniMax-H3 checkpoint used by ComfyUI**.
|
| 543 |
-
|
| 544 |
-
The compatibility conversions are particularly useful when the original full-model LoRA cannot be loaded directly because of incompatible AdaLN dimensions.
|
| 545 |
-
|
| 546 |
-
Optional acceleration methods confirmed working with these conversions include:
|
| 547 |
-
|
| 548 |
-
* SageAttention
|
| 549 |
-
* Sol Attention
|
| 550 |
-
* Gradient
|
| 551 |
-
* Spectrum
|
| 552 |
-
|
| 553 |
-
Accelerators can generally be stacked where the corresponding ComfyUI implementations support it.
|
| 554 |
-
|
| 555 |
-
---
|
| 556 |
-
|
| 557 |
-
## Naming Notes
|
| 558 |
-
|
| 559 |
-
The upstream project contains multiple generations of Turbo training.
|
| 560 |
-
|
| 561 |
-
### Older naming
|
| 562 |
-
|
| 563 |
-
Files such as:
|
| 564 |
-
|
| 565 |
-
`minimax_h3_turbo_4step_ema_ckpt500.safetensors`
|
| 566 |
-
|
| 567 |
-
and:
|
| 568 |
-
|
| 569 |
-
`minimax_h3_turbo_4step_ema_ckpt850.safetensors`
|
| 570 |
-
|
| 571 |
-
belong to the older training line.
|
| 572 |
-
|
| 573 |
-
In these filenames, `4step` refers to the few-step Turbo sampling target.
|
| 574 |
-
|
| 575 |
-
### Newer v4 naming
|
| 576 |
-
|
| 577 |
-
Files such as:
|
| 578 |
-
|
| 579 |
-
`minimax_h3_turbo_v4_step600_ema.safetensors`
|
| 580 |
-
|
| 581 |
-
use the newer naming convention.
|
| 582 |
-
|
| 583 |
-
Here:
|
| 584 |
-
|
| 585 |
-
* `v4` refers to the newer training recipe;
|
| 586 |
-
* `step600` refers to training step 600;
|
| 587 |
-
* `ema` refers to the exponential-moving-average weights.
|
| 588 |
|
| 589 |
-
|
| 590 |
|
| 591 |
-
|
|
|
|
|
|
|
|
|
|
| 592 |
|
| 593 |
-
|
| 594 |
|
| 595 |
---
|
| 596 |
|
| 597 |
-
##
|
| 598 |
-
|
| 599 |
-
### Current workflow
|
| 600 |
-
|
| 601 |
-
`fl_minimax_h3_turbo_lora_example_workflow.json`
|
| 602 |
-
|
| 603 |
-
[Download current workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
|
| 604 |
-
|
| 605 |
-
Current workflow output:
|
| 606 |
|
| 607 |
-
|
| 608 |
|
| 609 |
-
|
| 610 |
|
| 611 |
-
|
| 612 |
|
| 613 |
-
|
| 614 |
|
| 615 |
-
|
| 616 |
|
| 617 |
-
|
| 618 |
|
| 619 |
-
|
| 620 |
-
|
| 621 |
-
[View previous workflow output](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4)
|
| 622 |
-
|
| 623 |
-
---
|
| 624 |
|
| 625 |
-
|
| 626 |
-
|
| 627 |
-
Original MiniMax-H3 Turbo LoRA author:
|
| 628 |
-
|
| 629 |
-
**[larryvrh](https://huggingface.co/larryvrh)**
|
| 630 |
-
|
| 631 |
-
Original project:
|
| 632 |
-
|
| 633 |
-
**[MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)**
|
| 634 |
|
| 635 |
Original ComfyUI Turbo custom node:
|
| 636 |
|
| 637 |
-
|
| 638 |
|
| 639 |
-
|
| 640 |
|
| 641 |
-
|
| 642 |
-
* checkpoint-500 variants;
|
| 643 |
-
* checkpoint-850 variants;
|
| 644 |
-
* v4 step-600 variants.
|
| 645 |
|
| 646 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 647 |
|
| 648 |
-
|
| 649 |
-
* the original LoRA training;
|
| 650 |
-
* the original distillation method;
|
| 651 |
-
* the original few-step sampling method;
|
| 652 |
-
* the original dual video/audio scheduling implementation;
|
| 653 |
-
* the original generation scripts;
|
| 654 |
-
* the original documentation;
|
| 655 |
-
* the MiniMax-H3 base model;
|
| 656 |
-
* the pruned/curve-form MiniMax-H3 checkpoint.
|
| 657 |
|
| 658 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 659 |
|
| 660 |
-
Please retain attribution
|
|
|
|
| 8 |
- lora
|
| 9 |
- adapter
|
| 10 |
- comfyui
|
|
|
|
| 11 |
- pruned-model
|
| 12 |
- curve-form
|
| 13 |
- text-to-video
|
|
|
|
| 14 |
- audio-video
|
|
|
|
|
|
|
| 15 |
- synchronized-audio
|
| 16 |
- few-step
|
|
|
|
|
|
|
| 17 |
- turbo
|
| 18 |
- accelerated-inference
|
| 19 |
+
- lightx2v
|
| 20 |
+
- dynamic-rank
|
| 21 |
+
- svd
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
- safetensors
|
| 23 |
- bfloat16
|
|
|
|
|
|
|
| 24 |
---
|
| 25 |
|
| 26 |
+
# MiniMax-H3 Turbo LoRAs for ComfyUI
|
| 27 |
|
| 28 |
+
This repository contains third-party MiniMax-H3 Turbo LoRA conversions for ComfyUI, including:
|
| 29 |
|
| 30 |
+
- pruned/curve-form compatibility conversions of the Turbo LoRAs released by [larryvrh](https://huggingface.co/larryvrh);
|
| 31 |
+
- dynamically resized 4-step and 8-step v1.0 LoRAs derived from the official ComfyUI weights in [lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main).
|
| 32 |
|
| 33 |
+
The Turbo LoRAs accelerate MiniMax-H3 joint video and synchronized-audio generation by reducing the required number of sampling steps.
|
| 34 |
|
| 35 |
+
> **Recommended pruned-model LoRA:**
|
| 36 |
+
> `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
|
|
|
|
| 37 |
>
|
| 38 |
+
> **Recommended starting settings:**
|
| 39 |
+
> **6–8 steps · Euler sampler · Beta scheduler · LoRA strength 1.0**
|
| 40 |
|
| 41 |
---
|
| 42 |
|
| 43 |
+
## **Update — LightX2V v1.0 Dynamic-Rank LoRAs**
|
| 44 |
|
| 45 |
+
Two resized BF16 LoRAs have been added from the official ComfyUI-compatible weights published in:
|
| 46 |
|
| 47 |
+
[lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main)
|
| 48 |
|
| 49 |
+
### New files
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
+
| File | Source | Description |
|
| 52 |
+
| --- | --- | --- |
|
| 53 |
+
| `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors` | `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_bf16.safetensors` | Dynamically resized 4-step 768p LightX2V LoRA. |
|
| 54 |
+
| `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_resized_avg_rank_21_bf16.safetensors` | `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_bf16.safetensors` | Dynamically resized 8-step LightX2V LoRA. |
|
| 55 |
|
| 56 |
+
These files were already supplied by LightX2V in the correct ComfyUI MiniMax-H3 layout. The update applies dynamic-rank compression without changing the model namespace or QKV layout expected by ComfyUI.
|
| 57 |
+
|
| 58 |
+
### How the new LoRAs were resized
|
| 59 |
+
|
| 60 |
+
The LoRAs were resized using an exact compact SVD calculated directly from each LoRA A/B factor pair.
|
| 61 |
|
| 62 |
+
The process was:
|
| 63 |
|
| 64 |
+
1. Treat every attention, MLP and token-refiner projection independently.
|
| 65 |
+
2. Separate the fused QKV LoRA into its original Q, K and V projections.
|
| 66 |
+
3. Calculate the exact singular spectrum of each effective `B @ A` update without materializing the full dense weight matrix.
|
| 67 |
+
4. Select a dynamic rank independently for each projection.
|
| 68 |
+
5. Preserve one additional safety rank after the selected Frobenius-energy threshold.
|
| 69 |
+
6. Rebuild the factors using balanced singular values:
|
| 70 |
+
- `A = sqrt(S) × Vh`
|
| 71 |
+
- `B = U × sqrt(S)`
|
| 72 |
+
7. Re-fuse Q, K and V using a block-diagonal B matrix and concatenated A matrix.
|
| 73 |
+
8. Bake the original `alpha / rank` scale into `lora_B`.
|
| 74 |
+
9. Remove the now-unnecessary alpha tensors.
|
| 75 |
+
10. Save all resulting LoRA tensors as BF16.
|
| 76 |
|
| 77 |
+
The target was the same true average projection rank represented by an `avg_rank_21` filename:
|
| 78 |
|
| 79 |
```text
|
| 80 |
+
Rank sum: 6778
|
| 81 |
+
Projection count: 312
|
| 82 |
+
Average projection rank: 21.724359
|
| 83 |
+
Filename rank: floor(21.724359) = 21
|
|
|
|
| 84 |
```
|
| 85 |
|
| 86 |
+
Q, K and V are counted separately when calculating the average. The rank of a fused QKV tensor is the sum of its three independently selected projection ranks.
|
| 87 |
|
| 88 |
+
### Resize results
|
| 89 |
|
| 90 |
+
| LoRA | Size | Average rank | Average Frobenius norm retained | Baked scale |
|
| 91 |
+
| --- | ---: | ---: | ---: | ---: |
|
| 92 |
+
| 4-step v1.0 768p | 284.36 MiB | 21.724359 | 94.95% | 1.0 |
|
| 93 |
+
| 8-step v1.0 | 311.89 MiB | 21.724359 | 97.72% | 0.0625 |
|
| 94 |
|
| 95 |
+
The thresholds were solved independently because the singular-value distributions differ between the 4-step and 8-step LoRAs. Using one fixed threshold would not produce the same average rank for both files.
|
| 96 |
+
|
| 97 |
+
### Validation of the resized files
|
| 98 |
|
| 99 |
+
Each resized file contains:
|
| 100 |
|
| 101 |
+
| Component | Count |
|
| 102 |
+
| --- | ---: |
|
| 103 |
+
| BF16 tensors | 416 |
|
| 104 |
+
| LoRA A/B pairs | 208 |
|
| 105 |
+
| Independently ranked projections | 312 |
|
| 106 |
+
| QKV modules | 52 |
|
| 107 |
+
| Alpha tensors | 0 |
|
| 108 |
|
| 109 |
+
Validation confirmed:
|
| 110 |
|
| 111 |
+
- all tensors are finite BF16 values;
|
| 112 |
+
- every LoRA A tensor has a matching LoRA B tensor;
|
| 113 |
+
- all 208 adapters are recognized by ComfyUI;
|
| 114 |
+
- QKV rank columns remain block-diagonal and correctly ordered as Q, K and V;
|
| 115 |
+
- the effective original LoRA strength is preserved;
|
| 116 |
+
- the exact average projection rank is 21.724359;
|
| 117 |
+
- no incompatible or unresolved tensors remain.
|
| 118 |
|
| 119 |
---
|
| 120 |
|
| 121 |
+
## Workflow Example
|
| 122 |
|
| 123 |
+
The following output was generated with the recommended pruned-model workflow using the v4 step-600 EMA LoRA.
|
| 124 |
|
| 125 |
<video
|
| 126 |
+
src="https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4"
|
| 127 |
controls
|
| 128 |
loop
|
| 129 |
width="100%"> </video>
|
| 130 |
|
| 131 |
+
### Current workflow
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 132 |
|
| 133 |
+
[Download the current ComfyUI workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
|
| 134 |
|
| 135 |
+
```text
|
| 136 |
+
Workflow: fl_minimax_h3_turbo_lora_example_workflow.json
|
| 137 |
+
LoRA: minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors
|
| 138 |
+
Steps: 6-8
|
| 139 |
+
Sampler: euler
|
| 140 |
+
Scheduler: beta
|
| 141 |
+
LoRA strength: 1.0
|
| 142 |
+
Video sigma shift: 12
|
| 143 |
+
Audio sigma shift: 4-6
|
| 144 |
+
```
|
| 145 |
|
| 146 |
+
The previous workflow is retained here:
|
|
|
|
| 147 |
|
| 148 |
+
[Download the previous workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
|
| 149 |
|
| 150 |
+
Its corresponding example output is:
|
| 151 |
|
| 152 |
+
[View the previous workflow output](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4)
|
| 153 |
|
| 154 |
---
|
| 155 |
|
| 156 |
## Included Files
|
| 157 |
|
| 158 |
+
### LightX2V dynamic-rank update
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 159 |
|
| 160 |
+
| File | Description |
|
| 161 |
+
| --- | --- |
|
| 162 |
+
| `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors` | Exact dynamic-SVD resize of the official LightX2V 4-step v1.0 768p ComfyUI LoRA. |
|
| 163 |
+
| `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_resized_avg_rank_21_bf16.safetensors` | Exact dynamic-SVD resize of the official LightX2V 8-step v1.0 ComfyUI LoRA. |
|
| 164 |
|
| 165 |
+
### Pruned/curve-form compatibility conversions
|
| 166 |
|
| 167 |
+
| File | Description |
|
| 168 |
+
| --- | --- |
|
| 169 |
+
| `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors` | **Recommended.** Pruned-model conversion of the v4 step-600 EMA checkpoint. |
|
| 170 |
+
| `minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors` | Non-EMA v4 step-600 variant. |
|
| 171 |
+
| `minimax_h3_turbo_4step_ema_ckpt850_pruned_comfyui.safetensors` | EMA checkpoint-850 conversion. |
|
| 172 |
+
| `minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors` | Non-EMA checkpoint-850 conversion. |
|
| 173 |
+
| `minimax_h3_turbo_4step_ema_ckpt500_pruned_comfyui.safetensors` | EMA checkpoint-500 conversion. |
|
| 174 |
+
| `minimax_h3_turbo_4step_ckpt500_pruned_comfyui.safetensors` | Non-EMA checkpoint-500 conversion. |
|
| 175 |
+
| `minimax_h3_turbo_4step_ema_pruned_comfyui.safetensors` | Initial EMA Turbo preview conversion. |
|
| 176 |
+
| `minimax_h3_turbo_4step_pruned_comfyui.safetensors` | Initial non-EMA Turbo preview conversion. |
|
| 177 |
|
| 178 |
+
### Workflows and assets
|
| 179 |
|
| 180 |
+
| File | Description |
|
| 181 |
+
| --- | --- |
|
| 182 |
+
| `fl_minimax_h3_turbo_lora_example_workflow.json` | Current recommended ComfyUI workflow. |
|
| 183 |
+
| `fl_minimax_h3_turbo_lora_example_workflow_old.json` | Previous workflow retained for comparison. |
|
| 184 |
+
| `assets/MiniMax_H3_audio.mp4` | Current workflow example output. |
|
| 185 |
+
| `assets/MiniMax_H3_00060-audio.mp4` | Previous workflow example output. |
|
| 186 |
|
| 187 |
+
EMA and non-EMA files contain different tensor values and are retained separately.
|
| 188 |
|
| 189 |
+
---
|
| 190 |
|
| 191 |
+
## Which File Should I Use?
|
| 192 |
|
| 193 |
+
### LightX2V 4-step v1.0
|
| 194 |
|
| 195 |
+
Use:
|
|
|
|
| 196 |
|
| 197 |
+
`minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors`
|
| 198 |
|
| 199 |
+
Choose this for the newer LightX2V 4-step 768p FL2V workflow when maximum sampling speed is preferred.
|
| 200 |
|
| 201 |
+
### LightX2V 8-step v1.0
|
| 202 |
|
| 203 |
+
Use:
|
| 204 |
|
| 205 |
+
`minimax_h3_fl2v_turbo_8step_v1.0_comfyui_resized_avg_rank_21_bf16.safetensors`
|
| 206 |
|
| 207 |
+
Choose this for the newer LightX2V 8-step workflow when prioritizing quality and motion consistency over the minimum possible step count.
|
| 208 |
|
| 209 |
+
### Recommended pruned-model conversion
|
| 210 |
|
| 211 |
+
For the existing pruned/curve-form workflow in this repository, start with:
|
| 212 |
|
| 213 |
`minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
|
| 214 |
|
| 215 |
+
Recommended settings:
|
| 216 |
|
| 217 |
```text
|
| 218 |
+
Steps: 6-8
|
| 219 |
Sampler: euler
|
| 220 |
Scheduler: beta
|
| 221 |
LoRA strength: 1.0
|
|
|
|
| 223 |
Audio sigma shift: 4-6
|
| 224 |
```
|
| 225 |
|
| 226 |
+
The non-EMA, checkpoint-500, checkpoint-850 and initial preview files are provided primarily for testing, comparison and reproducibility.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 227 |
|
| 228 |
---
|
| 229 |
|
| 230 |
+
## Why the Pruned Compatibility Conversion Was Needed
|
|
|
|
|
|
|
|
|
|
|
|
|
| 231 |
|
| 232 |
+
The original full-model Turbo LoRAs use keys such as:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 233 |
|
| 234 |
`blocks.0.attn.qkv_proj.lora_A.weight`
|
| 235 |
|
| 236 |
+
ComfyUI expects the corresponding keys under the model namespace:
|
| 237 |
|
| 238 |
`diffusion_model.blocks.0.attn.qkv_proj.lora_A.weight`
|
| 239 |
|
| 240 |
+
The following namespace conversion was applied:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 241 |
|
| 242 |
+
- `blocks.*` → `diffusion_model.blocks.*`
|
| 243 |
+
- `token_refiner.*` → `diffusion_model.token_refiner.*`
|
| 244 |
|
| 245 |
+
The original full-model LoRAs also contain AdaLN adapters whose dimensions do not match the pruned/curve-form MiniMax-H3 checkpoint. Those incompatible adapters were removed.
|
|
|
|
|
|
|
|
|
|
| 246 |
|
| 247 |
+
### Pruned conversion structure
|
| 248 |
|
| 249 |
+
| Component | Count |
|
| 250 |
+
| --- | ---: |
|
| 251 |
+
| Source tensors | 518 |
|
| 252 |
+
| Source LoRA A/B pairs | 259 |
|
| 253 |
+
| Retained tensors | 416 |
|
| 254 |
+
| Retained LoRA A/B pairs | 208 |
|
| 255 |
+
| Removed AdaLN tensors | 102 |
|
| 256 |
+
| Removed AdaLN A/B pairs | 51 |
|
|
|
|
|
|
|
|
|
|
| 257 |
|
| 258 |
The retained adapters include:
|
| 259 |
|
| 260 |
+
- all main-block attention adapters;
|
| 261 |
+
- all main-block MLP adapters;
|
| 262 |
+
- all token-refiner attention adapters;
|
| 263 |
+
- all token-refiner MLP adapters.
|
|
|
|
|
|
|
| 264 |
|
| 265 |
+
The removed adapters consist of:
|
|
|
|
|
|
|
| 266 |
|
| 267 |
+
- 50 AdaLN projection pairs from `blocks.0` through `blocks.49`;
|
| 268 |
+
- one AdaLN pair from `final_layer.adaln_proj.linear`.
|
| 269 |
|
| 270 |
+
These pruned files are partial compatibility conversions and should not be assumed to behave identically to the original full-model LoRA used with its intended full MiniMax-H3 base model.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 271 |
|
| 272 |
+
The newer LightX2V update does not use this pruning process because its source files were already released in the required ComfyUI MiniMax-H3 layout.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 273 |
|
| 274 |
---
|
| 275 |
|
| 276 |
## Usage
|
| 277 |
|
| 278 |
+
Place the LoRA files in:
|
| 279 |
|
| 280 |
`ComfyUI/models/loras/`
|
| 281 |
|
| 282 |
+
Load them with the compatible MiniMax-H3 model and workflow.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 283 |
|
| 284 |
+
A reasonable starting strength is:
|
| 285 |
|
| 286 |
+
`1.0`
|
| 287 |
|
| 288 |
+
If adjustment is needed, test approximately:
|
| 289 |
|
| 290 |
`0.8-1.2`
|
| 291 |
|
| 292 |
+
When comparing LoRAs, keep the following identical:
|
| 293 |
|
| 294 |
+
- prompt;
|
| 295 |
+
- seed;
|
| 296 |
+
- resolution;
|
| 297 |
+
- frame count;
|
| 298 |
+
- base model;
|
| 299 |
+
- sampler;
|
| 300 |
+
- scheduler;
|
| 301 |
+
- LoRA strength;
|
| 302 |
+
- sigma shifts;
|
| 303 |
+
- workflow.
|
|
|
|
| 304 |
|
| 305 |
---
|
| 306 |
|
| 307 |
+
## Sampling Guidance
|
|
|
|
|
|
|
| 308 |
|
| 309 |
### 4 steps
|
| 310 |
|
| 311 |
+
Maximum speed and useful for rapid previews.
|
|
|
|
|
|
|
| 312 |
|
| 313 |
### 6 steps
|
| 314 |
|
| 315 |
+
A good speed-to-quality compromise for the v4 step-600 EMA pruned conversion.
|
| 316 |
|
| 317 |
### 8 steps
|
| 318 |
|
| 319 |
+
Recommended when prioritizing quality, motion consistency and synchronized audio stability.
|
| 320 |
|
| 321 |
+
For the existing pruned-model workflow:
|
| 322 |
|
| 323 |
```text
|
| 324 |
8 steps
|
|
|
|
| 326 |
Beta scheduler
|
| 327 |
```
|
| 328 |
|
| 329 |
+
Follow the LightX2V project recommendations when using the new v1.0 FL2V LoRAs:
|
| 330 |
+
|
| 331 |
+
[lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main)
|
| 332 |
|
| 333 |
---
|
| 334 |
|
|
|
|
| 336 |
|
| 337 |
MiniMax-H3 generates video and synchronized audio as separate streams with different scheduling requirements.
|
| 338 |
|
| 339 |
+
Incorrect audio scheduling may cause:
|
| 340 |
|
| 341 |
+
- severe distortion;
|
| 342 |
+
- noise-like output;
|
| 343 |
+
- unstable audio energy;
|
| 344 |
+
- blown-out audio;
|
| 345 |
+
- completely broken audio.
|
| 346 |
|
| 347 |
+
If audio is unstable, check:
|
| 348 |
|
| 349 |
+
- sampler and scheduler configuration;
|
| 350 |
+
- audio sigma shift;
|
| 351 |
+
- video sigma shift;
|
| 352 |
+
- ComfyUI version;
|
| 353 |
+
- MiniMax-H3 sampling implementation;
|
| 354 |
+
- custom sampler nodes;
|
| 355 |
+
- the workflow intended for the selected LoRA.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 356 |
|
| 357 |
+
Broken audio should not automatically be attributed to the LoRA.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 358 |
|
| 359 |
---
|
| 360 |
|
| 361 |
+
## Optional Acceleration
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 362 |
|
| 363 |
+
These compatibility LoRAs have been used with optional ComfyUI acceleration methods including:
|
| 364 |
|
| 365 |
+
- SageAttention
|
| 366 |
+
- Sol Attention
|
| 367 |
+
- Gradient
|
| 368 |
+
- Spectrum
|
| 369 |
|
| 370 |
+
These methods are optional and are not included in this repository. Compatibility depends on the corresponding ComfyUI implementation and workflow.
|
| 371 |
|
| 372 |
---
|
| 373 |
|
| 374 |
+
## Original Projects and Attribution
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 375 |
|
| 376 |
+
### LightX2V v1.0 LoRAs
|
| 377 |
|
| 378 |
+
The new dynamically resized 4-step and 8-step LoRAs are derived from the official ComfyUI-compatible files released by:
|
| 379 |
|
| 380 |
+
[lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main)
|
| 381 |
|
| 382 |
+
Credit for the source LoRA weights, training and release belongs to the LightX2V project and its contributors.
|
| 383 |
|
| 384 |
+
This repository only provides the dynamic-rank BF16 resize described above.
|
| 385 |
|
| 386 |
+
### Original Turbo LoRAs
|
| 387 |
|
| 388 |
+
The older Turbo LoRA weights, training work and distillation method were released by:
|
|
|
|
|
|
|
|
|
|
|
|
|
| 389 |
|
| 390 |
+
[larryvrh/MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 391 |
|
| 392 |
Original ComfyUI Turbo custom node:
|
| 393 |
|
| 394 |
+
[ComfyUI-MiniMax-H3-Turbo](https://github.com/Larryvrh/ComfyUI-MiniMax-H3-Turbo)
|
| 395 |
|
| 396 |
+
The custom node includes a dedicated MiniMax-H3 Turbo LoRA loader and sampling implementation for MiniMax-H3 video/audio scheduling.
|
| 397 |
|
| 398 |
+
This repository does not claim authorship of:
|
|
|
|
|
|
|
|
|
|
| 399 |
|
| 400 |
+
- the original LoRA weights;
|
| 401 |
+
- LoRA training or distillation;
|
| 402 |
+
- the few-step sampling methods;
|
| 403 |
+
- MiniMax-H3 video/audio scheduling;
|
| 404 |
+
- the MiniMax-H3 base model;
|
| 405 |
+
- the pruned/curve-form checkpoint;
|
| 406 |
+
- the LightX2V source weights;
|
| 407 |
+
- the original project documentation or generation code.
|
| 408 |
|
| 409 |
+
The modifications provided here are limited to:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 410 |
|
| 411 |
+
- pruned/curve-form ComfyUI compatibility conversions;
|
| 412 |
+
- namespace adjustments;
|
| 413 |
+
- removal of incompatible AdaLN adapters where required;
|
| 414 |
+
- exact dynamic-rank SVD resizing of the LightX2V ComfyUI LoRAs;
|
| 415 |
+
- BF16 safetensors packaging and validation.
|
| 416 |
|
| 417 |
+
Please retain attribution and comply with the licenses and terms of the original LoRAs and MiniMax-H3 base model when using or redistributing these files.
|