drbaph commited on
Commit
498f1e2
·
verified ·
1 Parent(s): f436fd3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +224 -467
README.md CHANGED
@@ -8,246 +8,214 @@ tags:
8
  - lora
9
  - adapter
10
  - comfyui
11
- - pruned
12
  - pruned-model
13
  - curve-form
14
  - text-to-video
15
- - text-to-audio
16
  - audio-video
17
- - video-generation
18
- - audio-generation
19
  - synchronized-audio
20
  - few-step
21
- - four-step
22
- - 4-step
23
  - turbo
24
  - accelerated-inference
25
- - further-trained
26
- - checkpoint-500
27
- - checkpoint-600
28
- - checkpoint-850
29
- - v4
30
- - ema
31
- - euler
32
- - beta-scheduler
33
  - safetensors
34
  - bfloat16
35
- - bf16
36
- - partial-conversion
37
  ---
38
 
39
- # MiniMax-H3 Turbo LoRA ComfyUI Pruned-Model Compatibility Conversions
40
 
41
- This repository contains third-party **ComfyUI compatibility conversions** of the original **MiniMax-H3 Turbo LoRA** created by **[larryvrh](https://huggingface.co/larryvrh)**.
42
 
43
- The Turbo LoRA enables few-step MiniMax-H3 audio-video generation, producing joint video and synchronized audio using substantially fewer sampling steps than the standard MiniMax-H3 workflow.
 
44
 
45
- This repository includes compatibility conversions of the initial Turbo weights as well as later **checkpoint-500**, **checkpoint-850**, and **v4 step-600** releases.
46
 
47
- These LoRAs are intended for the **pruned/curve-form MiniMax-H3 checkpoint used by ComfyUI**.
48
-
49
- > **Recommended checkpoint:** `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
50
  >
51
- > **Recommended settings:** **8 steps · Euler sampler · Beta scheduler**
 
52
 
53
  ---
54
 
55
- # Workflow Examples
56
 
57
- ## New Workflow Output
58
 
59
- This is the output from the current recommended workflow using the newer **v4 step-600 EMA** checkpoint and recommended sampling configuration.
60
 
61
- <video
62
- src="https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4"
63
- controls
64
- loop
65
- width="100%"> </video>
66
 
67
- ### New Recommended Workflow
 
 
 
68
 
69
- [Download the current ComfyUI workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
 
 
 
 
70
 
71
- The current workflow is:
72
 
73
- `fl_minimax_h3_turbo_lora_example_workflow.json`
 
 
 
 
 
 
 
 
 
 
 
74
 
75
- Recommended starting configuration:
76
 
77
  ```text
78
- Checkpoint: minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors
79
- Steps: 6
80
- Sampler: euler
81
- Scheduler: beta
82
- LoRA strength: 1.0
83
  ```
84
 
85
- ---
86
 
87
- ## Recommended Setup
88
 
89
- For the best overall results in this repository, start with:
 
 
 
90
 
91
- `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
 
 
92
 
93
- ### Recommended ComfyUI settings
94
 
95
- | Setting | Recommended |
96
- | ----------------- | ------------------------------------------------------------ |
97
- | LoRA | `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors` |
98
- | Steps | `6-8` |
99
- | Sampler | `euler` |
100
- | Scheduler | `beta` | |
101
- | LoRA strength | `1.0` starting point |
102
 
103
- The **v4 step-600 EMA** checkpoint is currently the recommended general-purpose version in this repository.
104
 
105
- For most generations, **8 steps with Euler and the Beta scheduler** is the recommended starting configuration for these ComfyUI compatibility versions.
 
 
 
 
 
 
106
 
107
  ---
108
 
109
- ## Old Workflow Output
110
 
111
- The following video and workflow are retained as an example of the previous Turbo LoRA configuration.
112
 
113
  <video
114
- src="https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4"
115
  controls
116
  loop
117
  width="100%"> </video>
118
 
119
- ### Old Workflow
120
-
121
- [Download the old ComfyUI workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
122
-
123
- The previous workflow has been renamed to:
124
-
125
- `fl_minimax_h3_turbo_lora_example_workflow_old.json`
126
-
127
- ![Old ComfyUI workflow screenshot](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/zfVV_yKP-njnOrGinGy8K.png)
128
-
129
- ---
130
 
131
- ## Original Project
132
 
133
- The original LoRA weights, training work, distillation method, audio/video sampling implementation, documentation and source files were created and released by **larryvrh**.
 
 
 
 
 
 
 
 
 
134
 
135
- **Original repository:**
136
- [larryvrh/MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)
137
 
138
- I did **not** train, distill or create the original Turbo LoRA weights.
139
 
140
- This repository provides modified compatibility versions intended to allow the compatible LoRA adapters to load with ComfyUI's built-in MiniMax-H3 LoRA loader when using the pruned/curve-form model.
141
 
142
- Full credit for the original MiniMax-H3 Turbo LoRA, training and distillation method belongs to **larryvrh**.
143
 
144
  ---
145
 
146
  ## Included Files
147
 
148
- | File | Description |
149
- | --------------------------------------------------------------- | ------------------------------------------------------------------------------------------------- |
150
- | `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors` | **Recommended.** Pruned-model ComfyUI compatibility conversion of the v4 step-600 EMA checkpoint. |
151
- | `minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors` | Non-EMA version of the v4 step-600 checkpoint for comparison. |
152
- | `minimax_h3_turbo_4step_ema_ckpt850_pruned_comfyui.safetensors` | EMA compatibility conversion of the checkpoint-850 weights. |
153
- | `minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors` | Non-EMA compatibility conversion of the checkpoint-850 weights. |
154
- | `minimax_h3_turbo_4step_ema_ckpt500_pruned_comfyui.safetensors` | Further-trained checkpoint-500 EMA variant in the pruned-model ComfyUI format. |
155
- | `minimax_h3_turbo_4step_ckpt500_pruned_comfyui.safetensors` | Further-trained checkpoint-500 non-EMA variant in the pruned-model ComfyUI format. |
156
- | `minimax_h3_turbo_4step_ema_pruned_comfyui.safetensors` | Compatibility conversion of the initial EMA Turbo release. |
157
- | `minimax_h3_turbo_4step_pruned_comfyui.safetensors` | Compatibility conversion of the initial non-EMA Turbo release. |
158
- | `fl_minimax_h3_turbo_lora_example_workflow.json` | **Current recommended ComfyUI example workflow.** |
159
- | `fl_minimax_h3_turbo_lora_example_workflow_old.json` | Previous example workflow, retained for reference and comparison. |
160
- | `assets/MiniMax_H3_audio.mp4` | Output video from the **new recommended workflow**. |
161
- | `assets/MiniMax_H3_00060-audio.mp4` | Output video from the previous workflow. |
162
-
163
- The EMA and non-EMA files remain separate and contain different tensor values.
164
-
165
- The files without checkpoint identifiers preserve the earlier preview weights.
166
-
167
- The `ckpt500` and `ckpt850` files belong to the older training line, while the `v4_step600` files use the newer **v4 training recipe**.
168
-
169
- These files are partial compatibility versions of the original full-model Turbo LoRAs for use with the pruned/curve-form MiniMax-H3 architecture.
170
-
171
- ---
172
-
173
- ## Which File Should I Use?
174
-
175
- ### Recommended — v4 Step-600 EMA
176
-
177
- Start with:
178
-
179
- `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
180
-
181
- Recommended configuration:
182
-
183
- * **Steps:** `6-8`
184
- * **Sampler:** `euler`
185
- * **Scheduler:** `beta`
186
- * **LoRA strength:** start at `1.0`
187
-
188
- This is the **recommended checkpoint for most generations**.
189
-
190
- ### v4 Step-600 non-EMA
191
-
192
- For comparison:
193
-
194
- `minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors`
195
-
196
- The non-EMA weights are provided primarily for testing and comparison against the recommended EMA checkpoint.
197
-
198
- ### Checkpoint-850
199
-
200
- EMA:
201
-
202
- `minimax_h3_turbo_4step_ema_ckpt850_pruned_comfyui.safetensors`
203
-
204
- Non-EMA:
205
-
206
- `minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors`
207
 
208
- These are retained for comparison with the newer v4 training line.
 
 
 
209
 
210
- ### Checkpoint-500
211
 
212
- EMA:
 
 
 
 
 
 
 
 
 
213
 
214
- `minimax_h3_turbo_4step_ema_ckpt500_pruned_comfyui.safetensors`
215
 
216
- Non-EMA:
 
 
 
 
 
217
 
218
- `minimax_h3_turbo_4step_ckpt500_pruned_comfyui.safetensors`
219
 
220
- These preserve the earlier further-trained checkpoint-500 release.
221
 
222
- ### Initial Preview Weights
223
 
224
- The following files preserve the initial preview versions:
225
 
226
- * `minimax_h3_turbo_4step_pruned_comfyui.safetensors`
227
- * `minimax_h3_turbo_4step_ema_pruned_comfyui.safetensors`
228
 
229
- They are kept primarily for comparison and reproducibility.
230
 
231
- ---
232
 
233
- ## Recommended Workflow
234
 
235
- The current recommended workflow file is:
236
 
237
- `fl_minimax_h3_turbo_lora_example_workflow.json`
238
 
239
- Download:
240
 
241
- [fl_minimax_h3_turbo_lora_example_workflow.json](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
242
 
243
- It is intended to be used with:
244
 
245
  `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
246
 
247
- Recommended configuration:
248
 
249
  ```text
250
- Steps: 8
251
  Sampler: euler
252
  Scheduler: beta
253
  LoRA strength: 1.0
@@ -255,221 +223,102 @@ Video sigma shift: 12
255
  Audio sigma shift: 4-6
256
  ```
257
 
258
- The corresponding example output is:
259
-
260
- `assets/MiniMax_H3_audio.mp4`
261
-
262
- [View / download MiniMax_H3_audio.mp4](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4)
263
-
264
- ---
265
-
266
- ## Previous Workflow
267
-
268
- The previous example workflow is retained as:
269
-
270
- `fl_minimax_h3_turbo_lora_example_workflow_old.json`
271
-
272
- Download:
273
-
274
- [fl_minimax_h3_turbo_lora_example_workflow_old.json](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
275
-
276
- Its corresponding example output is:
277
-
278
- `assets/MiniMax_H3_00060-audio.mp4`
279
-
280
- [View / download MiniMax_H3_00060-audio.mp4](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4)
281
 
282
  ---
283
 
284
- ## About the Original Turbo LoRA
285
-
286
- The MiniMax-H3 Turbo LoRA is designed to generate joint video and synchronized stereo audio using dramatically fewer sampling steps than the standard MiniMax-H3 generation process.
287
-
288
- The original project demonstrated generation using substantially fewer sampling steps than the normal MiniMax-H3 workflow, providing a large reduction in sampling time.
289
 
290
- The newer Turbo checkpoints continue to improve upon the initial preview release.
291
-
292
- Refer to the original repository for the author's current documentation, training updates, standalone generation implementation and sampling recommendations:
293
-
294
- [larryvrh/MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)
295
-
296
- ---
297
-
298
- ## Why This Conversion Was Made
299
-
300
- The original Turbo LoRA files use tensor keys such as:
301
 
302
  `blocks.0.attn.qkv_proj.lora_A.weight`
303
 
304
- ComfyUI's built-in MiniMax-H3 LoRA resolver expects keys under the model namespace:
305
 
306
  `diffusion_model.blocks.0.attn.qkv_proj.lora_A.weight`
307
 
308
- Without that namespace, ComfyUI may report warnings such as:
309
-
310
- `[WARNING] lora key not loaded: blocks.0.attn.out_proj.lora_A.weight`
311
-
312
- The following namespace conversion was applied to the retained tensors:
313
-
314
- * `blocks.*` → `diffusion_model.blocks.*`
315
- * `token_refiner.*` → `diffusion_model.token_refiner.*`
316
-
317
- The retained tensor values, BF16 dtype, tensor shapes, LoRA rank and A/B orientation were preserved.
318
-
319
- ---
320
-
321
- ## Conversion Details
322
 
323
- Each original full-model Turbo LoRA contained:
 
324
 
325
- | Component | Count |
326
- | --------------------- | ----: |
327
- | Source tensors | 518 |
328
- | Source LoRA A/B pairs | 259 |
329
 
330
- Each pruned-model compatibility conversion contains:
331
 
332
- | Component | Count |
333
- | ----------------------- | ----: |
334
- | Retained tensors | 416 |
335
- | Retained LoRA A/B pairs | 208 |
336
- | Pruned AdaLN tensors | 102 |
337
- | Pruned AdaLN A/B pairs | 51 |
338
-
339
- The pruned adapters were:
340
-
341
- * 50 AdaLN projection pairs from `blocks.0` through `blocks.49`;
342
- * 1 AdaLN projection pair from `final_layer.adaln_proj.linear`.
343
 
344
  The retained adapters include:
345
 
346
- * all main-block attention adapters;
347
- * all main-block MLP adapters;
348
- * all token-refiner attention adapters;
349
- * all token-refiner MLP adapters.
350
-
351
- The retained attention, MLP and token-refiner tensors have dimensions compatible with the pruned/curve-form MiniMax-H3 checkpoint.
352
 
353
- ---
354
-
355
- ## Validation
356
 
357
- The converted LoRA structure was checked for:
 
358
 
359
- * complete LoRA A/B adapter pairs;
360
- * no orphan A or B tensors;
361
- * retained keys using the `diffusion_model.*` namespace;
362
- * no duplicated `diffusion_model.diffusion_model.*` prefixes;
363
- * no incompatible `adaln_proj` tensors;
364
- * preserved BF16 dtype;
365
- * preserved tensor shapes;
366
- * preserved LoRA ranks;
367
- * separate EMA and non-EMA weights;
368
- * no unresolved retained keys during ComfyUI loader-level validation.
369
 
370
- The original source files were not overwritten.
371
-
372
- ---
373
-
374
- ## Optional Acceleration
375
-
376
- The LoRAs have been tested working in ComfyUI with optional acceleration methods including:
377
-
378
- * **SageAttention**
379
- * **Sol Attention**
380
- * **Gradient**
381
- * **Spectrum**
382
-
383
- These acceleration methods are optional and are not included in this repository.
384
-
385
- They may also be combined with the Turbo LoRA depending on your ComfyUI workflow and available custom nodes.
386
-
387
- ---
388
-
389
- ## Important Limitation
390
-
391
- These files are **partial ComfyUI compatibility conversions intended specifically for the pruned/curve-form MiniMax-H3 architecture**.
392
-
393
- The original full-model Turbo LoRAs contain AdaLN adapters that do not directly match the corresponding dimensions of the pruned/curve-form MiniMax-H3 checkpoint.
394
-
395
- Those incompatible AdaLN tensors are therefore excluded from these compatibility versions.
396
-
397
- The retained attention, MLP and token-refiner LoRA tensors remain compatible with the pruned architecture.
398
-
399
- Because these are partial compatibility conversions, they should not be assumed to be numerically identical in behaviour to using the original full Turbo LoRA with its intended full MiniMax-H3 base.
400
 
401
  ---
402
 
403
  ## Usage
404
 
405
- Place the LoRA files inside:
406
 
407
  `ComfyUI/models/loras/`
408
 
409
- Use them with the **pruned/curve-form MiniMax-H3 checkpoint for ComfyUI**.
410
-
411
- ### Recommended LoRA
412
-
413
- `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
414
-
415
- ### Recommended settings
416
-
417
- * **Steps:** `8`
418
- * **Sampler:** `euler`
419
- * **Scheduler:** `beta`
420
- * **Video sigma shift:** `12`
421
- * **Audio sigma shift:** `4-6`
422
- * **LoRA strength:** `1.0` recommended starting point
423
-
424
- The recommended workflow for these settings is:
425
-
426
- [Download `fl_minimax_h3_turbo_lora_example_workflow.json`](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
427
-
428
- The corresponding example output is:
429
 
430
- [View `assets/MiniMax_H3_audio.mp4`](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4)
431
 
432
- If necessary, LoRA strength can be adjusted slightly for individual generations.
433
 
434
- A reasonable starting range is approximately:
435
 
436
  `0.8-1.2`
437
 
438
- When comparing checkpoints, use the same:
439
 
440
- * prompt;
441
- * seed;
442
- * resolution;
443
- * frame count;
444
- * base model;
445
- * sampler;
446
- * scheduler;
447
- * LoRA strength;
448
- * workflow.
449
-
450
- This gives a meaningful comparison between checkpoint versions.
451
 
452
  ---
453
 
454
- ## Sampling Step Guidance
455
-
456
- The Turbo LoRA can operate at extremely low step counts, but image quality and motion consistency generally improve when moving beyond the minimum.
457
 
458
  ### 4 steps
459
 
460
- Maximum speed.
461
-
462
- Useful for testing and rapid previews.
463
 
464
  ### 6 steps
465
 
466
- Good speed/quality compromise.
467
 
468
  ### 8 steps
469
 
470
- **Recommended for the v4 step-600 EMA compatibility conversion.**
471
 
472
- Use:
473
 
474
  ```text
475
  8 steps
@@ -477,7 +326,9 @@ Euler sampler
477
  Beta scheduler
478
  ```
479
 
480
- This is the recommended configuration used by the current example workflow.
 
 
481
 
482
  ---
483
 
@@ -485,176 +336,82 @@ This is the recommended configuration used by the current example workflow.
485
 
486
  MiniMax-H3 generates video and synchronized audio as separate streams with different scheduling requirements.
487
 
488
- Incorrect audio scheduling can result in:
489
 
490
- * blown-out audio;
491
- * severe distortion;
492
- * noise-like audio;
493
- * unstable audio energy;
494
- * completely broken audio.
495
 
496
- For the current recommended ComfyUI compatibility workflow in this repository:
497
 
498
- ```text
499
- LoRA: minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors
500
- Steps: 8
501
- Sampler: euler
502
- Scheduler: beta
503
- Video sigma shift: 12
504
- Audio sigma shift: 4-6
505
- LoRA strength: 1.0
506
- ```
507
-
508
- Do not automatically assume broken audio is caused by the LoRA.
509
-
510
- Check:
511
 
512
- * sampler configuration;
513
- * scheduler configuration;
514
- * audio sigma shift;
515
- * video sigma shift;
516
- * ComfyUI version;
517
- * MiniMax-H3 sampling implementation;
518
- * custom sampler nodes.
519
 
520
  ---
521
 
522
- ## Original Turbo Custom Node
523
-
524
- The original Turbo author also provides a dedicated ComfyUI custom node:
525
-
526
- [GitHub — Larryvrh/ComfyUI-MiniMax-H3-Turbo](https://github.com/Larryvrh/ComfyUI-MiniMax-H3-Turbo)
527
-
528
- The node includes a MiniMax-H3 Turbo LoRA loader and dedicated sampling functionality designed for MiniMax-H3's video/audio scheduling behaviour.
529
-
530
- A workflow is also included in the custom-node repository.
531
-
532
- The custom node evolves alongside the upstream Turbo weights, so users choosing that implementation should follow the settings documented in its current README.
533
-
534
- The settings documented in this repository refer to the tested **pruned-model compatibility workflow**, where the recommended starting point is:
535
-
536
- **v4 step-600 EMA · 8 steps · Euler · Beta scheduler**
537
-
538
- ---
539
-
540
- ## Compatibility
541
-
542
- These LoRAs are intended for the **pruned/curve-form MiniMax-H3 checkpoint used by ComfyUI**.
543
-
544
- The compatibility conversions are particularly useful when the original full-model LoRA cannot be loaded directly because of incompatible AdaLN dimensions.
545
-
546
- Optional acceleration methods confirmed working with these conversions include:
547
-
548
- * SageAttention
549
- * Sol Attention
550
- * Gradient
551
- * Spectrum
552
-
553
- Accelerators can generally be stacked where the corresponding ComfyUI implementations support it.
554
-
555
- ---
556
-
557
- ## Naming Notes
558
-
559
- The upstream project contains multiple generations of Turbo training.
560
-
561
- ### Older naming
562
-
563
- Files such as:
564
-
565
- `minimax_h3_turbo_4step_ema_ckpt500.safetensors`
566
-
567
- and:
568
-
569
- `minimax_h3_turbo_4step_ema_ckpt850.safetensors`
570
-
571
- belong to the older training line.
572
-
573
- In these filenames, `4step` refers to the few-step Turbo sampling target.
574
-
575
- ### Newer v4 naming
576
-
577
- Files such as:
578
-
579
- `minimax_h3_turbo_v4_step600_ema.safetensors`
580
-
581
- use the newer naming convention.
582
-
583
- Here:
584
-
585
- * `v4` refers to the newer training recipe;
586
- * `step600` refers to training step 600;
587
- * `ema` refers to the exponential-moving-average weights.
588
 
589
- The corresponding pruned ComfyUI compatibility conversion in this repository is:
590
 
591
- `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
 
 
 
592
 
593
- This is the **recommended checkpoint**.
594
 
595
  ---
596
 
597
- ## Repository Workflow Files
598
-
599
- ### Current workflow
600
-
601
- `fl_minimax_h3_turbo_lora_example_workflow.json`
602
-
603
- [Download current workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
604
-
605
- Current workflow output:
606
 
607
- `assets/MiniMax_H3_audio.mp4`
608
 
609
- [View current workflow output](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4)
610
 
611
- ### Previous workflow
612
 
613
- `fl_minimax_h3_turbo_lora_example_workflow_old.json`
614
 
615
- [Download previous workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
616
 
617
- Previous workflow output:
618
 
619
- `assets/MiniMax_H3_00060-audio.mp4`
620
-
621
- [View previous workflow output](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4)
622
-
623
- ---
624
 
625
- ## Attribution
626
-
627
- Original MiniMax-H3 Turbo LoRA author:
628
-
629
- **[larryvrh](https://huggingface.co/larryvrh)**
630
-
631
- Original project:
632
-
633
- **[MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)**
634
 
635
  Original ComfyUI Turbo custom node:
636
 
637
- **[ComfyUI-MiniMax-H3-Turbo](https://github.com/Larryvrh/ComfyUI-MiniMax-H3-Turbo)**
638
 
639
- This repository contains third-party, partial ComfyUI compatibility versions for the pruned/curve-form MiniMax-H3 checkpoint, including:
640
 
641
- * initial Turbo preview weights;
642
- * checkpoint-500 variants;
643
- * checkpoint-850 variants;
644
- * v4 step-600 variants.
645
 
646
- I do not claim authorship of:
 
 
 
 
 
 
 
647
 
648
- * the original Turbo LoRA weights;
649
- * the original LoRA training;
650
- * the original distillation method;
651
- * the original few-step sampling method;
652
- * the original dual video/audio scheduling implementation;
653
- * the original generation scripts;
654
- * the original documentation;
655
- * the MiniMax-H3 base model;
656
- * the pruned/curve-form MiniMax-H3 checkpoint.
657
 
658
- The modifications in this repository are compatibility conversions intended to make the compatible portions of the upstream Turbo LoRAs usable with the pruned/curve-form MiniMax-H3 architecture in ComfyUI.
 
 
 
 
659
 
660
- Please retain attribution to **larryvrh** and comply with the licences and terms of the original LoRA and MiniMax-H3 base model when using or redistributing these files.
 
8
  - lora
9
  - adapter
10
  - comfyui
 
11
  - pruned-model
12
  - curve-form
13
  - text-to-video
 
14
  - audio-video
 
 
15
  - synchronized-audio
16
  - few-step
 
 
17
  - turbo
18
  - accelerated-inference
19
+ - lightx2v
20
+ - dynamic-rank
21
+ - svd
 
 
 
 
 
22
  - safetensors
23
  - bfloat16
 
 
24
  ---
25
 
26
+ # MiniMax-H3 Turbo LoRAs for ComfyUI
27
 
28
+ This repository contains third-party MiniMax-H3 Turbo LoRA conversions for ComfyUI, including:
29
 
30
+ - pruned/curve-form compatibility conversions of the Turbo LoRAs released by [larryvrh](https://huggingface.co/larryvrh);
31
+ - dynamically resized 4-step and 8-step v1.0 LoRAs derived from the official ComfyUI weights in [lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main).
32
 
33
+ The Turbo LoRAs accelerate MiniMax-H3 joint video and synchronized-audio generation by reducing the required number of sampling steps.
34
 
35
+ > **Recommended pruned-model LoRA:**
36
+ > `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
 
37
  >
38
+ > **Recommended starting settings:**
39
+ > **6–8 steps · Euler sampler · Beta scheduler · LoRA strength 1.0**
40
 
41
  ---
42
 
43
+ ## **Update — LightX2V v1.0 Dynamic-Rank LoRAs**
44
 
45
+ Two resized BF16 LoRAs have been added from the official ComfyUI-compatible weights published in:
46
 
47
+ [lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main)
48
 
49
+ ### New files
 
 
 
 
50
 
51
+ | File | Source | Description |
52
+ | --- | --- | --- |
53
+ | `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors` | `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_bf16.safetensors` | Dynamically resized 4-step 768p LightX2V LoRA. |
54
+ | `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_resized_avg_rank_21_bf16.safetensors` | `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_bf16.safetensors` | Dynamically resized 8-step LightX2V LoRA. |
55
 
56
+ These files were already supplied by LightX2V in the correct ComfyUI MiniMax-H3 layout. The update applies dynamic-rank compression without changing the model namespace or QKV layout expected by ComfyUI.
57
+
58
+ ### How the new LoRAs were resized
59
+
60
+ The LoRAs were resized using an exact compact SVD calculated directly from each LoRA A/B factor pair.
61
 
62
+ The process was:
63
 
64
+ 1. Treat every attention, MLP and token-refiner projection independently.
65
+ 2. Separate the fused QKV LoRA into its original Q, K and V projections.
66
+ 3. Calculate the exact singular spectrum of each effective `B @ A` update without materializing the full dense weight matrix.
67
+ 4. Select a dynamic rank independently for each projection.
68
+ 5. Preserve one additional safety rank after the selected Frobenius-energy threshold.
69
+ 6. Rebuild the factors using balanced singular values:
70
+ - `A = sqrt(S) × Vh`
71
+ - `B = U × sqrt(S)`
72
+ 7. Re-fuse Q, K and V using a block-diagonal B matrix and concatenated A matrix.
73
+ 8. Bake the original `alpha / rank` scale into `lora_B`.
74
+ 9. Remove the now-unnecessary alpha tensors.
75
+ 10. Save all resulting LoRA tensors as BF16.
76
 
77
+ The target was the same true average projection rank represented by an `avg_rank_21` filename:
78
 
79
  ```text
80
+ Rank sum: 6778
81
+ Projection count: 312
82
+ Average projection rank: 21.724359
83
+ Filename rank: floor(21.724359) = 21
 
84
  ```
85
 
86
+ Q, K and V are counted separately when calculating the average. The rank of a fused QKV tensor is the sum of its three independently selected projection ranks.
87
 
88
+ ### Resize results
89
 
90
+ | LoRA | Size | Average rank | Average Frobenius norm retained | Baked scale |
91
+ | --- | ---: | ---: | ---: | ---: |
92
+ | 4-step v1.0 768p | 284.36 MiB | 21.724359 | 94.95% | 1.0 |
93
+ | 8-step v1.0 | 311.89 MiB | 21.724359 | 97.72% | 0.0625 |
94
 
95
+ The thresholds were solved independently because the singular-value distributions differ between the 4-step and 8-step LoRAs. Using one fixed threshold would not produce the same average rank for both files.
96
+
97
+ ### Validation of the resized files
98
 
99
+ Each resized file contains:
100
 
101
+ | Component | Count |
102
+ | --- | ---: |
103
+ | BF16 tensors | 416 |
104
+ | LoRA A/B pairs | 208 |
105
+ | Independently ranked projections | 312 |
106
+ | QKV modules | 52 |
107
+ | Alpha tensors | 0 |
108
 
109
+ Validation confirmed:
110
 
111
+ - all tensors are finite BF16 values;
112
+ - every LoRA A tensor has a matching LoRA B tensor;
113
+ - all 208 adapters are recognized by ComfyUI;
114
+ - QKV rank columns remain block-diagonal and correctly ordered as Q, K and V;
115
+ - the effective original LoRA strength is preserved;
116
+ - the exact average projection rank is 21.724359;
117
+ - no incompatible or unresolved tensors remain.
118
 
119
  ---
120
 
121
+ ## Workflow Example
122
 
123
+ The following output was generated with the recommended pruned-model workflow using the v4 step-600 EMA LoRA.
124
 
125
  <video
126
+ src="https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_audio.mp4"
127
  controls
128
  loop
129
  width="100%"> </video>
130
 
131
+ ### Current workflow
 
 
 
 
 
 
 
 
 
 
132
 
133
+ [Download the current ComfyUI workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow.json?download=true)
134
 
135
+ ```text
136
+ Workflow: fl_minimax_h3_turbo_lora_example_workflow.json
137
+ LoRA: minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors
138
+ Steps: 6-8
139
+ Sampler: euler
140
+ Scheduler: beta
141
+ LoRA strength: 1.0
142
+ Video sigma shift: 12
143
+ Audio sigma shift: 4-6
144
+ ```
145
 
146
+ The previous workflow is retained here:
 
147
 
148
+ [Download the previous workflow](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/fl_minimax_h3_turbo_lora_example_workflow_old.json?download=true)
149
 
150
+ Its corresponding example output is:
151
 
152
+ [View the previous workflow output](https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/resolve/main/assets/MiniMax_H3_00060-audio.mp4)
153
 
154
  ---
155
 
156
  ## Included Files
157
 
158
+ ### LightX2V dynamic-rank update
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
159
 
160
+ | File | Description |
161
+ | --- | --- |
162
+ | `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors` | Exact dynamic-SVD resize of the official LightX2V 4-step v1.0 768p ComfyUI LoRA. |
163
+ | `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_resized_avg_rank_21_bf16.safetensors` | Exact dynamic-SVD resize of the official LightX2V 8-step v1.0 ComfyUI LoRA. |
164
 
165
+ ### Pruned/curve-form compatibility conversions
166
 
167
+ | File | Description |
168
+ | --- | --- |
169
+ | `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors` | **Recommended.** Pruned-model conversion of the v4 step-600 EMA checkpoint. |
170
+ | `minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors` | Non-EMA v4 step-600 variant. |
171
+ | `minimax_h3_turbo_4step_ema_ckpt850_pruned_comfyui.safetensors` | EMA checkpoint-850 conversion. |
172
+ | `minimax_h3_turbo_4step_ckpt850_pruned_comfyui.safetensors` | Non-EMA checkpoint-850 conversion. |
173
+ | `minimax_h3_turbo_4step_ema_ckpt500_pruned_comfyui.safetensors` | EMA checkpoint-500 conversion. |
174
+ | `minimax_h3_turbo_4step_ckpt500_pruned_comfyui.safetensors` | Non-EMA checkpoint-500 conversion. |
175
+ | `minimax_h3_turbo_4step_ema_pruned_comfyui.safetensors` | Initial EMA Turbo preview conversion. |
176
+ | `minimax_h3_turbo_4step_pruned_comfyui.safetensors` | Initial non-EMA Turbo preview conversion. |
177
 
178
+ ### Workflows and assets
179
 
180
+ | File | Description |
181
+ | --- | --- |
182
+ | `fl_minimax_h3_turbo_lora_example_workflow.json` | Current recommended ComfyUI workflow. |
183
+ | `fl_minimax_h3_turbo_lora_example_workflow_old.json` | Previous workflow retained for comparison. |
184
+ | `assets/MiniMax_H3_audio.mp4` | Current workflow example output. |
185
+ | `assets/MiniMax_H3_00060-audio.mp4` | Previous workflow example output. |
186
 
187
+ EMA and non-EMA files contain different tensor values and are retained separately.
188
 
189
+ ---
190
 
191
+ ## Which File Should I Use?
192
 
193
+ ### LightX2V 4-step v1.0
194
 
195
+ Use:
 
196
 
197
+ `minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors`
198
 
199
+ Choose this for the newer LightX2V 4-step 768p FL2V workflow when maximum sampling speed is preferred.
200
 
201
+ ### LightX2V 8-step v1.0
202
 
203
+ Use:
204
 
205
+ `minimax_h3_fl2v_turbo_8step_v1.0_comfyui_resized_avg_rank_21_bf16.safetensors`
206
 
207
+ Choose this for the newer LightX2V 8-step workflow when prioritizing quality and motion consistency over the minimum possible step count.
208
 
209
+ ### Recommended pruned-model conversion
210
 
211
+ For the existing pruned/curve-form workflow in this repository, start with:
212
 
213
  `minimax_h3_turbo_v4_step600_ema_pruned_comfyui.safetensors`
214
 
215
+ Recommended settings:
216
 
217
  ```text
218
+ Steps: 6-8
219
  Sampler: euler
220
  Scheduler: beta
221
  LoRA strength: 1.0
 
223
  Audio sigma shift: 4-6
224
  ```
225
 
226
+ The non-EMA, checkpoint-500, checkpoint-850 and initial preview files are provided primarily for testing, comparison and reproducibility.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
227
 
228
  ---
229
 
230
+ ## Why the Pruned Compatibility Conversion Was Needed
 
 
 
 
231
 
232
+ The original full-model Turbo LoRAs use keys such as:
 
 
 
 
 
 
 
 
 
 
233
 
234
  `blocks.0.attn.qkv_proj.lora_A.weight`
235
 
236
+ ComfyUI expects the corresponding keys under the model namespace:
237
 
238
  `diffusion_model.blocks.0.attn.qkv_proj.lora_A.weight`
239
 
240
+ The following namespace conversion was applied:
 
 
 
 
 
 
 
 
 
 
 
 
 
241
 
242
+ - `blocks.*` `diffusion_model.blocks.*`
243
+ - `token_refiner.*` → `diffusion_model.token_refiner.*`
244
 
245
+ The original full-model LoRAs also contain AdaLN adapters whose dimensions do not match the pruned/curve-form MiniMax-H3 checkpoint. Those incompatible adapters were removed.
 
 
 
246
 
247
+ ### Pruned conversion structure
248
 
249
+ | Component | Count |
250
+ | --- | ---: |
251
+ | Source tensors | 518 |
252
+ | Source LoRA A/B pairs | 259 |
253
+ | Retained tensors | 416 |
254
+ | Retained LoRA A/B pairs | 208 |
255
+ | Removed AdaLN tensors | 102 |
256
+ | Removed AdaLN A/B pairs | 51 |
 
 
 
257
 
258
  The retained adapters include:
259
 
260
+ - all main-block attention adapters;
261
+ - all main-block MLP adapters;
262
+ - all token-refiner attention adapters;
263
+ - all token-refiner MLP adapters.
 
 
264
 
265
+ The removed adapters consist of:
 
 
266
 
267
+ - 50 AdaLN projection pairs from `blocks.0` through `blocks.49`;
268
+ - one AdaLN pair from `final_layer.adaln_proj.linear`.
269
 
270
+ These pruned files are partial compatibility conversions and should not be assumed to behave identically to the original full-model LoRA used with its intended full MiniMax-H3 base model.
 
 
 
 
 
 
 
 
 
271
 
272
+ The newer LightX2V update does not use this pruning process because its source files were already released in the required ComfyUI MiniMax-H3 layout.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
273
 
274
  ---
275
 
276
  ## Usage
277
 
278
+ Place the LoRA files in:
279
 
280
  `ComfyUI/models/loras/`
281
 
282
+ Load them with the compatible MiniMax-H3 model and workflow.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
283
 
284
+ A reasonable starting strength is:
285
 
286
+ `1.0`
287
 
288
+ If adjustment is needed, test approximately:
289
 
290
  `0.8-1.2`
291
 
292
+ When comparing LoRAs, keep the following identical:
293
 
294
+ - prompt;
295
+ - seed;
296
+ - resolution;
297
+ - frame count;
298
+ - base model;
299
+ - sampler;
300
+ - scheduler;
301
+ - LoRA strength;
302
+ - sigma shifts;
303
+ - workflow.
 
304
 
305
  ---
306
 
307
+ ## Sampling Guidance
 
 
308
 
309
  ### 4 steps
310
 
311
+ Maximum speed and useful for rapid previews.
 
 
312
 
313
  ### 6 steps
314
 
315
+ A good speed-to-quality compromise for the v4 step-600 EMA pruned conversion.
316
 
317
  ### 8 steps
318
 
319
+ Recommended when prioritizing quality, motion consistency and synchronized audio stability.
320
 
321
+ For the existing pruned-model workflow:
322
 
323
  ```text
324
  8 steps
 
326
  Beta scheduler
327
  ```
328
 
329
+ Follow the LightX2V project recommendations when using the new v1.0 FL2V LoRAs:
330
+
331
+ [lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main)
332
 
333
  ---
334
 
 
336
 
337
  MiniMax-H3 generates video and synchronized audio as separate streams with different scheduling requirements.
338
 
339
+ Incorrect audio scheduling may cause:
340
 
341
+ - severe distortion;
342
+ - noise-like output;
343
+ - unstable audio energy;
344
+ - blown-out audio;
345
+ - completely broken audio.
346
 
347
+ If audio is unstable, check:
348
 
349
+ - sampler and scheduler configuration;
350
+ - audio sigma shift;
351
+ - video sigma shift;
352
+ - ComfyUI version;
353
+ - MiniMax-H3 sampling implementation;
354
+ - custom sampler nodes;
355
+ - the workflow intended for the selected LoRA.
 
 
 
 
 
 
356
 
357
+ Broken audio should not automatically be attributed to the LoRA.
 
 
 
 
 
 
358
 
359
  ---
360
 
361
+ ## Optional Acceleration
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
362
 
363
+ These compatibility LoRAs have been used with optional ComfyUI acceleration methods including:
364
 
365
+ - SageAttention
366
+ - Sol Attention
367
+ - Gradient
368
+ - Spectrum
369
 
370
+ These methods are optional and are not included in this repository. Compatibility depends on the corresponding ComfyUI implementation and workflow.
371
 
372
  ---
373
 
374
+ ## Original Projects and Attribution
 
 
 
 
 
 
 
 
375
 
376
+ ### LightX2V v1.0 LoRAs
377
 
378
+ The new dynamically resized 4-step and 8-step LoRAs are derived from the official ComfyUI-compatible files released by:
379
 
380
+ [lightx2v/Minimax-h3-Turbo](https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main)
381
 
382
+ Credit for the source LoRA weights, training and release belongs to the LightX2V project and its contributors.
383
 
384
+ This repository only provides the dynamic-rank BF16 resize described above.
385
 
386
+ ### Original Turbo LoRAs
387
 
388
+ The older Turbo LoRA weights, training work and distillation method were released by:
 
 
 
 
389
 
390
+ [larryvrh/MiniMax-H3-Turbo-Lora](https://huggingface.co/larryvrh/MiniMax-H3-Turbo-Lora)
 
 
 
 
 
 
 
 
391
 
392
  Original ComfyUI Turbo custom node:
393
 
394
+ [ComfyUI-MiniMax-H3-Turbo](https://github.com/Larryvrh/ComfyUI-MiniMax-H3-Turbo)
395
 
396
+ The custom node includes a dedicated MiniMax-H3 Turbo LoRA loader and sampling implementation for MiniMax-H3 video/audio scheduling.
397
 
398
+ This repository does not claim authorship of:
 
 
 
399
 
400
+ - the original LoRA weights;
401
+ - LoRA training or distillation;
402
+ - the few-step sampling methods;
403
+ - MiniMax-H3 video/audio scheduling;
404
+ - the MiniMax-H3 base model;
405
+ - the pruned/curve-form checkpoint;
406
+ - the LightX2V source weights;
407
+ - the original project documentation or generation code.
408
 
409
+ The modifications provided here are limited to:
 
 
 
 
 
 
 
 
410
 
411
+ - pruned/curve-form ComfyUI compatibility conversions;
412
+ - namespace adjustments;
413
+ - removal of incompatible AdaLN adapters where required;
414
+ - exact dynamic-rank SVD resizing of the LightX2V ComfyUI LoRAs;
415
+ - BF16 safetensors packaging and validation.
416
 
417
+ Please retain attribution and comply with the licenses and terms of the original LoRAs and MiniMax-H3 base model when using or redistributing these files.