100 Commits
Author SHA1 Message Date
Jukka Seppänen 6bfaacc67c feat: Qwen-image 2.1 support (CORE-423) (#16400) 2026-09-19 18:44:02 -04:00
Jukka Seppänen 9a77c1db9e Qwen3/3.5/3.8 cudagraphs and w4a8 gemv support (CORE-390) (#15623) 2026-09-17 20:38:24 -04:00
Jukka Seppänen a2f455c9da feat: Support MoGe 3 (CORE-443) (#16381) 2026-09-17 14:17:04 -04:00
Jukka Seppänen b2e31e8941 MiniMax-H3 VAE optimizations (#16187) 2026-09-14 23:50:34 -04:00
Jukka Seppänen 1d91a82dc6 feat: Marigold v2 support (CORE-431) (#16232) 2026-09-11 15:40:56 -07:00
Jukka Seppänen b7ebfd73c5 Fix quantized text encoder matmul gating and Gemma4 prefill cache positions (#16185) 2026-09-08 14:57:44 -04:00
Jukka Seppänen 488e8f8ab8 feat: Pixal3D multiview model support (CORE-421) (#16048) 2026-09-08 11:18:45 -07:00
Jukka Seppänen e308cc73b4 Add Sparse Attention node (#16072)
* support VSA

* BlockSparseAttention node

* Add extra_tokens

* cleanup

* cleanup
2026-09-05 21:18:15 -04:00
Jukka Seppänen 1aec3a1351 MiniMax-H3: Make VAE optional, allow using text encoder only references (#16065) 2026-09-03 15:51:47 -04:00
Jukka Seppänen 02aa70781a Allow using references with MiniMax-H3 Fun Union and fix prefetch race condition (#16020) 2026-09-01 19:09:42 -04:00
Jukka Seppänen 2504e68d4d MiniMax-H3: Support PDD LoRA (#15908) 2026-08-28 18:12:36 -04:00
Jukka Seppänen 82f839f5e7 feat: Support Sam3d-body (CORE-35) (#14370) 2026-08-22 22:08:22 -04:00
Jukka Seppänen 924743af08 Minimax-H3: Add missing special tokens (#15808) 2026-08-22 18:03:29 -04:00
Jukka Seppänen 0e65cb9071 feat: Support Pixal3d and TRELLIS2 (CORE-278) (CORE-199) (CORE-236) (CORE-312) (#14718) 2026-08-21 20:32:25 -04:00
Jukka Seppänen 55b6a9b11d Fix thinking handling (#15611) 2026-08-14 15:17:18 -04:00
Jukka Seppänen 7fe8a61385 Speedup Gemma4 text generation (CORE-371) (#15054) 2026-08-13 21:12:55 -04:00
Jukka Seppänen 27bca654eb Fix KSamplerAdvanced with add_noise disabled on nested latents (#15447) 2026-08-11 17:58:00 -04:00
Jukka Seppänen 2a68ce33b4 Optimize MiniMax-H3 VAE (#15446) 2026-08-09 14:24:48 -04:00
Jukka Seppänen 344b43989e Support asym w4a8_int (#15308)
* support asym w4a8_int

* Simplify

* Fixes
2026-08-07 08:32:57 -07:00
Jukka Seppänen 93cb5edb98 Fix audio carry to wrappers (#15390) 2026-08-07 08:30:21 -07:00
Jukka Seppänen a464ac3358 feat: Support Wan-Animate2 (CORE-358) (#15362) 2026-08-06 21:08:16 -04:00
Jukka Seppänen bdcb886a47 Fix sampler issues for audio with minimax, support more samplers. (#15243) 2026-08-06 13:36:34 -07:00
Jukka Seppänen 15989f87ca Speedup LTX and Wan (#15138) 2026-08-05 21:15:48 -04:00
Jukka Seppänen bbda83647d Support int8_convrot VAE (#15334) 2026-08-05 21:12:23 -04:00
Jukka Seppänen 57500fc5bc feat: Support MiniMax-H3 (CORE-375) (#15224) 2026-08-02 22:28:29 -04:00
Jukka Seppänen 49a7422892 Support latent previews for nested latents (#15196) 2026-08-01 19:57:15 -04:00
Jukka Seppänen c38171ddb9 Support Pruna LTX VAE (#15129) 2026-07-28 18:25:55 -04:00
Jukka Seppänen 3d41e3ea4e Support int8 convrot embedding lookup (#15035) 2026-07-28 17:02:57 -04:00
Jukka Seppänen a3572c4832 Allow using float fps for LTXVEmptyLatentAudio (#15106) 2026-07-27 13:04:14 -07:00
Jukka Seppänen 806e092ed4 Fix MageFlow on cards that don't support bf16 (#15081) 2026-07-25 21:01:51 -04:00
Jukka Seppänen 6f6c500c15 Improve LTXV IC-lora detection (#15073) 2026-07-25 14:30:37 +03:00
Jukka Seppänen 45ffd5430b feat: Support MageFlow (CORE-372) (#15026) 2026-07-24 23:14:01 -04:00
Jukka Seppänen ecba6f2594 feat: Support Gemma4 12B (CORE-277) (#14304) 2026-07-20 19:33:26 -04:00
Jukka Seppänen 2a61015582 feat: Support Krea2 (#14589) 2026-06-22 14:35:00 -07:00
Jukka Seppänen e25c391888 feat: Support Boogu-Image (CORE-308) (#14523) 2026-06-17 14:22:36 -07:00
Jukka Seppänen ca3dbe206c Allow using Qwen3-VL as flux2 klein text encoder (again) (#14526) 2026-06-17 08:45:06 -07:00
Jukka Seppänen a590d60bb1 feat: SCAIL-2 multireference (CORE-310) (#14509)
* SCAIl-2: support multiref
2026-06-17 16:21:23 +03:00
Jukka Seppänen fc964047e7 feat: Support text generation with Qwen3-VL (CORE-276) (#14298) 2026-06-17 08:12:44 +08:00
Jukka Seppänen b97e60fc6b Fix SCAIL-2 reference mask background convention (#14415) 2026-06-11 16:17:04 +08:00
Jukka Seppänen f8e51b674c feat: Add Bernini-R model support (Wan video) (CORE-279) (#14216) 2026-06-10 07:47:34 +08:00
Jukka Seppänen 184009c2f6 feat: Add model support for SCAIL-2 (#14373)
* initial SCAIL2 support
2026-06-09 18:24:09 +03:00
Jukka Seppänen 8ed7f458d0 Allow custom templates with Ideogram4 TE (#14374) 2026-06-09 21:11:05 +08:00
Jukka Seppänen fc258b10e5 Add Color primitive (#14260) 2026-06-09 00:30:28 +08:00
Jukka Seppänen 5aa71b9bc2 Enable cfg1 optimization for DualModelGuider with CFGGuider (#14290)
* Enable cfg1 optimization for DualModelGuider

* Fix CFG Override tooltip
2026-06-05 10:04:10 +03:00
Jukka Seppänen 24f9a020ce Support Ideogram4 (#14259) 2026-06-03 08:41:44 -07:00
Jukka Seppänen dc10c0133e PiD: Add SDXL and QwenImage (#14240) 2026-06-02 12:40:49 -07:00
Jukka Seppänen 462c27fdb2 feat: Add TripoSplat support (#14210) 2026-06-01 07:01:50 -07:00
Jukka Seppänen c37d2a0dac feat: Add gaussian splat nodes (#14190) 2026-05-31 11:47:29 -07:00
Jukka Seppänen 54d5be4a8e Fix background removal mask output shape (#14171) 2026-05-29 09:14:32 -07:00
Jukka Seppänen 987a937658 Support context window for PiD and fix lq_latent rounding (#14136) 2026-05-27 12:08:06 -07:00
Jukka Seppänen 28f4ef277c feat: Support NVIDIA PixelDiT and PiD (CORE-201) (#14103) 2026-05-26 17:50:14 -07:00
Jukka Seppänen f9f54cae42 Lens: some cleanup (#14112)
* Lens: remove redundant memory optimization
2026-05-26 10:32:53 +03:00
Jukka Seppänen 41812fa0ac feat: Microsoft Lens support (CORE-248) (#14077) 2026-05-25 23:01:51 -07:00
Jukka Seppänen 4d6a058bf1 feat: MediaPipe face detection (CORE-235) (#14009)
* Initial mediapipe face detection support

* Update face_geometry.py

* Account for diff sized batch input

* Model folder placeholder
2026-05-20 16:07:48 -07:00
Jukka Seppänen 971c9e3518 HiDream-O1: support area conditioning (#13944) 2026-05-18 01:17:05 -04:00
Jukka Seppänen b39af210d0 Fix Qwen3.5 text generation with multiple input images (#13943) 2026-05-18 01:16:42 -04:00
Jukka Seppänen 33ce449c8b Reduce LTX2.3 peak VRAM when guide_mask is in use (CORE-166) (#13735)
- Reduce peak VRAM by handling self_attn_mask more efficiently
- Fallback to SDPA when self_attention_mask is used
2026-05-16 00:02:27 +03:00
Jukka Seppänen 77e2ed5e01 feat: Support MoGe (CORE-168) (#13878) 2026-05-15 10:34:56 +08:00
Jukka Seppänen b2000029c8 Persists ModelNoiseScale when also patching shift (#13892) 2026-05-14 18:36:17 -07:00
Jukka Seppänen 1f28908d6e Make audio processing nodes handle None -inputs (#13879) 2026-05-14 10:51:35 +08:00
Jukka Seppänen 8505abf52e feat: Extend Save3D to save vertex colors and textures (CORE-189) (#13824)
Split GLB save logic out of nodes_hunyuan3d.py into a new nodes_save_3d.py, and extend the writer to support UVs, per-vertex colors, and embedded baseColor textures.

Extend the MESH type with optional uvs, vertex_colors, and texture fields so meshes can carry texture data through the graph.

Add pack_variable_mesh_batch / get_mesh_batch_item helpers and switch VoxelToMesh / VoxelToMeshBasic to use them so batches with differing vertex/face counts no longer fail at torch.stack.
2026-05-13 18:33:53 +03:00
Jukka Seppänen 8e53f001a4 feat: Support HiDream-O1-Image (CORE-187) (#13817)
* Initial HiDream01-image support

* Cleanup nodes

* Cleaner handling of empty placeholder models

* Remove snap_to_predefined, prefer tooltip for the trained resolutions

* Add model and block wrappers

* Fix shift tooltip

* Add node to work around the patch tile issue

Experimental, runs multiple passes with the patch grid offset and blends with various different methods.

* Qwen35 vision rotary_pos_emb cast fix

* Fix embedding layout type

* Some small optimizations

* Cleanup, don't need this fallback

* Prefix KV cache, cleanup

Bit of speed, reduce redundant code

* Get rid of redundant custom sampler, refactor noise scaling

Our existing lcm sampler is mathematically same, just added the missing options to it instead and a node to control them. Refactored the noise scaling and fix it for the stochastic samplers, add a generic node to control the initial noise scale.

* Update nodes_hidream_o1.py

* Fix some cache validation cases

* Keep existing sampling params

* Remove redundant video vision path

* Replace some numpy ops with torch

* Fx RoPE index for batch size > 1

* Prefer torch preprocessing

* Rename block_type to be compatible with existing patch nodes

* Fixes and tweaks
2026-05-11 20:35:53 -07:00
Jukka SeppänenandRattus 3200f28e3a Support Wan-Dancer (#13813)
* initial WanDancer support

* nodes_wandancer: Add list form of chunker.

Create an alternate list form of the node so the chunk gens can be
trivially looped by the comfy executor.

* Closer match to original soxr resampling

* Remove librosa node

* Cleanup

---------

Co-authored-by: Rattus <rattus128@gmail.com>
2026-05-09 14:02:56 -07:00
Jukka Seppänen 8dc3f3f209 Improve SAM3 large input handling (#13767) 2026-05-07 17:18:28 -07:00
Jukka Seppänen cd8c7a2306 Throttle dynamic VRAM prepare logging (#13704) 2026-05-07 10:41:13 +08:00
Jukka Seppänen c33d26c283 fix: Proper memory estimation for frame interpolation when not using dynamic VRAM (#13698) 2026-05-04 20:20:40 +03:00
Jukka Seppänen 025e6792ee Batch broadcasting in JoinImageWithAlpha node (#13686)
* Batch broadcasting in JoinImageWithAlpha node
2026-05-03 16:30:00 +03:00
Jukka Seppänen be95871adc feat: Gemma4 text generation support (CORE-30) (#13376)
* initial gemma4 support

* parity with reference implementation

outputs can 100% match transformers with same sdpa flags, checkpoint this and then optimize

* Cleanup, video fixes

* cleanup, enable fused rms norm by default

* update comment

* Cleanup

* Update sd.py

* Various fixes

* Add fp8 scaled embedding support

* small fixes

* Translate think tokens

* Fix image encoder attention mask type

So it works with basic attention

* Handle thinking tokens different only for Gemma4

* Code cleanup

* Update nodes_textgen.py

* Use embed scale class instead of buffer

Slight difference to HF, but technically more accurate and simpler code

* Default to fused rms_norm

* Update gemma4.py
2026-05-02 22:46:15 -04:00
Jukka Seppänen b5921c8ac2 SDPose: resize fix (#13656) 2026-05-01 14:17:25 -07:00
Jukka Seppänen 0e25a6936e Reduce video tiny VAE peak VRAM and decode time (CORE-127) (#13617)
* Update taehv.py

* Simplify

* Simplify pixel_unshuffle dispatch
2026-04-29 12:15:10 -07:00
Jukka Seppänen 084e08c6e2 Disable sageattention for SAM3 (#13529)
Causes Nans
2026-04-23 11:14:42 -07:00
Jukka Seppänen 6fbb6b6f49 Fix LTXV Reference Audio node (#13531) 2026-04-23 11:13:17 -07:00
Jukka Seppänen 749d5b4e8d feat: SAM (segment anything) 3.1 support (CORE-34) (#13408) 2026-04-23 00:07:43 -04:00
Jukka Seppänen db85cf03ff feat: RIFE and FILM frame interpolation model support (CORE-29) (#13258)
* initial RIFE support

* Also support FILM

* Better RAM usage, reduce FILM VRAM peak

* Add model folder placeholder

* Fix oom fallback frame loss

* Remove torch.compile for now

* Rename model input

* Shorter input type name

---------
2026-04-22 04:16:02 -07:00
Jukka Seppänen eb22225387 Support standalone LTXV audio VAEs (#13499) 2026-04-21 10:46:37 -07:00
Jukka Seppänen b9dedea57d feat: SUPIR model support (CORE-17) (#13250) 2026-04-18 23:02:01 -04:00
Jukka Seppänen a134423890 SDPose: resize input always (#13349) 2026-04-10 11:26:55 -10:00
Jukka Seppänen a500f1edac CORE-13 feat: Support RT-DETRv4 detection model (#12748) 2026-03-28 23:34:10 -04:00
Jukka Seppänen b0fd65e884 fix: regression in text generate with LTXAV model (#13170) 2026-03-26 09:55:05 -07:00
Jukka Seppänen 404d7b9978 feat: Support Qwen3.5 text generation models (#12771) 2026-03-25 22:48:28 -04:00
Jukka Seppänen e87858e974 feat: LTX2: Support reference audio (ID-LoRA) (#13111) 2026-03-23 18:22:24 -04:00
Jukka Seppänen fd0261d2bc Reduce tiled decode peak memory (#13050) 2026-03-19 13:29:34 -04:00
Jukka Seppänen 9fff091f35 Further Reduce LTX VAE decode peak RAM usage (#13052) 2026-03-18 18:32:26 -04:00
Jukka Seppänen 735a0465e5 Inplace VAE output processing to reduce peak RAM consumption. (#13028) 2026-03-17 20:20:49 -04:00
Jukka Seppänen 0904cc3fe5 LTXV: Accumulate VAE decode results on intermediate_device (#12955) 2026-03-14 18:09:09 -07:00
Jukka Seppänen 1c5db7397d feat: Support mxfp8 (#12907) 2026-03-14 18:36:29 -04:00
Jukka Seppänen 06f85e2c79 Fix text encoder lora loading for wrapped models (#12852) 2026-03-09 16:08:51 -04:00
Jukka Seppänen 8befce5c7b Add manual cast to LTX2 vocoder conv_transpose1d (#12795)
* Add manual cast to LTX2 vocoder

* Update vocoder.py
2026-03-05 12:37:25 -08:00
Jukka SeppänenandJedrzej Kosinski 0a7446ade4 Pass tokens when loading text gen model for text generation (#12755)
Co-authored-by: Jedrzej Kosinski <kosinkadink1@gmail.com>
2026-03-04 08:59:56 -08:00
Jukka Seppänen 1f6744162f feat: Support SCAIL WanVideo model (#12614) 2026-02-28 16:49:12 -05:00
Jukka Seppänen c7f7d52b68 feat: Support SDPose-OOD (#12661) 2026-02-26 19:59:05 -05:00
Jukka Seppänen 907e5dcbbf initial FlowRVS support (#12637) 2026-02-25 23:38:46 -05:00
Jukka Seppänen 6d11cc7354 feat: Add basic text generation support with native models, initially supporting Gemma3 (#12392) 2026-02-18 20:49:43 -05:00
Jukka Seppänen 5ff4fdedba Fix LazyCache (#12344) 2026-02-07 11:25:30 -08:00
Jukka Seppänen a1c101f861 EasyCache: Support LTX2 (#12231) 2026-02-06 00:43:09 -05:00
Jukka Seppänen ad53e78f11 Fix Noise_EmptyNoise when using nested latents (#12089) 2026-01-26 19:25:00 -05:00
Jukka Seppänen 55bd606e92 LTX2: Refactor forward function for better VRAM efficiency and fix spatial inpainting (#12046)
* Disable timestep embed compression when inpainting

Spatial inpainting not compatible with the compression

* Reduce crossattn peak VRAM

* LTX2: Refactor forward function for better VRAM efficiency
2026-01-23 15:26:38 -05:00
Jukka Seppänen 16b9aabd52 Support Multi/InfiniteTalk (#10179)
* re-init

* Update model_multitalk.py

* whitespace...

* Update model_multitalk.py

* remove print

* this is redundant

* remove import

* Restore preview functionality

* Move block_idx to transformer_options

* Remove LoopingSamplerCustomAdvanced

* Remove looping functionality, keep extension functionality

* Update model_multitalk.py

* Handle ref_attn_mask with separate patch to avoid having to always return q and k from self_attn

* Chunk attention map calculation for multiple speakers to reduce peak VRAM usage

* Update model_multitalk.py

* Add ModelPatch type back

* Fix for latest upstream

* Use DynamicCombo for cleaner node

Basically just so that single_speaker mode hides mask inputs and 2nd audio input

* Update nodes_wan.py
2026-01-21 23:09:48 -05:00
Jukka Seppänen 245f6139b6 More targeted embedding_connector loading for LTX2 text encoder (#11992)
Reduces errors
2026-01-21 23:05:06 -05:00
Jukka Seppänen 3365ad18a5 Support LTX2 tiny vae (taeltx_2) (#11929) 2026-01-21 23:03:51 -05:00