Georgi Gerganov a894dae939 metal : support arbitrary hc in dsv4_hc_pre (#29169) ...

the dsv4_hc_pre kernels hardcoded hc = 4 via a constexpr used with
simd_shuffle, so the op was rejected by supports_op for any other hc
and fell back to CPU. Kimi-K3 uses dsv4_hc_pre with hc equal to the
number of banked checkpoints in the cross-layer residual stack, which
grows with the layer index.

pass n_hc as a function constant (FC_DSV4_HC) with per-n_hc pipeline
variants, and loop over it in both pre kernels with direct loads

add test-backend-ops cases for hc = 1, 2, 3, 5, 8 and 65, gated and
not gated

Assisted-by: pi:llama.cpp/Qwen3.8-27B

2026-09-20 17:52:20 +03:00

..

cmake

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079)

2026-09-09 12:50:08 +02:00

include

[SYCL] Fix function signature for ggml_backend_sycl_split_buffer_type (#28981)

2026-09-16 22:15:47 -04:00

src

metal : support arbitrary hc in dsv4_hc_pre (#29169)

2026-09-20 17:52:20 +03:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

ggml : bump version to 0.24.0 (ggml/1627)

2026-09-14 16:45:33 +03:00