ynankaniandJohannes Gäßler b56f34ab13 CUDA: Handle compute type for NVFP4 on cublass path (#29173) ...

* CUDA: Handle compute type for NVFP4 on cublass path

Signed-off-by: ynankani <ynankani@nvidia.com>

* Use BF16 compute type for quantized models if HW allows

Signed-off-by: ynankani <ynankani@nvidia.com>

* Set acc prec to bf16 for nvfp4 as it needs atleast bf16 range

Signed-off-by: ynankani <ynankani@nvidia.com>

* Update ggml/src/ggml-cuda/ggml-cuda.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* preserve op_params for per-expert matmul

Signed-off-by: ynankani <ynankani@nvidia.com>

---------

Signed-off-by: ynankani <ynankani@nvidia.com>
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

2026-10-01 16:53:52 +05:30

..

cmake

Enables Windows ARM64 build with MSVC cl.exe (#28362)

2026-09-28 10:07:27 +02:00

include

ci: add zdnn backend build but not test (#29541)

2026-09-29 20:45:14 +03:00

src

CUDA: Handle compute type for NVFP4 on cublass path (#29173)

2026-10-01 16:53:52 +05:30

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

CUDA: Make CCCL configurable + pin it to 3.4.3 for CI jobs (#29792)

2026-10-01 13:05:29 +02:00