Jeff Bolz 86cb5ab93f vulkan: Reduce temporary memory usage for TOP_K (llama/17623) ...

- Compute row size for the temp buffer based on the output of the first pass.
- Update shader addressing math to use the output row size
- Pass the output row size as "ncols_output", what used to be "ncols_output" is now "k"

For the common case of K=40 and src0=(200000,1,1,1), this reduces the temporary buffer
from about 3.2MB to 500KB.

2025-12-12 17:53:15 +02:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094)

2025-08-18 20:30:45 +03:00

include

model: LFM2-VL fixes (llama/17577)

2025-12-12 17:53:14 +02:00

src

vulkan: Reduce temporary memory usage for TOP_K (llama/17623)

2025-12-12 17:53:15 +02:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

cmake : add utf8 compilation options for msvc (llama/17682)

2025-12-12 17:53:15 +02:00