upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-29 06:00:58 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
b8832
llama.cpp/ggml
History
Aman Gupta b94050e896 CUDA: use LRU based eviction for cuda graphs (#21611) 
* CUDA: use a ring-buffer for cuda graphs

* bump limit to 128

* use LRU eviction

* better naming

* do periodic clean-up
2026-04-17 23:24:21 +08:00
..
cmake
ggml: backend-agnostic tensor parallelism (experimental) (#19378)
2026-04-09 16:42:19 +02:00
include
CUDA: manage NCCL communicators in context (#21891)
2026-04-15 15:58:40 +02:00
src
CUDA: use LRU based eviction for cuda graphs (#21611)
2026-04-17 23:24:21 +08:00
.gitignore
vulkan : cmake integration (#8119)
2024-07-13 18:12:39 +02:00
CMakeLists.txt
[SYCL] Fix Q8_0 reorder: garbage on 2nd prompt + crash on full VRAM (#21638)
2026-04-16 08:34:05 +03:00