upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-30 09:57:38 -05:00
Code Issues Packages Projects Releases Wiki Activity

Add FP8 KV-cache support

Browse Source
This commit is contained in:
Oliver Simons
2026-09-04 20:51:13 +02:00
parent cef6c528f8
commit b6ccff9b0e
10 changed files with 146 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
common/arg.cpp
+1
View File
@@ -305,6 +305,7 @@ const std::vector<ggml_type> kv_cache_types = {
GGML_TYPE_F32,
GGML_TYPE_F16,
GGML_TYPE_BF16,
GGML_TYPE_F8_E4M3,
GGML_TYPE_Q8_0,
GGML_TYPE_Q4_0,
GGML_TYPE_Q4_1,