upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-26 12:40:58 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
master-0b366e7
llama.cpp/utils.cpp
Erik Scholz 0b366e7357 Command line switch to use F16 for memory_k and memory_v (refactor of #154) (#294) 
* Use F16 for memory_k and memory_v

* add command line switch to use f16 instead of f32 for memory k+v

---------

Co-authored-by: Ty Everett <ty@tyweb.us>
2023-03-19 19:57:00 +02:00

20 KiB
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink