upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-23 11:10:55 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
c0bc8591e8815c63cb01dd3f051a8b0df02501c9
llama.cpp/tools/server/server-task.cpp
Georgi Gerganov bf2c86ddc0 server : refactor prompt cache state ownership (#25649) 
* server : clear checkpoints upon prompt clear

* server : move the prompt state data to the server_prompt_cache

Assisted-by: pi:llama.cpp/Qwen3.6-27B

* server : handle batched slot being cleared
2026-07-14 18:25:52 +03:00

63 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink