llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-10-02 10:57:33 -05:00

Files

T

Georgi Gerganov 1777b02be1 rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs

GGML_RPC_DEBUG is now parsed as a number: 0/unset disables debug logs,
1-3 emit increasingly detailed output (events, per-command trace,
transport detail). Non-numeric values fall back to 1.

The duplicated env/macro blocks in ggml-rpc.cpp and transport.cpp are
replaced by a shared log.h, which becomes the single choke point for
all logging of the RPC backend: LOG_ERROR/LOG_WARN/LOG_INFO for
unconditional severity logs and LOG_DBG/LOG_DBG2/LOG_DBG3 for the
verbosity-gated ones. The transport files no longer need ggml-impl.h,
and the server banner now also goes through the ggml logger (stderr).

Missing logs are added on both the client (handshake, buffer ops,
tensor transfers, graph computes, cache decisions) and the server
(per-command dispatch, graph nodes), including the negotiated
transport via the new socket_t::transport_name().

Assisted-by: pi:llama.cpp/MiMo-V2.6-Flash-RL

2026-09-27 23:00:44 +03:00

batched-bench

cmake : add install() for impl libraries + fix apple builds (#23511 )

2026-05-22 11:46:26 +03:00

cli

args: add env vars for temperature, top-p, min-p and penalties (#27380 )

2026-09-21 12:47:38 +02:00

completion

args: add env vars for temperature, top-p, min-p and penalties (#27380 )

2026-09-21 12:47:38 +02:00

cvector-generator

cmake : introduce semantic versioning (#26839 )