Files
llama.cpp/tools/results
Xuan-Son Nguyen 60e9cf7a7b batch: migrate the rest of examples to llama_batch_ext (#29601)
* migrate the rest

* test-thread-safety

* rm common_batch_staged
2026-09-30 18:08:43 +02:00
..
2026-03-08 12:30:21 +01:00

Results

The llama-results tool can be used to --check the outputs of a model vs. a previous commit to detect whether they have changed. Example usage:

llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed."  # writes results to file
llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." --check  # compares results vs file

The metric by which the results are compared is the normalized mean squared error (NMSE) with a tolerance of 10^{-6}.