llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-25 20:21:03 -05:00

Files

Zach Winter 555881ebc8 ui: reduce per-token render cost when streaming (#26053 )

* performance harness - the empirical root

Assisted-by: Claude Opus 4.8

* 210.36ms -> 2.67ms per streamed token

Assisted-by: Claude Opus 4.8

* 11.58ms -> 0.62ms per streamed token

Assisted-by: Claude Opus 4.8

* 22.02ms -> 3.33ms per streamed token

Assisted-by: Claude Opus 4.8

* 3.07ms -> 1.36ms per streamed token at 40 messages

Assisted-by: Claude Opus 4.8

---------

Co-authored-by: Zach Winter <dmtommy@icloud.com>

2026-07-24 22:09:46 +02:00

agentic-perf-state.svelte.ts

ui: reduce per-token render cost when streaming (#26053 )

2026-07-24 22:09:46 +02:00

AgenticPerfWrapper.svelte

ui: reduce per-token render cost when streaming (#26053 )

2026-07-24 22:09:46 +02:00

ChatMessagesPerfWrapper.svelte

ui: reduce per-token render cost when streaming (#26053 )

2026-07-24 22:09:46 +02:00

CollapsibleLazyBodyHarness.svelte

ui: reduce per-token render cost when streaming (#26053 )