upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-27 21:21:02 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 31d0ff1869 server / ranking : add sorting and management of top_n (#16403) b6733 Yann Follet 2025-10-11 21:39:04 +08:00
  • 97870e6497 cuda : avoid initializing unused devices (#16510) b6732 Diego Devesa 2025-10-11 04:02:26 -07:00
  • 477a66b035 convert : correctly handle LLaMA tokenizer for Jamba (#16470) amirai21 2025-10-11 11:33:41 +03:00
  • e60f01d941 server : fix division by zero when reporting stats (#16501) b6730 Georgi Gerganov 2025-10-10 22:15:05 +03:00
  • 81086cd6a3 vocab : mark EOT token for Granite models (#16499) b6729 Georgi Gerganov 2025-10-10 17:17:31 +03:00
  • 68ee98ae18 server : return HTTP 400 if prompt exceeds context length (#16486) b6728 Radoslav Gerganov 2025-10-10 17:11:07 +03:00
  • cdb6da468c server : log requests to /v1/completions (#16495) b6727 Radoslav Gerganov 2025-10-10 13:22:27 +03:00
  • 6d69ab3f26 cmake : Dont define XOPENSOURCE on AIX (#16481) b6726 Prajwal B Mehendarkar 2025-10-10 13:45:46 +05:30
  • 1faa13a118 webui: updated the chat service to only include max_tokens in the req… (#16489) b6725 Pascal 2025-10-09 22:54:57 +02:00
  • 1deee0f8d4 cpu : optimize the ggml NORM operation (#15953) b6724 duduta 2025-10-09 22:11:15 +03:00
  • d00cbea63c server : host-memory prompt caching (#16391) Georgi Gerganov 2025-10-09 18:54:51 +03:00
  • 8328fd4bae No markdown in cot (#16483) Pascal 2025-10-09 17:36:29 +02:00
  • 56b4795842 model-conversion : add support for SentenceTransformers (#16387) b6721 Daniel Bevenius 2025-10-09 14:35:22 +02:00
  • 2c0d875ae6 ci: add ARM64 Kleidiai build and test support (#16462) sudhiarm 2025-10-09 09:13:18 +01:00
  • aa4711d369 CANN: Improve ACL graph matching (#16166) b6719 Chenguang Li 2025-10-09 15:50:25 +08:00
  • d80d6d2400 kleidiai: kernel interface refactoring (#16460) b6718 Charles Xu 2025-10-09 09:29:17 +02:00
  • b260213755 [SYCL] refactor soft_max, add soft_max_back (#16472) b6717 Neo Zhang Jianyu 2025-10-09 15:25:11 +08:00
  • e08db42595 model: EmbeddingGemma Adding Support for SentenceTransformers Dense Modules (#16367) Saba Fallah 2025-10-09 08:39:18 +02:00
  • 12bbc3fa50 refactor: centralize CoT parsing in backend for streaming mode (#16394) b6715 Pascal 2025-10-08 22:18:41 +02:00
  • 9d0882840e Disable CUDA host buffers on integrated GPUs (#16308) b6714 ai-fonsi 2025-10-08 20:21:46 +02:00
  • d2ee056e1d server : fix cancel pending task (#16467) b6713 issixx 2025-10-08 17:20:18 +09:00
  • b2c08c9ec4 metal : mark FA blocks (#16372) Georgi Gerganov 2025-10-08 10:57:53 +03:00
  • 7fdd16b432 server : improve context checkpoint logic (#16440) b6711 Georgi Gerganov 2025-10-08 10:57:29 +03:00
  • 74b8fc17f9 ggml webgpu: profiling, CI updates, reworking of command submission (#16452) b6710 Reese Levine 2025-10-07 13:48:56 -07:00
  • aeaf8a36f0 llama : support LiquidAI LFM2-MoE hybrid model (#16464) b6709 Tarek Dakhran 2025-10-07 20:03:35 +02:00
  • df1b612e29 server : add /v1/health endpoint (#16461) b6708 Georgi Gerganov 2025-10-07 15:57:14 +03:00
  • 4e0388aa8a webui : added download action (#13552) (#16282) Sascha Rogmann 2025-10-07 11:11:08 +02:00
  • ef4c5b87ea presets : fix pooling param for embedding models (#16455) b6706 Georgi Gerganov 2025-10-07 10:32:32 +03:00
  • c61ae20d05 rpc : update documentation (#16441) Radoslav Gerganov 2025-10-07 09:59:13 +03:00
  • 0123ff38f5 memory : use sequential equal splits for recurrent modules (#16442) b6704 Georgi Gerganov 2025-10-07 08:24:17 +03:00
  • 0a319bb75e metal : add support for non-padded FA KV (#16148) b6703 Georgi Gerganov 2025-10-07 08:23:30 +03:00
  • 1d6092fc72 tests : add -INF blocks to the KQ mask in the FA tests (#16380) b6702 Georgi Gerganov 2025-10-07 08:22:35 +03:00
  • 8ae32dc9ec metal : various optimizations + refactoring (#16446) b6701 Georgi Gerganov 2025-10-07 08:21:40 +03:00
  • 3df2244df4 llama : add --no-host to disable host buffers (#16310) b6700 Gadflyii 2025-10-06 12:55:53 -05:00
  • c08002a198 chat : Granite Docling stopping (#16438) b6699 Gabe Goodhart 2025-10-06 10:59:40 -06:00
  • 3a002afafa ci : refactor sdk caching to minimize storage (#16414) Sigbjørn Skjæret 2025-10-06 17:40:21 +02:00
  • a23b9bdbd3 ggml : fix unaligned access in AMX code (#16315) b6697 Georgi Gerganov 2025-10-06 16:05:27 +03:00
  • 04e632a4aa ci : remove missing reranker model files (#16444) Daniel Bevenius 2025-10-06 14:56:59 +02:00
  • a80ff183ab ggml-cpu : fix leftover handling in ggml_vec_scale_f32 for SVE (#16443) b6695 Daniel Bevenius 2025-10-06 14:17:12 +02:00
  • 1d49ca3759 nix : removed metal for nix (#16118) Yuannan 2025-10-06 09:29:56 +00:00
  • c5fef0fcea server: update readme to mention n_past_max metric (#16436) Oleksandr Kuvshynov 2025-10-06 03:53:31 -04:00
  • ca71fb9b36 model : Granite docling + Idefics3 preprocessing (SmolVLM) (#16206) b6692 Gabe Goodhart 2025-10-05 06:57:47 -06:00
  • 35266573b9 ggml webgpu: actually add softmax, fix rms_norm offset (#16400) b6691 Reese Levine 2025-10-04 20:59:31 -07:00
  • 86df2c9ae4 vulkan: use a more appropriate amount of threads when generating shaders (#16418) b6690 Eve 2025-10-04 20:04:27 +00:00
  • f39283960b rpc : check src buffer when copying tensor (#16421) b6689 Radoslav Gerganov 2025-10-04 16:22:45 +03:00
  • 898acba681 rpc : add support for multiple devices (#16276) b6688 Radoslav Gerganov 2025-10-04 12:49:16 +03:00
  • e29acf74fe vulkan : incremental shader builds (#16341) b6687 Acly 2025-10-04 11:42:56 +02:00
  • 128d522c04 chat : support Magistral thinking (#16413) b6686 Pascal 2025-10-03 20:51:48 +02:00
  • f6dcda3900 server : context checkpointing for hybrid and recurrent models (#16382) b6685 ddh0 2025-10-03 13:34:51 -05:00
  • 606a73f531 metal : fix loop bound in ggml_mem_ranges (#16412) b6684 Georgi Gerganov 2025-10-03 19:18:56 +03:00
  • 946f71ed9a llama : fix shapes for bert/mpt q/k norm (#16409) b6683 Sigbjørn Skjæret 2025-10-03 14:40:25 +02:00
  • 638d330246 ggml : fix graph reallocation with multiple chunks (#16396) b6682 Acly 2025-10-03 13:49:08 +02:00
  • 84c8e305e8 Fix missing messages on sibling navigation (#16408) Aleksander Grygier 2025-10-03 12:51:40 +02:00
  • 2aaf0a2a20 vulkan: Replace uses of maxMemoryAllocationSize and VK_WHOLE_SIZE (#16354) b6680 Jeff Bolz 2025-10-03 05:50:46 -05:00
  • 0e1f838556 vulkan: Fix FA coopmat1 invalid array indexing (#16365) b6679 Jeff Bolz 2025-10-03 04:52:46 -05:00
  • ad126479c2 ci : change macos-13 to macos-15-intel (#16401) b6678 Daniel Bevenius 2025-10-03 11:45:16 +02:00
  • 77233277c9 Capture model name only after first token (streaming) or completed request (#16405) Aleksander Grygier 2025-10-03 11:30:39 +02:00
  • e308efda8e vulkan: in flash attention, bounds check against nem1 (don't rely on GGML_KQ_MASK_PAD) (#16316) b6676 Jeff Bolz 2025-10-03 03:33:08 -05:00
  • 136bda78c5 webui : Fix messages payload sent to chat completions (#16402) Aleksander Grygier 2025-10-03 09:11:34 +02:00
  • 5113efd34c fix: track viewportHeight via window.innerHeight to avoid unwanted scrolling (#16356) Pascal 2025-10-03 08:01:31 +02:00
  • d64c8104f0 test-barrier : do not use more threads than physically available (#16389) b6673 Sigbjørn Skjæret 2025-10-02 20:10:12 +02:00
  • ef07a40906 ggml webgpu: add support for soft_max, optimize rms_norm (#16357) b6672 Reese Levine 2025-10-02 11:00:31 -07:00
  • 34fcc5a4ac model : Apertus model implementation (#15852) b6671 Piotr Wilkin (ilintar) 2025-10-02 19:43:22 +02:00
  • 91a2a56556 musa: update compile flags (#16265) b6670 R0CKSTAR 2025-10-02 21:29:56 +08:00
  • 72ee736c44 ci : fix ubuntu-latest-cmake-rpc (disable ccache) (#16388) Sigbjørn Skjæret 2025-10-02 13:51:36 +02:00
  • f09aefaa84 ci: update vulkan ci (#16294) Eve 2025-10-02 08:10:07 +00:00
  • bbd32bc038 ci : fix clean-up of old logs (#16381) Georgi Gerganov 2025-10-02 10:35:43 +03:00
  • 2be72c2b12 SYCL: Update to oneAPI 2025.2 (#16371) b6666 Neo Zhang Jianyu 2025-10-02 15:16:25 +08:00
  • 95ce098544 HIP: add IMbackK to codeowner (#16375) b6665 uvos 2025-10-02 05:52:59 +02:00
  • c8dedc9999 CI: reenable cdna in rocm docker builds (#16376) uvos 2025-10-01 23:32:39 +02:00
  • e95fec640f HIP: Disable ROCWMMA fattn on CDNA when compiled against ROCWMMA 2.0.0 (#16221) b6663 uvos 2025-10-01 23:09:25 +02:00
  • ded67b9444 llama : parameter conversion and loading fixes for PLaMo2 variants (#16075) b6662 Shunta Saito 2025-10-02 06:08:15 +09:00
  • 1fe4e38cc2 ci: Properly install rocwmma for hip builds (#16305) b6661 uvos 2025-10-01 20:18:03 +02:00
  • 4201deae9c common: introduce http.h for httplib-based client (#16373) b6660 Adrien Gallouët 2025-10-01 19:22:18 +02:00
  • 764799279f Conversation action dialogs as singletons from Chat Sidebar + apply conditional rendering for Actions Dropdown for Chat Conversation Items (#16369) Aleksander Grygier 2025-10-01 18:18:10 +02:00
  • 2a9b63383a Improve code block color theming (#16325) Aleksander Grygier 2025-10-01 15:54:42 +02:00
  • 1104ca1a1c ci : use registry cache for docker builds (#16366) Sigbjørn Skjæret 2025-10-01 14:09:52 +02:00
  • 4f1575921c Add optional setting for showing "Model used:" information (#16337) Aleksander Grygier 2025-10-01 12:08:16 +02:00
  • 132d673554 vulkan: make ggml_vk_default_dispatcher support older vulkan headers (#16345) Eve 2025-10-01 07:56:36 +00:00
  • aa9538a63a webui: Remove running llama-server within WebUI dev.sh script (#16363) Aleksander Grygier 2025-10-01 07:40:26 +02:00
  • e74c92e842 model : support GLM 4.6 (make a few NextN/MTP tensors not required) (#16359) b6653 Bartowski 2025-09-30 16:24:36 -04:00
  • b2ba81dbe0 ci : fix ccache key for ubuntu-cpu-cmake (#16355) Sigbjørn Skjæret 2025-09-30 21:41:42 +02:00
  • bf6f3b3a19 common : disable progress bar without a tty (#16352) b6651 Adrien Gallouët 2025-09-30 19:52:41 +02:00
  • 7c156df414 opencl: support pad_ext (#15888) b6650 lhez 2025-09-30 10:45:45 -07:00
  • 16b0ca0d2e Chatapi ignore empty sampling (#16330) Pascal 2025-09-30 19:18:54 +02:00
  • 8d78cd2613 ggml webgpu: support for rope,div,sub,glu,scale,cont operators (#16187) b6648 Reese Levine 2025-09-30 09:57:51 -07:00
  • d1c84a662d opencl: support ne3 in get_rows (#15866) b6647 lhez 2025-09-30 09:55:13 -07:00
  • 364a7a6d4a common : remove common_has_curl() (#16351) b6646 Adrien Gallouët 2025-09-30 16:39:44 +02:00
  • 2df5bcf357 ci : disable ccache for android (#16348) Sigbjørn Skjæret 2025-09-30 15:38:01 +02:00
  • 075c01567b ggml : bump version to 0.9.4 (ggml/1363) b6644 Georgi Gerganov 2025-09-30 13:42:39 +03:00
  • a014310374 cuda : Enable CUDA Graph usage for Nemotron Nano v2 (NemotronH) (#16328) b6643 anavp-nvidia 2025-09-30 08:13:22 +00:00
  • 35fb82497e metal : dynamic simdgroups for MV kernels (#16340) b6642 Georgi Gerganov 2025-09-30 11:03:23 +03:00
  • 3c62aed89f common : simplify etag tracking by removing json (#16342) b6641 Adrien Gallouët 2025-09-30 09:36:33 +02:00
  • f1eb1cb1eb kleidiai : fix work size and threads sync for fp16 (#16246) b6640 Charles Xu 2025-09-30 09:07:20 +02:00
  • de41f2b7bf codeowners: add codeowners for opencl backend (#16344) lhez 2025-09-29 22:30:16 -07:00
  • a74a0d69f3 tests: override test_set_rows::max_nmse_err to allow for occasional rounding differences (#16295) b6638 Jeff Bolz 2025-09-29 19:26:34 -05:00
  • 5f7e166cbf Fix thinking blocks with quotes + add handling [THINK]...[/THINK] blocks (#16326) Pascal 2025-09-29 18:49:47 +02:00
  • d72f5f7ba2 ci : add AMD runners and workflows (#16249) Georgi Gerganov 2025-09-29 17:51:48 +03:00
  • b77e6c18e1 ggml: riscv: add riscv spacemit backend (#15288) b6635 alex-spacemit 2025-09-29 22:50:44 +08:00
  • 2ddd3f2356 sync : ggml b6634 Georgi Gerganov 2025-09-29 16:50:52 +03:00