upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-28 13:41:01 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 828e5d2fcd tests : add ggml_set_rows Georgi Gerganov 2025-06-22 18:45:30 +03:00
  • e73690a69d ggml : ggml_set_rows update comment + better index name Georgi Gerganov 2025-06-22 18:45:07 +03:00
  • e89709721b ggml : support GGML_TYPE_F32 ".from_float" trait Georgi Gerganov 2025-06-22 18:44:42 +03:00
  • 630c84a2bd ggml : ggml_set_rows support quantized dst Georgi Gerganov 2025-06-22 11:10:42 +03:00
  • df71c803b4 ggml : ggml_set_rows support broadcast Georgi Gerganov 2025-06-22 10:28:07 +03:00
  • 313a444b22 ggml : add ggml_is_contiguous_rows Georgi Gerganov 2025-06-22 10:27:31 +03:00
  • 695b6b7025 ggml : add repeat impl for i64 Georgi Gerganov 2025-06-21 09:07:25 +03:00
  • f2cd962fe2 use I64 for indices Radoslav Gerganov 2025-06-20 11:37:43 +03:00
  • c1a581a10b ggml : add ggml_set_rows Radoslav Gerganov 2025-06-19 11:04:23 +03:00
  • 7b50d589a8 kv-cells : fix tracking of seq_pos (#14339) b5742 Georgi Gerganov 2025-06-23 12:27:35 +03:00
  • 3a9457df96 vulkan: update windows SDK in CI (#14334) Jeff Bolz 2025-06-23 03:19:24 -05:00
  • fa4a9f2a1c quantize : handle user-defined pruning of whole layers (blocks) (#13037) b5740 Ed Addario 2025-06-22 22:16:26 +01:00
  • 238005c2dc gguf-py : fix SpecialVocab parsing when post_processor is null (#14330) Sigbjørn Skjæret 2025-06-22 19:46:17 +02:00
  • 66aba7aca9 run : avoid double tokenization (#14327) b5738 Ruikai Peng 2025-06-23 01:28:06 +08:00
  • f1f5e82df6 examples : fix is_first logic for tokenization (#14329) b5737 Georgi Gerganov 2025-06-22 20:10:07 +03:00
  • af3373f1ad HIP: enable vec fattn on RDNA4 (#14323) b5736 uvos 2025-06-22 16:51:23 +02:00
  • 5d5c066de8 mtmd : fix Pixtral OOM with large images by capping image_size to 1024 (#14326) b5735 yuiseki 2025-06-22 21:44:57 +09:00
  • 40bfa04c95 common : use std::string_view now that we target c++17 (#14319) b5734 Sigbjørn Skjæret 2025-06-22 07:37:43 +02:00
  • aa064b2eb7 CUDA: add mean operation (#14313) b5733 Aman Gupta 2025-06-22 12:39:54 +08:00
  • aa0ef5c578 gguf-py : fix Qwen3-Embedding eos token (#14314) Sigbjørn Skjæret 2025-06-21 18:12:05 +02:00
  • bb16041cae Add support for VK_EXT_debug_utils to add labels to Vulkan objects. (#13792) b5731 Markus Tavenrath 2025-06-21 08:17:12 +02:00
  • 58cba76a9a gguf-py : fix TemplateProcessing pair when bos/eos is missing (#14312) Sigbjørn Skjæret 2025-06-21 07:33:21 +02:00
  • 67ae5312e2 metal : fix thread-safety (#14300) b5729 Georgi Gerganov 2025-06-21 08:04:18 +03:00
  • 692e3cdd0a memory : rename interface to llama_memory_context_i (#14296) b5728 Georgi Gerganov 2025-06-21 08:03:46 +03:00
  • b23fa0b3f4 convert : fix Llama 4 conversion (#14311) Daniel Han 2025-06-20 21:32:01 -07:00
  • 06cbedfca1 sync : ggml b5726 Georgi Gerganov 2025-06-20 20:50:24 +03:00
  • b7147673f2 Add ggml_roll (ggml/1274) Acly 2025-06-18 13:34:50 +02:00
  • d860dd99a4 docs : fix the link to llama.h (#14293) David Chiu 2025-06-21 01:43:35 +08:00
  • c959f462a0 CUDA: add conv_2d_transpose (#14287) b5723 Aman Gupta 2025-06-20 22:48:24 +08:00
  • 22015b2092 lint : remove trailing whitepace (#14304) b5722 Sigbjørn Skjæret 2025-06-20 16:37:44 +02:00
  • dd6e6d0b6a vocab : prevent tokenizer overflow (#14301) b5721 Ruikai Peng 2025-06-20 22:13:06 +08:00
  • ae96333923 metal : fix thread-safety gg/metal-fix-thread-safety Georgi Gerganov 2025-06-20 16:42:54 +03:00
  • 8308f98c7f sycl: add usage of enqueue_functions extension (#14244) b5720 Nicolò Scipione 2025-06-20 15:07:21 +02:00
  • 6369be0735 Implement GGML_CPU_ALL_VARIANTS for PowerPC (#14286) b5719 Christian Kastner 2025-06-20 12:17:32 +00:00
  • 88fc854b4b llama : improve sep token handling (#14272) b5718 Sigbjørn Skjæret 2025-06-20 14:04:09 +02:00
  • e28c1b93fd cuda : synchronize graph capture and cublas handle destruction (#14288) b5717 Diego Devesa 2025-06-20 04:57:36 -07:00
  • d27b3ca175 ggml : fix repack work size for mul_mat_id (#14292) b5716 Georgi Gerganov 2025-06-20 11:19:15 +03:00
  • 9230dbe2c7 ggml: Update KleidiAI to v1.9.0 (#14277) b5715 Charles Xu 2025-06-20 09:51:01 +02:00
  • 812939a9e9 model : more uniform output id handling (#14275) b5714 Georgi Gerganov 2025-06-20 10:50:27 +03:00
  • 6fb2f2e8a9 ggml : fix repack work size for mul_mat_id gg/repack-fix-wsize Georgi Gerganov 2025-06-20 10:34:16 +03:00
  • 4c9fdfbe15 ubatch : new splitting logic (#14217) b5713 Georgi Gerganov 2025-06-20 10:14:14 +03:00
  • 9eaa51e7f0 CUDA: add conv_2d_dw (#14265) b5712 Aman Gupta 2025-06-20 09:50:24 +08:00
  • 8f71d0f3e8 ggml-cpu : remove unnecesary arm feature detection (#14281) b5711 Diego Devesa 2025-06-19 12:24:14 -07:00
  • 6201b43814 Update the graph. Vaibhavs10 2025-06-19 17:13:28 +02:00
  • 381174bbda gguf-py : make sentencepiece optional (#14200) gguf-v0.17.1 Alex Trotta 2025-06-19 09:56:12 -04:00
  • d67341dc18 server : add server parameters for draft model cache type (#13782) b5709 aa956 2025-06-19 16:01:03 +03:00
  • 456af35eb7 build : suppress gcc15 compile warnings (#14261) b5708 fanyang 2025-06-19 20:49:48 +08:00
  • 600e3e9b50 sycl: Cleanup codepaths in Get Rows in sycl backend (#14215) b5707 Anton Mitkov 2025-06-19 11:40:21 +01:00
  • fffcce535e llama-bench : add --no-warmup flag (#14224) (#14270) b5706 bashayer hijji 2025-06-19 13:24:12 +03:00
  • 5fc7856815 convert : fix remote option in Windows (#14100) pqnet 2025-06-19 12:21:40 +02:00
  • faed5a5f5d llamafile : support s390x SIMD instruction set (#14273) b5704 Aaron Teo 2025-06-19 17:48:54 +08:00
  • 10bb545c5b Vulkan: Set device max size for host memory to avoid OOM warning and fallback to CPU buffer (#14249) b5703 0cc4m 2025-06-19 09:15:42 +02:00
  • 830e5542c2 Merge branch 'master' into compilade/mamba2 Francis Couture-Harpin 2025-06-19 02:44:45 -04:00
  • f8c7caeeb7 cuda : implement ssm scan for Mamba2 Francis Couture-Harpin 2025-05-15 18:09:53 -04:00
  • edc4a29eff memory : Hybrid recurrent cache (#13979) b5702 Gabe Goodhart 2025-06-19 00:08:14 -05:00
  • ed3290ab34 metal : add mean kernel (#14267) b5701 Georgi Gerganov 2025-06-19 08:05:21 +03:00
  • a42f239418 Merge branch 'master' into compilade/mamba2 Francis Couture-Harpin 2025-06-18 23:59:21 -04:00
  • 1a9454a3d2 imatrix : avoid returning from void function save_imatrix Francis Couture-Harpin 2025-06-18 16:44:41 -04:00
  • ba6f6be6ce imatrix : don't use FMA explicitly Francis Couture-Harpin 2025-06-18 16:33:37 -04:00
  • 2c0945027a Merge branch 'master' into compilade/imatrix-batched-chunks Francis Couture-Harpin 2025-06-18 16:32:35 -04:00
  • ccb2bb9988 test-model-random : show max error Francis Couture-Harpin 2025-06-18 15:11:23 -04:00
  • 9d873d7543 test-model-random : shuffle across sequences but not within Francis Couture-Harpin 2025-06-18 15:07:24 -04:00
  • 8d94713654 docs: add s390x build documentation (#14264) Aaron Teo 2025-06-19 01:10:26 +08:00
  • 50d2227953 ggml-cpu: reduce asm calls for hsum (#14037) b5699 Aaron Teo 2025-06-19 01:10:08 +08:00
  • 6231c5cd6d ggml-cpu: fix uncaught underscore terminators (#14023) b5698 Aaron Teo 2025-06-19 01:06:49 +08:00
  • ef035803eb ggml: Add Apple support for GGML_CPU_ALL_VARIANTS (#14258) b5697 Charles Xu 2025-06-18 13:40:07 +02:00
  • 413977de32 mtmd : refactor llava-uhd preprocessing logic (#14247) b5696 Xuan-Son Nguyen 2025-06-18 10:43:57 +02:00
  • 95402553a5 llama-chat : fix multiple system message for gemma, orion (#14246) b5695 Xuan-Son Nguyen 2025-06-18 09:58:43 +02:00
  • 3865cff4f5 convert : fix null head_dim AutoConfig regression (#14248) Sigbjørn Skjæret 2025-06-18 09:52:07 +02:00
  • d03172cc79 sync : ggml b5693 Georgi Gerganov 2025-06-18 09:58:23 +03:00
  • dd8e59f443 ggml : disable warnings for tests when using MSVC (ggml/1273) Daniel Bevenius 2025-06-13 15:06:42 +02:00
  • bbe98d2784 ggml : remove unused ggml_context_container (ggml/1272) Daniel Bevenius 2025-06-13 09:05:44 +02:00
  • c2056ed6d4 examples : include examples in msvc disable warn (ggml/1270) Daniel Bevenius 2025-06-12 12:27:09 +02:00
  • 59fee24c72 recurrent : rework graph inputs + add TODOs gabe-l-hart/HybridRecurrentCache Georgi Gerganov 2025-06-18 09:29:51 +03:00
  • faf41199c0 refactor: Use a common build_recurrent_state method that is cache-agnostic Gabe Goodhart 2025-06-16 15:17:28 -06:00
  • 5046d412ef fix: Fix initialization of child states Gabe Goodhart 2025-06-16 13:48:20 -06:00
  • 9db44a2a63 fix: Fix resize vs reserve and skip null tensors in size computation Gabe Goodhart 2025-06-16 13:34:25 -06:00
  • 11cd80d5de feat: Overhaul build_recurrent_state / build_inp_s_copy to match attention pattern Gabe Goodhart 2025-06-12 17:04:27 -06:00
  • 4ec4e6a801 refactor: Use llama_memory_state_ptr for child states in hybrid memory state Gabe Goodhart 2025-06-12 14:30:21 -06:00
  • 7ba463b38c fix: Remove llama_model_is_hybrid_Recurrent public API Gabe Goodhart 2025-06-12 14:01:28 -06:00
  • 1510016ea4 fix: Remove logits_all after rebase Gabe Goodhart 2025-06-12 14:00:53 -06:00
  • d8c929ff5d feat: Allow custom layer filters for hybrid recurrent Gabe Goodhart 2025-06-11 13:41:52 -06:00
  • d5d7628b5f refactor: Remove n_embd_k/v_gqa from recurrent cache Gabe Goodhart 2025-06-11 12:56:26 -06:00
  • b42c8b43cf refactor: Remove layer index from n_embd_k/v_s Gabe Goodhart 2025-06-11 12:20:47 -06:00
  • 1dd12133cd refactor: Remove n_embd_k/v_s from unified cache Gabe Goodhart 2025-06-11 12:20:04 -06:00
  • 833dfb54ae fix: Use per-layer n_embd_k/v_s calls for mamba (1) layers Gabe Goodhart 2025-06-10 16:30:49 -06:00
  • f6d5f055c6 fix: Remove errant virtual destructor leftover from previous impl attempt Gabe Goodhart 2025-06-10 16:26:31 -06:00
  • 9c1a604af8 fix: Update clear signature for data argument after rebase Gabe Goodhart 2025-06-06 09:38:10 -06:00
  • de9297fd5e fix: Add missing padding to n_ctx for hybrid cache construction Gabe Goodhart 2025-06-05 15:54:50 -06:00
  • 911e694476 fix: Fix status for init_update sig for recurrent cache state Gabe Goodhart 2025-06-05 14:41:08 -06:00
  • d3699366e6 fix: Update recurrent cache for changes to remove intermediate kv_cache interface Gabe Goodhart 2025-06-05 14:07:07 -06:00
  • a9b5fe98ad fix: Fix logic for initializing inputs and attn layers for hybrid caches Gabe Goodhart 2025-06-04 15:02:14 -06:00
  • e3c1631556 feat: Support hybrid recurrent in llama-graph Gabe Goodhart 2025-06-04 08:47:55 -06:00
  • cf03d4ae5c fix: Fix shift logic to defer to unified cache Gabe Goodhart 2025-06-03 16:29:40 -06:00
  • 6c6ec0003a fix: Fix wrong bool condition for split equal in hybrid cache Gabe Goodhart 2025-05-28 11:02:54 -06:00
  • 423c89401d feat: Construct hybrid recurrent cache for hybrid recurrent models Gabe Goodhart 2025-05-28 08:57:18 -06:00
  • c71eaa37a0 feat: First pass at llama_kv_cache_hybrid_recurrent Gabe Goodhart 2025-05-30 09:35:26 -06:00
  • 13332a7554 fix: Use per-layer sizing everywhere in kv caches Gabe Goodhart 2025-05-14 09:16:06 -06:00
  • 40e9187892 feat: Add layer filter to recurrent cache Gabe Goodhart 2025-05-20 13:43:16 -06:00
  • fb26e95ae7 refactor: rename *_is_hybrid -> *_is_hybrid_recurrent Gabe Goodhart 2025-05-28 06:48:53 -06:00