upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-28 21:50:56 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • e3c1631556 feat: Support hybrid recurrent in llama-graph Gabe Goodhart 2025-06-04 08:47:55 -06:00
  • cf03d4ae5c fix: Fix shift logic to defer to unified cache Gabe Goodhart 2025-06-03 16:29:40 -06:00
  • 6c6ec0003a fix: Fix wrong bool condition for split equal in hybrid cache Gabe Goodhart 2025-05-28 11:02:54 -06:00
  • 423c89401d feat: Construct hybrid recurrent cache for hybrid recurrent models Gabe Goodhart 2025-05-28 08:57:18 -06:00
  • c71eaa37a0 feat: First pass at llama_kv_cache_hybrid_recurrent Gabe Goodhart 2025-05-30 09:35:26 -06:00
  • 13332a7554 fix: Use per-layer sizing everywhere in kv caches Gabe Goodhart 2025-05-14 09:16:06 -06:00
  • 40e9187892 feat: Add layer filter to recurrent cache Gabe Goodhart 2025-05-20 13:43:16 -06:00
  • fb26e95ae7 refactor: rename *_is_hybrid -> *_is_hybrid_recurrent Gabe Goodhart 2025-05-28 06:48:53 -06:00
  • fc9e0b576e feat: Auto-fill hparams.recurrent_layer_arr based on whether the model is recurrent Gabe Goodhart 2025-05-09 15:22:18 -06:00
  • 05f1958080 feat: Add support for distinguishing recurrent vs non-recurrent layers in hparams Gabe Goodhart 2025-05-09 15:04:36 -06:00
  • 5e2f2c3876 feat: Add c++ side constants for attention layer indices hparam Gabe Goodhart 2025-05-09 15:08:33 -06:00
  • ec8fe17b1a feat: Add llama_model_is_hybrid API call Gabe Goodhart 2025-05-09 15:21:29 -06:00
  • d3d06debe3 server : add pidfile option add-pidfile Eric Curtin 2025-06-17 14:23:55 +01:00
  • c46503014d cmake: remove shader-gen step-targets from ggml-vulkan (#14226) b5689 bandoti 2025-06-17 17:33:25 -03:00
  • 02ff085071 fix errors in conversion. Vaibhavs10 2025-06-17 16:01:53 +02:00
  • 32ea9c5fc1 Model -> ModelBase. Vaibhavs10 2025-06-17 15:09:15 +02:00
  • 024bd29445 Init - first pass. Vaibhavs10 2025-06-17 15:03:34 +02:00
  • 860a9e4eef ggml-cpu : remove the weak alias trick (#14221) b5688 xctan 2025-06-17 17:58:32 +08:00
  • fe9d60e74a musa: fix build warning (unused variable) (#14231) b5687 R0CKSTAR 2025-06-17 17:48:08 +08:00
  • 04b8f5143d Merge branch 'master' into compilade/test-model-random Francis Couture-Harpin 2025-06-16 21:42:25 -04:00
  • 352703b08b test-model-random : better default tensor initialization distribution Francis Couture-Harpin 2025-06-16 21:30:21 -04:00
  • e434e69183 common : suggest --jinja when autodetection fails (#14222) b5686 Sigbjørn Skjæret 2025-06-16 21:58:42 +02:00
  • 89fea80d29 server : fix incorrect usage of llama_get_embeddings() (#14225) b5685 Georgi Gerganov 2025-06-16 22:33:27 +03:00
  • 6adc3c3ebc llama : add thread safety test (#14035) b5684 Diego Devesa 2025-06-16 08:11:43 -07:00
  • 0dbcabde8c cmake: clean up external project logic for vulkan-shaders-gen (#14179) b5683 bandoti 2025-06-16 10:32:13 -03:00
  • ad590be98c model : add NeoBERT (#14164) b5682 Đinh Trọng Huy 2025-06-16 21:53:41 +09:00
  • 7d6d91babf HIP: disable rocwmma on gfx12 by default until rocm 7.0 (#14202) b5681 uvos 2025-06-16 13:47:38 +02:00
  • d3e64b9f49 llama : rework embeddings logic (#14208) Georgi Gerganov 2025-06-16 14:14:00 +03:00
  • 3ba0d843c6 ggml: Add Android support for GGML_CPU_ALL_VARIANTS (#14206) b5679 Charles Xu 2025-06-16 11:47:57 +02:00
  • 0bf49eb668 convert : remove arcee change in convert_hf_to_gguf_update.py (#14207) Bartowski 2025-06-16 09:16:06 +01:00
  • 4ad243677b gguf-py : allow key override when adding value to GGUFWriter (#14194) Đinh Trọng Huy 2025-06-16 16:20:59 +09:00
  • c89c2d1ab9 vulkan: mutex around vkQueueSubmit (#14127) b5676 Jeff Bolz 2025-06-16 00:21:08 -06:00
  • 3555b3004b ggml-cpu : rework weak alias on apple targets (#14146) b5675 xctan 2025-06-16 13:54:15 +08:00
  • d7da8dc83a model : Add support for Arcee AI's upcoming AFM model (#14185) b5674 Bartowski 2025-06-16 00:04:06 +01:00
  • cd355eda7d server : When listening on a unix domain socket don't print http:// and port (#14180) b5673 Eric Curtin 2025-06-15 23:36:22 +02:00
  • 30e5b01de2 quantize : change int to unsigned int for KV overrides (#14197) b5672 Ed Addario 2025-06-15 17:53:45 +01:00
  • e54b394082 CUDA/HIP: fix ssm_scan on devices where warp size is not 32 (#14196) b5671 uvos 2025-06-15 17:30:13 +02:00
  • 2c2caa4443 HIP: Replace usage of depricated preprocessor macro __AMDGCN_WAVEFRONT_SIZE__ (#14183) b5670 uvos 2025-06-15 15:45:27 +02:00
  • 5fce5f948d kv-cache : fix use-after-move of defrag info (#14189) b5669 Georgi Gerganov 2025-06-15 10:52:11 +03:00
  • 9ae4143bc6 model : add dots.llm1 architecture support (#14044) (#14118) b5668 Mikko Juola 2025-06-15 00:52:06 -07:00
  • c311ac664d cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188) b5667 Georgi Gerganov 2025-06-15 10:08:58 +03:00
  • b9912ac570 batch : auto-gen positions + verify multi-sequence input (#14177) b5666 Georgi Gerganov 2025-06-15 09:18:37 +03:00
  • 00ba772610 docs : remove WIP since PR has been merged (#13912) Pepijn de Vos 2025-06-15 08:06:37 +02:00
  • 3cb203c89f llama-chat : Do not throw when tool parsing fails (#14012) b5664 Piotr 2025-06-14 18:25:15 +02:00
  • 2e42be42bd compare-llama-bench: add option to plot (#14169) Aman Gupta 2025-06-14 16:34:20 +08:00
  • dfa3c18266 tests : add LLAMA, LLAMA4, and GEMMA2 to test-model-random Francis Couture-Harpin 2025-06-13 20:02:29 -04:00
  • 61f6429470 Merge branch 'master' into compilade/test-model-random Francis Couture-Harpin 2025-06-13 14:31:39 -04:00
  • fb85a288d7 vocab : fix build (#14175) b5662 Georgi Gerganov 2025-06-13 20:03:05 +03:00
  • 40643edb86 sycl: fix docker image (#14144) Svetlozar Georgiev 2025-06-13 17:32:56 +01:00
  • 3cfbbdb44e Merge commit from fork Guy Goldenberg 2025-06-13 19:20:25 +03:00
  • 80709b70a2 batch : add LLAMA_BATCH_DEBUG environment variable (#14172) b5659 Georgi Gerganov 2025-06-13 18:35:00 +03:00
  • 26ff3685bf docs : Update multimodal.md (#14122) ddpasa 2025-06-13 15:17:53 +02:00
  • 60c666347b batch : rework llama_batch_allocr (#14153) b5657 Georgi Gerganov 2025-06-13 13:47:55 +03:00
  • b7cc7745e3 readme : remove survey link (#14168) Georgi Gerganov 2025-06-13 11:55:44 +03:00
  • cc8d081879 cmake: Add ability to pass in LLAMA_BUILD_NUMBER/COMMIT (#14167) b5655 Christian Kastner 2025-06-13 08:38:52 +00:00
  • d714dadb57 pooling : make cls_b and cls_out_b optional (#14165) b5654 Đinh Trọng Huy 2025-06-13 17:34:08 +09:00
  • ffad043973 server : fix SWA condition for full context reprocess (#14163) b5653 Georgi Gerganov 2025-06-13 11:18:25 +03:00
  • 0889eba570 sycl: Adding additional cpy dbg print output (#14034) b5652 Anton Mitkov 2025-06-13 08:51:39 +01:00
  • c61285e739 SYCL: Bump oneMath commit (#14152) b5651 Ewan Crawford 2025-06-13 08:45:37 +01:00
  • 09cf2c7c65 cmake : Improve build-info.cpp generation (#14156) b5650 Christian Kastner 2025-06-13 06:51:34 +00:00
  • c33fe8b8c4 vocab : prevent heap overflow when vocab is too small (#14145) b5649 Georgi Gerganov 2025-06-13 08:03:54 +03:00
  • ed52f3668e sycl: Remove not needed copy f16->f32 for dnnl mul mat (#14125) b5648 Anton Mitkov 2025-06-12 14:15:11 +01:00
  • a681b4ba83 readme : remove project status link (#14149) Georgi Gerganov 2025-06-12 14:43:09 +03:00
  • 7d516443dd server : re-enable SWA speculative decoding (#14131) b5646 Georgi Gerganov 2025-06-12 11:51:38 +03:00
  • 36fce98281 server : re-enable swa speculative decoding gg/server-reenable-swa-spec Georgi Gerganov 2025-06-11 20:22:06 +03:00
  • f6e1a7aa87 context : simplify output counting logic during decode (#14142) b5645 Georgi Gerganov 2025-06-12 11:50:01 +03:00
  • c3ee46fab4 batch : remove logits_all flag (#14141) b5644 Georgi Gerganov 2025-06-12 11:49:26 +03:00
  • ed99a8ea04 cont : fix comments gg/batch-simplify-output Georgi Gerganov 2025-06-12 10:43:55 +03:00
  • b8b8d3f368 context : simplify output counting logic during decode Georgi Gerganov 2025-06-12 10:35:09 +03:00
  • e2c0b6e46a cmake : handle whitepsaces in path during metal build (#14126) Georgi Gerganov 2025-06-12 10:14:24 +03:00
  • c53acda0b8 batch : remove logits_all flag Georgi Gerganov 2025-06-12 10:10:45 +03:00
  • 9596506965 kv-cache : fix split_equal handling in unified implementation (#14130) b5642 Georgi Gerganov 2025-06-12 10:02:15 +03:00
  • a20b2b05bc context : round n_tokens to next multiple of n_seqs when reserving (#14140) b5641 compilade 2025-06-12 02:56:04 -04:00
  • 8fe213af76 tests : avoid sprintf in test-model-random Francis Couture-Harpin 2025-06-12 02:48:11 -04:00
  • 7657835b33 tests : fix overflow and memory leaks in test-model-random Francis Couture-Harpin 2025-06-12 02:23:44 -04:00
  • 9cd402cbe1 tests : add test-model-random Francis Couture-Harpin 2025-06-11 17:53:55 -04:00
  • 2e89f76b7a common: fix issue with regex_escape routine on windows (#14133) b5640 bandoti 2025-06-11 17:19:44 -03:00
  • 4b6fb6524b context : round n_tokens to next multiple of n_seqs when reserving compilade/fix-batch-reserve-rwkv Francis Couture-Harpin 2025-06-11 16:17:36 -04:00
  • 0b6f6becb4 ggml-cpu : reorder SVE FMA for consistency with other SIMD arches Francis Couture-Harpin 2025-06-11 15:29:58 -04:00
  • 757aa6239d ggml : fix mamba2 ssm scan when compiled with SVE Francis Couture-Harpin 2025-06-11 12:33:05 -04:00
  • 532802f938 Implement GGML_CPU_ALL_VARIANTS for ARM (#14080) b5639 Christian Kastner 2025-06-11 19:07:44 +00:00
  • d4e0d95cf5 chore : clean up relative source dir paths (#14128) b5638 Sigbjørn Skjæret 2025-06-11 19:04:23 +02:00
  • 2fa5f2ceb8 graph : fix recurrent state copies when avoiding copies Francis Couture-Harpin 2025-06-10 20:00:41 -04:00
  • cc66a7f78f tests : add test-tokenizers-repo (#14017) b5637 Sigbjørn Skjæret 2025-06-11 17:16:32 +02:00
  • bd248d4dc7 vulkan: Better thread-safety for command pools/buffers (#14116) b5636 Jeff Bolz 2025-06-11 09:48:52 -05:00
  • 7781e5fe99 webui: Wrap long numbers instead of infinite horizontal scroll (#14062) Aman 2025-06-11 22:42:25 +08:00
  • 89a184fa71 kv-cache : relax SWA masking condition (#14119) b5634 Georgi Gerganov 2025-06-11 16:48:45 +03:00
  • 2baf07727f server : pass default --keep argument (#14120) b5633 Taylor 2025-06-11 06:43:43 -04:00
  • 7ae2932116 kv-cache : add LLAMA_KV_CACHE_DEBUG environment variable (#14121) b5632 Georgi Gerganov 2025-06-11 12:52:45 +03:00
  • 1f7d50b293 vulkan: Track descriptor pools/sets per-context (#14109) b5631 Jeff Bolz 2025-06-11 00:19:25 -05:00
  • 4c763c8d1b opencl: add mul_mv_id_q4_0_f32_8x_flat (#14003) b5630 lhez 2025-06-10 16:55:58 -07:00
  • 9864bfcd01 Merge branch 'master' into compilade/mamba2 Francis Couture-Harpin 2025-06-10 19:22:15 -04:00
  • dad5c44398 kv-cache : avoid modifying recurrent cells when setting inputs (#13834) b5629 compilade 2025-06-10 18:20:14 -04:00
  • 55f6b9fa65 convert : fix duplicate key DeepSeek-R1 conversion error (#14103) Sigbjørn Skjæret 2025-06-10 23:29:52 +02:00
  • 3678b838bb llama : support GEGLU for jina-bert-v2 (#14090) b5627 Sigbjørn Skjæret 2025-06-10 18:02:08 +02:00
  • 652b70e667 vulkan: force device 0 in CI (#14106) Jeff Bolz 2025-06-10 10:53:47 -05:00
  • 3a12db23b6 Fixed spec timings to: accepted/tested instead of accepted/drafted (#14104) b5625 Juk Armstrong 2025-06-10 16:48:07 +01:00
  • ae92c1855b sync : ggml b5624 Georgi Gerganov 2025-06-10 17:37:45 +03:00
  • b7ce1ad1e3 ggml : fix weak alias win32 (whisper/0) Georgi Gerganov 2025-06-10 11:34:10 +03:00
  • 97340b4c99 Vulkan: Don't default to CPU device (like llvmpipe), even if no other device is available, to allow fallback to CPU backend (#14099) b5622 0cc4m 2025-06-10 14:01:33 +02:00