upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-28 21:50:56 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • e83ba3e460 llama : add support for jina-reranker-v2 (#13900) b5537 Sigbjørn Skjæret 2025-05-29 21:42:31 +02:00
  • 2b131621e6 gguf-py : add support for sub_type (in arrays) in GGUFWriter add_key_value method (#13561) gguf-v0.17.0 Sigbjørn Skjæret 2025-05-29 15:36:05 +02:00
  • 54a2c7a8cd arm64: optimize q4_k_q8_k kernel with i8mm (#13886) b5535 Yibo Cai 2025-05-29 19:39:20 +08:00
  • 21fcc21ad5 cmake: Factor out CPU architecture detection (#13883) b5534 Christian Kastner 2025-05-29 12:50:25 +02:00
  • dd8ba93416 ggml: aarch64: Implement SVE F32 kernels for Mamba Sequential Scan Algorithm (#13882) b5533 Vineel Abhinav 2025-05-29 14:48:43 +05:30
  • 66c92061f5 tests : remove json.hpp from a test (#13880) b5532 Georgi Gerganov 2025-05-29 12:17:16 +03:00
  • 5ca82fc1d7 convert : workaround for AutoConfig dummy labels (#13881) Sigbjørn Skjæret 2025-05-29 10:00:57 +02:00
  • 6385b843a8 llama : add RobertaForSequenceClassification reranker support (#13875) b5530 Sigbjørn Skjæret 2025-05-29 08:15:01 +02:00
  • 1b8fb8152d ggml: aarch64: Implement SVE F32 kernels for vector functions (#13843) b5529 Vineel Abhinav 2025-05-29 11:31:33 +05:30
  • 53ae30640e gguf-py : fix SafetensorRemote return on undefined size (< 0) (#13841) Beinsezii 2025-05-28 14:50:20 -07:00
  • 763d06edb7 llama : fix KV shift for qwen2vl (#13870) b5527 Xuan-Son Nguyen 2025-05-28 22:35:31 +02:00
  • 10961339b2 mtmd : move helpers to dedicated library (⚠️ breaking change) (#13866) b5526 Xuan-Son Nguyen 2025-05-28 22:35:22 +02:00
  • d98f2a35fc ci: disable LLAMA_CURL for Linux cross-builds (#13871) bandoti 2025-05-28 15:46:47 -03:00
  • e0e3aa231d llama : add support for BertForSequenceClassification reranker (#13858) b5524 Đinh Trọng Huy 2025-05-29 02:01:58 +09:00
  • aa6dff05be convert: small addition to support LlamaModel (#13838) Đinh Trọng Huy 2025-05-28 23:34:18 +09:00
  • c962ae3382 server: fix remove 'image_url'/'input_audio' json-object effectlly for 'llama_params' in multimodal-model-mode (#13853) b5522 Sky 2025-05-28 22:33:54 +08:00
  • a3938fb53d convert : fix qwen omni conversion (#13859) Xuan-Son Nguyen 2025-05-28 16:12:35 +02:00
  • f7873fc698 tests : change umlaut test (#11600) Alex Fanthome 2025-05-28 14:49:28 +01:00
  • a68247439b CUDA: fix FA tg at long context for CC >= 8.9 (#13852) b5519 Johannes Gäßler 2025-05-28 13:33:37 +02:00
  • d97b9ade51 correct working directory for all builds Sigbjørn Skjæret 2025-05-28 12:49:36 +02:00
  • 0fe7183ae4 fix prototype for non-curl builds Sigbjørn Skjæret 2025-05-28 11:11:02 +02:00
  • ecbc92acd0 correct working directory Sigbjørn Skjæret 2025-05-28 10:16:34 +02:00
  • 26b79b6cb3 convert : fix tensor naming conflict for llama 4 vision (#13836) Xuan-Son Nguyen 2025-05-28 10:05:54 +02:00
  • 42ff1867bc add test-tokenizers-remote Sigbjørn Skjæret 2025-05-28 09:51:44 +02:00
  • 2d2e059f4f make common_download_file_single/multiple public Sigbjørn Skjæret 2025-05-28 09:50:41 +02:00
  • 1e8659e65a CANN: Add SOC TYPE printing in cmake configuration (#13837) b5517 leo-pony 2025-05-28 11:54:20 +08:00
  • a3c30846e4 opencl: add new ops - argsort, div, sub, addrows, sigmoid, group_norm (#13787) b5516 lhez 2025-05-27 12:56:08 -07:00
  • 1701d4c54f opencl: mark mul_mat f32f32 as supporting non-contiguous tensors (#13790) b5515 lhez 2025-05-27 12:53:14 -07:00
  • bef8176387 vulkan: use timestamp queries for GGML_VULKAN_PERF (#13817) b5514 Jeff Bolz 2025-05-27 11:39:07 -05:00
  • 34b7c0439e cmake : add llama-cparams.cpp to build (#13832) b5513 Georgi Gerganov 2025-05-27 19:08:44 +03:00
  • f3101a8cc6 SYCL: add gelu_erf kernel (#13749) b5512 Akarshan Biswas 2025-05-27 20:52:59 +05:30
  • 1c49c70d07 sync : ggml Georgi Gerganov 2025-05-27 18:04:38 +03:00
  • a8ea03d8ad ggml : add ggml_repeat_4d (#13824) b5510 Xuan-Son Nguyen 2025-05-27 15:53:55 +02:00
  • 05f6ac6283 ggml : riscv: add xtheadvector support (#13720) b5509 xctan 2025-05-27 21:21:36 +08:00
  • bc583e3c63 mtmd : support Qwen 2.5 Omni (input audio+vision, no audio output) (#13784) b5508 Xuan-Son Nguyen 2025-05-27 14:06:10 +02:00
  • 72b090da2c docs: remove link for llama-cli function calling (#13810) bandoti 2025-05-27 08:52:40 -03:00
  • 7fe03e7446 ggml-cpu: x86 feature detection is specific to x86 (#13811) b5506 Christian Kastner 2025-05-27 13:18:39 +02:00
  • 952f3953c1 ggml : allow CUDA graphs when using pipeline parallelism (#13814) b5505 Diego Devesa 2025-05-27 04:05:18 -07:00
  • 81713121ee kv-cells : track min/max used cells and per-sequence positions (#13808) b5504 Georgi Gerganov 2025-05-27 13:49:41 +03:00
  • f9cd68398b sampling : make sure samplers return at least 1 token (#13822) b5503 Georgi Gerganov 2025-05-27 12:07:52 +03:00
  • 9065ca71a2 tests : sampling tests use min_keep == 0 gg/min-p-fix Georgi Gerganov 2025-05-27 11:30:41 +03:00
  • 76f31abe53 sampling : same for typical sampling Georgi Gerganov 2025-05-27 11:30:24 +03:00
  • fe12a5d47e sampling : min-p should always return at least one token Georgi Gerganov 2025-05-27 11:24:40 +03:00
  • 4f81b33e32 llama : validate seq id batch input (#13809) b5502 Georgi Gerganov 2025-05-27 09:40:59 +03:00
  • cdf94a1802 server: --offline mode (#13804) b5501 Olivier Chafik 2025-05-26 14:34:27 -07:00
  • a26c4cc11e scripts : add option to compare commits in Debug (#13806) Georgi Gerganov 2025-05-26 22:24:01 +03:00
  • 4265a87b59 cuda : avoid cuGetErrorString (#13791) b5499 Georgi Gerganov 2025-05-26 22:14:52 +03:00
  • 6f180b915c SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611) b5498 Akarshan Biswas 2025-05-26 21:10:36 +05:30
  • 03f582ae8f server: fix streaming crashes (#13786) b5497 Olivier Chafik 2025-05-26 08:03:57 -07:00
  • 88c125f2ac examples/training: Fix file name in README (#13803) standby24x7 2025-05-26 23:55:24 +09:00
  • d74e94c1b3 server: fix format of streamed tool call deltas (diff name, fix id location) (#13800) b5495 Olivier Chafik 2025-05-26 06:56:49 -07:00
  • f13847cfb5 server: fix regression on streamed non-chat completion w/ stops (#13785) b5494 Olivier Chafik 2025-05-26 06:16:37 -07:00
  • 79c137f776 examples : allow extracting embeddings from decoder contexts (#13797) b5493 Georgi Gerganov 2025-05-26 14:03:54 +03:00
  • 22229314fc llama : clarify deprecation message (#13794) b5492 Georgi Gerganov 2025-05-26 12:57:50 +03:00
  • 9012eb9b45 sycl: Add more debug prints (#13640) Romain Biessy 2025-05-26 10:28:53 +02:00
  • fef693dc6b vulkan: mark IM2COL as supporting non-contig (#13783) b5490 Jeff Bolz 2025-05-25 23:02:07 -05:00
  • 2d38b6e400 CANN: Add the basic supports of Flash Attention kernel (#13627) b5489 Bizhao Shi 2025-05-26 10:20:18 +08:00
  • e121edc432 server: add --reasoning-budget 0 to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771) b5488 Olivier Chafik 2025-05-26 00:30:51 +01:00
  • 2f099b510f webui : bump max upload file size to 500MB (#13779) Xuan-Son Nguyen 2025-05-25 19:02:18 +02:00
  • aa50ba462f tests : improve UGM tokenizer test coverage (#13773) b5486 Sigbjørn Skjæret 2025-05-25 16:22:29 +02:00
  • de2ef53a4b kv-cache : rework kv_cell (#13706) Georgi Gerganov 2025-05-25 16:34:36 +03:00
  • c508256db2 rpc : Fix build on OpenBSD (#13541) b5484 Percy Piper 2025-05-25 13:35:53 +01:00
  • 40aaa8a403 mtmd : add support for Qwen2-Audio and SeaLLM-Audio (#13760) b5483 Xuan-Son Nguyen 2025-05-25 14:06:32 +02:00
  • a08c1d2845 docs : add Moondream2 pre-quantized link (#13745) ddpasa 2025-05-25 14:04:49 +02:00
  • d785f9c1fd server: fix/test add_generation_prompt (#13770) b5481 Olivier Chafik 2025-05-25 10:45:49 +01:00
  • 4032ca4066 llama : add support for Qwen3 MoE tied word embeddings (#13768) b5480 Piotr Jasiukajtis 2025-05-25 10:29:43 +02:00
  • 515fdbf7ed SYCL: revert "sycl: simplify bin_bcast_kernel (#13383)" (#13752) b5479 Akarshan Biswas 2025-05-25 12:38:37 +05:30
  • f5cd27b71d server: streaming of tool calls and thoughts when --jinja is on (#12379) b5478 Olivier Chafik 2025-05-25 01:48:08 +01:00
  • a2d02d5793 releases : bundle llvm omp library in windows release (#13763) b5477 Diego Devesa 2025-05-24 15:55:16 -07:00
  • 17fc817b58 releases : enable openmp in windows cpu backend build (#13756) b5476 Diego Devesa 2025-05-24 13:27:03 -07:00
  • 2bd1b30f69 ggml-cpu : set openmp wait time if not set (#13758) b5475 Diego Devesa 2025-05-24 13:26:47 -07:00
  • 259469c4b5 Move GLM4 f32 attention fix to the correct function (#13750) b5474 0cc4m 2025-05-24 16:49:12 +02:00
  • 4c32832c59 ggml : add ggml_gelu_erf() CUDA kernel (#13719) b5473 Xuan-Son Nguyen 2025-05-24 13:06:47 +02:00
  • c3a2624339 vocab : fix ugm tokenizer precision (#13743) b5472 Sigbjørn Skjæret 2025-05-24 12:29:09 +02:00
  • ffd0eae60b CUDA: fix race condition in FA vector kernels (#13742) b5471 Johannes Gäßler 2025-05-24 11:46:19 +02:00
  • b775345d78 ci : enable winget package updates (#13734) Diego Devesa 2025-05-23 13:14:00 -07:00
  • a70a8a69c2 ci : add winget package updater (#13732) Diego Devesa 2025-05-23 13:09:38 -07:00
  • d13d0f6135 hparams : initialize arrays (#13728) b5468 Georgi Gerganov 2025-05-23 20:16:13 +03:00
  • 8a2afb7520 llama : allow custom list of swa_layers (#13726) Xuan-Son Nguyen 2025-05-23 17:07:04 +02:00
  • 9ecf3e66a3 server : support audio input (#13714) b5466 Xuan-Son Nguyen 2025-05-23 11:03:47 +02:00
  • faaaff5f94 CANN: Support MUL_MAT_ID for q8_0 and q4_0 (#13705) b5465 Chenguang Li 2025-05-23 16:47:53 +08:00
  • e16c4731c7 ggml : fix the order of ggml_unary_op (#13718) b5464 Xuan-Son Nguyen 2025-05-23 08:12:48 +02:00
  • 1dcd01960c vulkan: support CPY from any type to itself (#13695) b5463 Jeff Bolz 2025-05-23 00:45:02 -04:00
  • c10ed6cbcc vulkan: Disable coopmat/coopmat2/bfloat extensions if glslc doesn't support it (#13696) b5462 Jeff Bolz 2025-05-23 00:33:45 -04:00
  • a127ff1780 use LOG_WARN to replace std::cerr (#13657) b5461 Judd 2025-05-23 12:33:08 +08:00
  • 3079e9ac8e release : fix windows hip release (#13707) b5460 Diego Devesa 2025-05-22 15:21:37 -07:00
  • 8a1d206f1d tts : fix n_ubatch + make WavTokenizer cache-less (#13713) b5459 Georgi Gerganov 2025-05-22 22:21:07 +03:00
  • 108d484ab2 tts : fix n_ubatch + make WavTokenizer cache-less gg/tts-fix-ubatch Georgi Gerganov 2025-05-22 21:53:13 +03:00
  • 797990c4bc mtmd : add ultravox audio input (#13623) b5458 Xuan-Son Nguyen 2025-05-22 20:42:48 +02:00
  • ab86335760 common: Include torch package for s390x (#13699) Aaron Teo 2025-05-23 02:31:29 +08:00
  • cc74d5be99 server : pad small embedding batches (#13692) b5456 Georgi Gerganov 2025-05-22 16:33:39 +03:00
  • 5be24af73d gguf-py : correct charsmap parameter typing (#13701) Sigbjørn Skjæret 2025-05-22 14:25:05 +02:00
  • d394a9aedc sycl : Remove waits from function calls (#13702) b5454 Nicolò Scipione 2025-05-22 13:54:43 +02:00
  • 6b56a64690 SYCL: Avoid using with SYCL-Graph for unsupported nodes (#13587) b5453 Ewan Crawford 2025-05-22 09:24:09 +01:00
  • a4e8912dfd opencl: Add support for multiple devices (#12622) b5452 Henry Linjamäki 2025-05-22 02:21:45 +03:00
  • edbf42edfd opencl: fix couple crashes (#12795) b5451 Henry Linjamäki 2025-05-21 23:21:17 +03:00
  • d643bb2c79 releases : build CPU backend separately (windows) (#13642) b5450 Diego Devesa 2025-05-21 13:09:57 -07:00
  • 8e186ef0e7 hparams : support models for which all layers use SWA (#13682) b5449 Georgi Gerganov 2025-05-21 20:00:49 +03:00
  • 5fbfe384d4 server : improve error reporting (#13680) b5448 Georgi Gerganov 2025-05-21 19:46:56 +03:00
  • c76532e7ba convert : add qwen2vl support for unsloth merges (#13686) antichristHater 2025-05-21 19:40:35 +03:00