upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-29 06:00:58 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • d2e518e9b4 ggml-cpu : fix ggml_graph_compute_thread did not terminate on abort. (ggml/1065) issixx 2025-01-17 21:29:08 +09:00
  • b636228c0a embedding : enable --no-warmup option (#11475) b4581 Daniel Bevenius 2025-01-29 09:38:54 +01:00
  • 325afb370a llama: fix missing k_cache store for rwkv6qwen2 (#11445) b4580 Molly Sophia 2025-01-29 12:07:21 +08:00
  • 794fe23f29 cmake: add hints for locating ggml on Windows using Llama find-package (#11466) Emreerdog 2025-01-29 02:22:06 +03:00
  • cf8cc856d7 server : Fixed wrong function name in llamacpp server unit test (#11473) peidaqi 2025-01-28 16:03:42 -07:00
  • d0c08040b6 ci : fix build CPU arm64 (#11472) Xuan-Son Nguyen 2025-01-29 00:02:56 +01:00
  • be5ef7963f HIP: Supress transformation warning in softmax.cu b4576 uvos 2025-01-28 23:06:32 +01:00
  • cae9fb4361 HIP: Only call rocblas_initialize on rocblas versions with the multiple instantation bug (#11080) b4575 Nikita Sarychev 2025-01-28 07:42:20 -08:00
  • 7fee2889e6 Add github protocol pulling and http:// (#11465) b4574 Eric Curtin 2025-01-28 15:45:41 +01:00
  • d7d1eccacc docker: allow installing pip packages system-wide (#11437) Nuno 2025-01-28 15:17:25 +01:00
  • 4bf3119d61 cmake : don't fail on GGML_CPU=OFF (#11457) b4572 someone13574 2025-01-28 09:15:34 -05:00
  • f643120bad docker: add perplexity and bench commands to full image (#11438) Nuno 2025-01-28 11:42:32 +01:00
  • 6e84b0ab8e SYCL : SOFTMAX F16 mask support and other fixes (#11261) b4570 Akarshan Biswas 2025-01-28 15:26:58 +05:30
  • 2b8525d5c8 Handle missing model in CLI parameters for llama-run (#11399) b4569 Michael Engel 2025-01-28 09:32:40 +01:00
  • a4417ddda9 Add new hf protocol for ollama (#11449) b4568 Eric Curtin 2025-01-27 19:36:10 +01:00
  • d6d24cd9ed AMD: parse the architecture as supplied by gcnArchName (#11244) b4567 Haus1 2025-01-27 08:58:17 -05:00
  • a5203b4465 llama : minor fixes for up llama load model speed (#11448) b4566 lexasub 2025-01-27 17:42:09 +04:00
  • e665b57fa2 Merge branch 'master' into gg/llama-kv-cache Georgi Gerganov 2025-01-27 14:00:56 +02:00
  • df984e0147 llama: refactor llama_decode_impl (#11381) b4565 Johannes Gäßler 2025-01-27 12:07:12 +01:00
  • acd38efee3 metal: Handle null returned from MTLCreateSystemDefaultDevice() (#11441) b4564 Ihar Hrachyshka 2025-01-27 02:41:59 -05:00
  • caf773f249 docker : fix ARM build and Vulkan build (#11434) Xuan Son Nguyen 2025-01-26 22:45:32 +01:00
  • a0c500b4dc context : prepare for abstraction Georgi Gerganov 2025-01-17 21:11:03 +02:00
  • 99422dfa3f context : introduce llama_batch_manager Georgi Gerganov 2025-01-17 20:30:16 +02:00
  • cb8f2095c6 wip Georgi Gerganov 2025-01-17 19:37:52 +02:00
  • 133ad6a723 context : initial need_reserve logic Georgi Gerganov 2025-01-17 14:42:09 +02:00
  • c75ba6851e context : move adapter code in the implementation [no ci] Georgi Gerganov 2025-01-17 12:41:16 +02:00
  • f0713498fd context : add get_ctx_padding() Georgi Gerganov 2025-01-17 11:51:35 +02:00
  • b4ec1d4429 cont : move kv_self update to llama_context Georgi Gerganov 2025-01-16 21:55:12 +02:00
  • f2524c0e41 llama : remove references to llama_kv_cache (wip) Georgi Gerganov 2025-01-16 15:04:14 +02:00
  • ae274f9747 llama : fix names [no ci] Georgi Gerganov 2025-01-15 13:35:56 +02:00
  • a19f671fe0 context : minor Georgi Gerganov 2025-01-15 10:54:21 +02:00
  • 17b363afd3 llama : update llama_kv_self API Georgi Gerganov 2025-01-14 16:47:34 +02:00
  • fd05ab87aa kv_cache : move state read/write to llama_kv_cache Georgi Gerganov 2025-01-14 13:13:35 +02:00
  • 4cd1b6fa4c context : prepare kv_cache_read/write to be moved to kv_cache Georgi Gerganov 2025-01-14 12:33:13 +02:00
  • 73a14eccc9 kv_cache : minor Georgi Gerganov 2025-01-14 11:56:53 +02:00
  • fef90cb3d7 kv_cache : fix Georgi Gerganov 2025-01-13 15:58:20 +02:00
  • 4d7bd03e65 kv_cache : functions -> members Georgi Gerganov 2025-01-13 15:50:39 +02:00
  • e4550fbafc llama : cont Georgi Gerganov 2025-01-13 14:56:52 +02:00
  • f78b396ee7 llama : add struct llama_kv_cache (wip) [no ci] Georgi Gerganov 2025-01-13 14:13:11 +02:00
  • 178a7eb952 metal : use residency sets (#11427) b4562 Georgi Gerganov 2025-01-26 20:06:16 +02:00
  • 6f53d8a6b4 docker: add missing vulkan library to base layer and update to 24.04 (#11422) Nuno 2025-01-26 18:22:43 +01:00
  • 19f65187cb cmake: add ggml find package (#11369) b4560 bandoti 2025-01-26 12:07:48 -04:00
  • 1d8ee06000 rpc: fix register position (#11424) b4559 Frank Mai 2025-01-26 23:20:34 +08:00
  • 2cc9b8c32c readme : update hot topics Georgi Gerganov 2025-01-26 14:30:15 +02:00
  • f35726c2fb build: apply MSVC /bigobj option to c/cpp files only (#11423) b4557 Jeff Bolz 2025-01-25 20:10:03 -06:00
  • 4a75d19376 vulkan: compile shaders on-demand (#11406) Jeff Bolz 2025-01-25 15:29:57 -06:00
  • 26771a1491 Hip: disable VMM on hip as it seams that it dosent work in some configurations (#11420) uvos 2025-01-25 21:01:12 +01:00
  • ca6baf76c1 build: add /bigobj to MSVC build (#11407) Jeff Bolz 2025-01-25 11:26:37 -06:00
  • 6e264a905b docker : add GGML_CPU_ARM_ARCH arg to select ARM architecture to build for (#11419) Diego Devesa 2025-01-25 17:22:41 +01:00
  • 49b0e3cec4 server : fix cleaning up stream task (#11418) b4552 Xuan Son Nguyen 2025-01-25 16:36:44 +01:00
  • 20a758155b docker : fix CPU ARM build (#11403) Diego Devesa 2025-01-25 15:22:29 +01:00
  • 00c24acb2a ci : fix line breaks on windows builds (#11409) b4550 Georgi Gerganov 2025-01-25 13:36:48 +02:00
  • 466ea66f33 CANN: Add Ascend CANN build ci (#10217) b4549 jiahao su 2025-01-25 07:26:01 +08:00
  • 5f0db9522f hip : Add hipGraph and VMM support to ROCM (#11362) b4548 uvos 2025-01-25 00:02:23 +01:00
  • de9d2c6f09 test [pack] sl/pr-releases slaren 2025-01-24 22:07:27 +01:00
  • df0edbb0be test slaren 2025-01-24 22:03:31 +01:00
  • 202b1e7105 ci : allow creating artifacts on PRs on demand slaren 2025-01-24 21:36:11 +01:00
  • c5d9effb49 CUDA: fix FP16 cuBLAS GEMM (#11396) b4547 Johannes Gäßler 2025-01-24 21:02:43 +01:00
  • 9fbadaef4f rocBLAS: Avoid fp32->fp16->fp32 conversion on cdna (#11356) b4546 uvos 2025-01-24 17:50:49 +01:00
  • 9755129c27 release : pack /lib in the packages (#11392) b4545 Georgi Gerganov 2025-01-24 18:41:30 +02:00
  • 969b264657 Revert "TMP : push artifacts" gg/build-pack-lib-include Georgi Gerganov 2025-01-24 17:58:09 +02:00
  • 5740ec7a66 ci : change ubuntu package to 22.04 Georgi Gerganov 2025-01-24 17:05:44 +02:00
  • 872fd18420 ci : fix typo Georgi Gerganov 2025-01-24 16:46:03 +02:00
  • 39d0621872 ci : macos set build rpath to "@loader_path" Georgi Gerganov 2025-01-24 16:31:12 +02:00
  • dae44bf21a ci : change back to ubuntu latest Georgi Gerganov 2025-01-24 16:28:32 +02:00
  • 537b09e70f TMP : push artifacts Georgi Gerganov 2025-01-24 14:54:24 +02:00
  • 8b2ed1e432 ci : remove obsolete MacOS build Georgi Gerganov 2025-01-24 16:01:52 +02:00
  • f9f65f0162 ci : try to fix macos build rpaths Georgi Gerganov 2025-01-24 16:01:32 +02:00
  • 56e26a7f30 ci : change ubuntu build from latest to 20.04 Georgi Gerganov 2025-01-24 15:58:48 +02:00
  • 194358e3b7 ci : restore the original HIP commands Georgi Gerganov 2025-01-24 15:41:52 +02:00
  • a07c2c8a52 docs : Update readme to build targets for local docker build (#11368) Jafar Uruç 2025-01-24 13:30:13 +00:00
  • 50455ded31 ci : fix HIP cmake compiler options to be on first line Georgi Gerganov 2025-01-24 15:23:22 +02:00
  • 564353c9a3 Revert "TMP : push artifacts" Georgi Gerganov 2025-01-24 15:22:36 +02:00
  • 4decf2c4df TMP : push artifacts Georgi Gerganov 2025-01-24 14:54:24 +02:00
  • 3a35bfe1f7 cmake : put libs in /bin Georgi Gerganov 2025-01-24 14:40:48 +02:00
  • 8137b4bb2b CPU/CUDA: fix (GQA) mul mat back, add CUDA support (#11380) b4543 Johannes Gäßler 2025-01-24 12:38:31 +01:00
  • ff4cb6ef4c release : pack /lib and /include in the packages gg/build-linux-static Georgi Gerganov 2025-01-24 13:28:37 +02:00
  • 1af6945eb0 cmake : avoid -march=native when reproducible build is wanted (#11366) b4542 Bernhard M. Wiedemann 2025-01-24 12:21:35 +01:00
  • 01f37edf1a Update llama-run README.md (#11386) Eric Curtin 2025-01-24 09:39:24 +00:00
  • c07e87f38b server : (webui) put DeepSeek R1 CoT in a collapsible <details> element (#11364) stduhpf 2025-01-24 09:02:38 +01:00
  • 564804b79b tests: fix some mul_mat test gaps (#11375) b4539 Jeff Bolz 2025-01-23 14:51:24 -06:00
  • 05f63cc9ee Update documentation (#11373) b4538 Eric Curtin 2025-01-23 20:04:31 +00:00
  • f7fb43cd0b Add -ngl (#11372) b4537 Eric Curtin 2025-01-23 16:16:18 +00:00
  • 5845661640 server : add more clean up when cancel_tasks is called (#11340) b4536 Xuan Son Nguyen 2025-01-23 13:56:05 +01:00
  • f211d1dc10 Treat hf.co/ prefix the same as hf:// (#11350) b4535 Eric Curtin 2025-01-23 10:38:20 +00:00
  • 955a6c2d91 Vulkan-run-test: fix mmq_wg_denoms (#11343) b4534 amd-dwang 2025-01-23 15:14:28 +08:00
  • 1971adf55e vulkan: sort shaders for more deterministic binary (#11315) b4533 Jeff Bolz 2025-01-23 01:07:50 -06:00
  • 5245729e33 vulkan: fix diag_mask_inf (#11323) b4532 Jeff Bolz 2025-01-23 01:01:17 -06:00
  • 6152129d05 main : update README documentation for batch size (#11353) Diego Devesa 2025-01-22 19:22:20 +01:00
  • 16d3df7ab0 readme : add plugin links (#11355) Georgi Gerganov 2025-01-22 19:44:26 +02:00
  • 12c2bdf2de server : fix draft context not being released (#11354) b4529 Diego Devesa 2025-01-22 17:44:40 +01:00
  • c64d2becb1 minja: sync at 0f5f7f2b37 (#11352) b4528 Olivier Chafik 2025-01-22 16:16:27 +00:00
  • 96f4053934 Adding logprobs to /v1/completions (#11344) b4527 Jiří Podivín 2025-01-22 12:51:32 +01:00
  • a94f3b2727 common: utils to split / join / repeat strings (from json converter) (#11342) b4526 Olivier Chafik 2025-01-22 09:51:44 +00:00
  • 3e3357fd77 llava : support Minicpm-omni (#11289) b4525 tc-mb 2025-01-22 15:35:48 +08:00
  • 6171c9d258 Add Jinja template support (#11016) b4524 Olivier Chafik 2025-01-21 13:18:51 +00:00
  • e28245f35f export-lora : fix tok_embd tensor (#11330) b4523 Xuan Son Nguyen 2025-01-21 14:07:12 +01:00
  • 6da5bec81c rpc : better caching of the base buffer pointer (#11331) b4522 Radoslav Gerganov 2025-01-21 15:06:41 +02:00
  • 2e2f8f093c linenoise.cpp refactoring (#11301) b4521 Eric Curtin 2025-01-21 09:32:35 +00:00
  • 2139667ec4 metal : fix out-of-bounds write (#11314) b4520 Georgi Gerganov 2025-01-21 08:48:13 +02:00