upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-29 14:11:13 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • f7fb43cd0b Add -ngl (#11372) b4537 Eric Curtin 2025-01-23 16:16:18 +00:00
  • 5845661640 server : add more clean up when cancel_tasks is called (#11340) b4536 Xuan Son Nguyen 2025-01-23 13:56:05 +01:00
  • f211d1dc10 Treat hf.co/ prefix the same as hf:// (#11350) b4535 Eric Curtin 2025-01-23 10:38:20 +00:00
  • 955a6c2d91 Vulkan-run-test: fix mmq_wg_denoms (#11343) b4534 amd-dwang 2025-01-23 15:14:28 +08:00
  • 1971adf55e vulkan: sort shaders for more deterministic binary (#11315) b4533 Jeff Bolz 2025-01-23 01:07:50 -06:00
  • 5245729e33 vulkan: fix diag_mask_inf (#11323) b4532 Jeff Bolz 2025-01-23 01:01:17 -06:00
  • 6152129d05 main : update README documentation for batch size (#11353) Diego Devesa 2025-01-22 19:22:20 +01:00
  • 16d3df7ab0 readme : add plugin links (#11355) Georgi Gerganov 2025-01-22 19:44:26 +02:00
  • 12c2bdf2de server : fix draft context not being released (#11354) b4529 Diego Devesa 2025-01-22 17:44:40 +01:00
  • c64d2becb1 minja: sync at 0f5f7f2b37 (#11352) b4528 Olivier Chafik 2025-01-22 16:16:27 +00:00
  • 96f4053934 Adding logprobs to /v1/completions (#11344) b4527 Jiří Podivín 2025-01-22 12:51:32 +01:00
  • a94f3b2727 common: utils to split / join / repeat strings (from json converter) (#11342) b4526 Olivier Chafik 2025-01-22 09:51:44 +00:00
  • 3e3357fd77 llava : support Minicpm-omni (#11289) b4525 tc-mb 2025-01-22 15:35:48 +08:00
  • 6171c9d258 Add Jinja template support (#11016) b4524 Olivier Chafik 2025-01-21 13:18:51 +00:00
  • e28245f35f export-lora : fix tok_embd tensor (#11330) b4523 Xuan Son Nguyen 2025-01-21 14:07:12 +01:00
  • 6da5bec81c rpc : better caching of the base buffer pointer (#11331) b4522 Radoslav Gerganov 2025-01-21 15:06:41 +02:00
  • 2e2f8f093c linenoise.cpp refactoring (#11301) b4521 Eric Curtin 2025-01-21 09:32:35 +00:00
  • 2139667ec4 metal : fix out-of-bounds write (#11314) b4520 Georgi Gerganov 2025-01-21 08:48:13 +02:00
  • 80d0d6b4b7 common : add -hfd option for the draft model (#11318) b4519 Georgi Gerganov 2025-01-20 22:29:43 +02:00
  • aea8ddd516 vulkan: fix coopmat2 validation failures (#11284) b4518 Jeff Bolz 2025-01-20 10:38:32 -06:00
  • c9e7cbb08b safer jinja llama_chat_templates struct xsn/tmp_jinja_safer Xuan Son Nguyen 2025-01-20 16:58:29 +01:00
  • 9f7add1cde examples : fix add_special conditions (#11311) Georgi Gerganov 2025-01-20 16:36:08 +02:00
  • 90d987b105 mmap: add include for cerrno (#11296) b4516 Christopher Nielsen 2025-01-20 09:02:43 -05:00
  • a4251edd6f cmake: fix shell command quoting in build-info script (#11309) Michael Podvitskiy 2025-01-20 15:02:15 +01:00
  • ec7f3ac9ab llama : add support for Deepseek-R1-Qwen distill model (#11310) b4514 Xuan Son Nguyen 2025-01-20 14:35:07 +01:00
  • ef6dada60c cont : fix whitespaces (#11305) b4513 Georgi Gerganov 2025-01-20 09:29:32 +02:00
  • ae3c1db2f9 llama : re-add LLM_ARCH_PHIMOE (#11305) b4512 Kyle Bruene 2025-01-20 01:21:01 -06:00
  • 92bc493917 tests : increase timeout when sanitizers are enabled (#11300) Georgi Gerganov 2025-01-19 20:22:30 +02:00
  • b9daaffe02 simple-chat : fix BOS being added to each message (#11278) b4510 Georgi Gerganov 2025-01-19 18:12:09 +02:00
  • 90a0349349 recommended way to check if the version is 0.3, as requested by ngxson cedo/add-outetts-v0.3 LostRuins Concedo 2025-01-19 21:43:59 +08:00
  • 99487b57d4 SYCL: Introducing memory host pool (#11251) b4509 Nicolò Scipione 2025-01-19 14:33:34 +01:00
  • cc50356470 minja: fix vigogne (https://github.com/google/minja/pull/22) ochafik 2025-01-18 17:55:04 +00:00
  • e3c475cd12 Disable jinja test that has a cryptic windows failure ochafik 2025-01-18 14:55:27 +00:00
  • a1649cc13f Adding linenoise.cpp to llama-run (#11252) b4508 Eric Curtin 2025-01-18 14:42:31 +00:00
  • 4dd34ff831 cmake : add sanitizer flags for llama.cpp (#11279) Georgi Gerganov 2025-01-18 16:18:15 +02:00
  • f30f099228 server : implement cancellable request (#11285) b4506 Xuan Son Nguyen 2025-01-18 14:12:05 +01:00
  • 0e74c9dabe Add missing optional include to server.cpp ochafik 2025-01-18 11:58:00 +00:00
  • fc60802b6e Rm unused optional include ochafik 2025-01-18 11:35:54 +00:00
  • f26c874179 scripts : restore hf.sh (#11288) Georgi Gerganov 2025-01-18 13:18:32 +02:00
  • b5486956ff added rudimentary support for outetts v0.3 500m and 1b models Concedo 2025-01-18 18:48:49 +08:00
  • 5074e6fecd Fix copy elision warning ochafik 2025-01-18 10:48:03 +00:00
  • 33322e823e Flush stdout in chat template before potential crash ochafik 2025-01-18 10:38:21 +00:00
  • e63520f37a Forward decl minja::chat_template to avoid eager json dep ochafik 2025-01-18 10:37:56 +00:00
  • 6390a998bf tts : add guide tokens support (#11186) b4504 LostRuins Concedo 2025-01-18 18:20:57 +08:00
  • ba421dd04e gguf-test: tensor data comparison jg/llama-sanitize Johannes Gäßler 2025-01-18 09:49:47 +01:00
  • 44e18ef939 vulkan: fix coopmat2 flash attention for non-contiguous inputs (#11281) b4503 Jeff Bolz 2025-01-18 02:26:50 -06:00
  • ee1e10e21e Normalize newlines in test-chat-templates for windows tests ochafik 2025-01-18 02:52:40 +00:00
  • d5fa351a24 Revert LLAMA_CHATML_TEMPLATE refactor ochafik 2025-01-18 01:04:12 +00:00
  • 81c0d437a5 Attempt to fix linkage of LLAMA_CHATML_TEMPLATE ochafik 2025-01-18 00:56:19 +00:00
  • 40db78963b Merge remote-tracking branch 'origin/master' into jinja ochafik 2025-01-18 00:44:37 +00:00
  • b75d0622e4 Refactor common_chat_* functions to accept minja template + use_jinja option ochafik 2025-01-18 00:43:38 +00:00
  • 7000623c00 tests : fix gguf context use in same_tensor_data Georgi Gerganov 2025-01-17 16:26:12 +02:00
  • e872097c35 cmake : apply only sanitizer flags at top level Georgi Gerganov 2025-01-17 15:48:39 +02:00
  • 9d1b20ad1a cmake : move llama.cpp compile flags to top level lists Georgi Gerganov 2025-01-17 15:40:03 +02:00
  • 9a03bc811f cmake : move sanitizer flags to llama_add_compile_flags Georgi Gerganov 2025-01-17 15:33:36 +02:00
  • ce293d837c tests : fix compile warnings Georgi Gerganov 2025-01-17 15:22:36 +02:00
  • 72dc7bff4d cmake : add sanitizer flags for llama.cpp Georgi Gerganov 2025-01-17 15:18:24 +02:00
  • 3edfa7d375 llama.android: add field formatChat to control whether to parse special tokens when send message (#11270) b4502 codezjx 2025-01-17 20:57:56 +08:00
  • 667d72846c rpc : early register backend devices (#11262) b4501 Radoslav Gerganov 2025-01-17 10:57:09 +02:00
  • a133566d34 vocab : fix double-eos check (#11273) b4500 Georgi Gerganov 2025-01-17 09:28:00 +02:00
  • 960ec65273 llama : fix deprecation message: vocabable -> vocab (#11269) b4499 David Renshaw 2025-01-17 02:12:01 -05:00
  • 7a689c415e README : added kalavai to infrastructure list (#11216) musoles 2025-01-17 00:10:49 +00:00
  • bd38ddea01 vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (#11166) b4497 Jeff Bolz 2025-01-16 15:47:10 -06:00
  • 466300fe14 vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206) Jeff Bolz 2025-01-16 15:23:49 -06:00
  • 206bc53422 vulkan: optimize coopmat2 q2_k dequant function (#11130) Jeff Bolz 2025-01-16 15:16:39 -06:00
  • 4dbc8b9cb7 llama : add internlm3 support (#11233) RunningLeon 2025-01-17 02:10:38 +08:00
  • 9c8dcefe17 CUDA: backwards pass for misc. ops, add tests (#11257) b4493 Johannes Gäßler 2025-01-16 16:43:38 +01:00
  • 681149ced2 llama : add llama_model_load_from_splits (#11255) Xuan Son Nguyen 2025-01-16 13:54:08 +01:00
  • c67cc9837d ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227) b4491 fj-y-saito 2025-01-16 18:11:49 +09:00
  • adc5dd92e8 vulkan: scale caching for k quants + misc fixes (#11081) Eve 2025-01-15 19:50:13 +00:00
  • f11cfdfd7f ci : use -no-cnv in gguf-split tests (#11254) Georgi Gerganov 2025-01-15 18:28:35 +02:00
  • 492eaad571 ci : change python3 -> python gg/ci-python Georgi Gerganov 2025-01-15 16:18:56 +02:00
  • 1d8504338e fix: ggml: fix vulkan-shaders-gen build (#10448) b4488 Junil Kim 2025-01-15 22:17:42 +09:00
  • 432df2d5f9 RoPE: fix back, CUDA support for back + noncont. (#11240) b4487 Johannes Gäßler 2025-01-15 12:51:37 +01:00
  • 0ccd7f3eb2 examples : add embd_to_audio to tts-outetts.py [no ci] (#11235) Daniel Bevenius 2025-01-15 05:44:38 +01:00
  • f446c2cf6a SYCL: Add gated linear attention kernel (#11175) b4485 Akarshan Biswas 2025-01-15 08:50:17 +05:30
  • b4d92a59a2 ci : add -no-cnv for tests (#11238) Xuan Son Nguyen 2025-01-14 15:42:23 +01:00
  • 3ed670b6dd Merge remote-tracking branch 'origin/master' into jinja Olivier Chafik 2025-01-14 12:17:07 +00:00
  • bbf3e55e35 vocab : add dummy tokens for "no_vocab" type (#11231) Georgi Gerganov 2025-01-14 12:54:58 +02:00
  • c5bf0d1bd7 server : Improve code snippets direction between RTL text (#11221) ebraminio 2025-01-14 14:09:33 +03:30
  • 091592d758 Refactor test-chat-template.cpp (#11224) b4481 Olivier Chafik 2025-01-14 10:16:41 +00:00
  • 44d1e796d0 sync : ggml Georgi Gerganov 2025-01-14 10:39:42 +02:00
  • 0cf9a06799 vocab : minor [no ci] gg/vocab-fix-no-vocab Georgi Gerganov 2025-01-14 10:36:18 +02:00
  • 69fc940d9a vocab : add dummy tokens for "no_vocab" type Georgi Gerganov 2025-01-14 10:26:47 +02:00
  • a4f3f5d8e6 scripts : sync gguf (cont) Georgi Gerganov 2025-01-14 09:40:15 +02:00
  • 48e1ae0e61 scripts : sync gguf Georgi Gerganov 2025-01-14 09:36:58 +02:00
  • d00a80e89d scripts : sync opencl Georgi Gerganov 2025-01-14 09:19:58 +02:00
  • 1b3bb7eeb9 Update arg.cpp Olivier Chafik 2025-01-14 00:07:18 +00:00
  • 4daae0bfc7 Update run.cpp ochafik 2025-01-13 23:26:31 +00:00
  • a57bb94e29 Update test_chat_completion.py ochafik 2025-01-13 23:18:03 +00:00
  • b7e21710c4 Update utils.py ochafik 2025-01-13 23:11:57 +00:00
  • b4083e4155 Test chat_template in e2e test ochafik 2025-01-13 23:10:52 +00:00
  • a6afb2735f Update common_chat_format_example to use minja template wrapper ochafik 2025-01-13 22:57:35 +00:00
  • c04c50e40c Merge remote-tracking branch 'origin/master' into jinja ochafik 2025-01-13 22:26:13 +00:00
  • 8dd4f334a4 Add --jinja to llama-run ochafik 2025-01-13 22:07:49 +00:00
  • 18f257bf1a Fix deprecation ochafik 2025-01-13 21:30:48 +00:00
  • 7c84ebc231 Test templates w/ minja ochafik 2025-01-13 21:23:30 +00:00
  • 1aac99ad54 Refactor test-chat-template ochafik 2025-01-13 20:11:27 +00:00
  • 78861a3eb2 Wire LLM_KV_TOKENIZER_CHAT_TEMPLATE_N in llama_model_chat_template ochafik 2025-01-13 19:58:15 +00:00
  • cb72cf1fc3 Merge remote-tracking branch 'origin/master' into jinja ochafik 2025-01-13 19:56:27 +00:00