upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-29 22:20:58 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • fab5d30ff6 llama : add .clang-format file (#10415) b4143 Diego Devesa 2024-11-20 12:57:53 +01:00
  • 8fd4b7fa29 vulkan: copy iq4_nl LUT into shared memory (#10409) b4142 Jeff Bolz 2024-11-20 01:40:18 -06:00
  • 1bacb9f625 vulkan: further optimize mul_mat_vec using larger loads (#10387) b4141 Jeff Bolz 2024-11-20 01:11:00 -06:00
  • ad21c9e1f1 update rel to 4040 (#10395) Neo Zhang Jianyu 2024-11-20 13:54:25 +08:00
  • 3952a221af Fix missing file renames in Makefile due to changes in commit ae8de6d50a (#10413) b4139 Anthony Van de Gejuchte 2024-11-19 23:18:17 +01:00
  • 42ae10bbcd add cmake rvv support (#10411) b4138 haopeng 2024-11-20 04:10:31 +08:00
  • 9fe0fb0626 sync : ggml b4137 Georgi Gerganov 2024-11-19 19:15:50 +02:00
  • 611fabd792 metal : fox offset integer overflows in im2col (ggml/1015) Plamen Minev 2024-11-18 15:02:27 +02:00
  • 12b0ad953a metal : add GGML_UNARY_OP_ELU kernel (ggml/1018) PAB 2024-11-18 10:02:49 +01:00
  • 342397dc7e cmake: force MSVC compiler charset to utf-8 (#9989) b4134 蕭澧邦 2024-11-20 01:42:00 +08:00
  • 2a11b6b094 Add required ggml-base and backend libs to cmake pkg (#10407) b4133 bandoti 2024-11-19 12:10:30 -04:00
  • 3ee6382d48 cuda : fix CUDA_FLAGS not being applied (#10403) b4132 Diego Devesa 2024-11-19 14:29:38 +01:00
  • 8e752a777b llama : add check for KV cache shifts (#10401) b4131 Georgi Gerganov 2024-11-19 13:29:26 +02:00
  • a88ad007de llama : add OLMo November 2024 support (#10394) b4130 Shane A 2024-11-19 01:04:08 -08:00
  • 2a1507c162 sycl : Add option to set the SYCL architecture for all targets (#10266) b4129 Romain Biessy 2024-11-19 09:02:23 +01:00
  • b3e585988f vulkan: Optimize soft_max (#10301) b4128 Jeff Bolz 2024-11-19 01:25:17 -06:00
  • 557924f222 sycl: Revert MUL_MAT_OP support changes (#10385) b4127 Alberto Cabrera Pérez 2024-11-19 00:50:04 +00:00
  • d3481e6316 cuda : only use native when supported by cmake (#10389) b4126 Diego Devesa 2024-11-18 18:43:40 +01:00
  • 531cb1c233 Skip searching root path for cross-compile builds (#10383) bandoti 2024-11-18 11:23:58 -04:00
  • f139d2ea61 vulkan: remove use of null initializer (#10372) Jeff Bolz 2024-11-18 08:28:42 -06:00
  • 2eb76b2a5e flake.lock: Update (#10346) Georgi Gerganov 2024-11-18 16:08:20 +02:00
  • 9b75f03cd2 Vulkan: Fix device info output format specifiers (#10366) b4122 0cc4m 2024-11-18 11:02:43 +01:00
  • 75207b3a88 docker: use GGML_NATIVE=OFF (#10368) Johannes Gäßler 2024-11-18 00:21:53 +01:00
  • 76e9e58b78 CUDA: fix MMV kernel being used for FP16 src1 (#10357) b4120 Johannes Gäßler 2024-11-17 23:20:42 +01:00
  • ce2e59ba10 CMake: fix typo in comment [no ci] (#10360) Johannes Gäßler 2024-11-17 12:59:38 +01:00
  • be5caccef9 llama : only use default buffer types for the KV cache (#10358) b4118 Diego Devesa 2024-11-17 12:25:45 +01:00
  • 20a780c7b6 gitignore : ignore local run scripts [no ci] Georgi Gerganov 2024-11-17 13:12:22 +02:00
  • cf32a9b93a metal : refactor kernel args into structs (#10238) Georgi Gerganov 2024-11-17 11:23:01 +02:00
  • a43178299c ggml : fix undefined reference to 'getcpu' (#10354) b4115 FirstTimeEZ 2024-11-17 21:39:22 +13:00
  • c3ea58aca4 CUDA: remove DMMV, consolidate F16 mult mat vec (#10318) b4114 Johannes Gäßler 2024-11-17 09:09:55 +01:00
  • 467576b6cc CMake: default to -arch=native for CUDA build (#10320) b4113 Johannes Gäßler 2024-11-17 09:06:34 +01:00
  • eda7e1d4f5 ggml : fix possible buffer use after free in sched reserve (#9930) b4112 Diego Devesa 2024-11-17 07:31:17 +01:00
  • 24203e9dd7 ggml : inttypes.h -> cinttypes (#0) b4111 Georgi Gerganov 2024-11-16 23:40:39 +02:00
  • 5d9e59979c ggml : adapt AMX to tensor->grad removal (#0) Georgi Gerganov 2024-11-16 21:38:01 +02:00
  • a4200cafad make : add ggml-opt (#0) Georgi Gerganov 2024-11-16 21:35:31 +02:00
  • 84274a10c3 tests : remove test-grad0 Georgi Gerganov 2024-11-16 21:34:03 +02:00
  • 68fcb4759c ggml : fix compile warnings (#0) Georgi Gerganov 2024-11-16 21:32:41 +02:00
  • 8a43e940ab ggml: new optimization interface (ggml/988) Johannes Gäßler 2024-11-16 22:17:59 +02:00
  • 5c9a8b22b1 scripts : update sync Georgi Gerganov 2024-11-16 22:16:04 +02:00
  • 0fff7fd798 docs : vulkan build instructions to use git bash mingw64 (#10303) FirstTimeEZ 2024-11-17 12:29:18 +13:00
  • 4e54be0ec6 llama/ex: remove --logdir argument (#10339) b4103 Johannes Gäßler 2024-11-16 23:00:41 +01:00
  • db4cfd5dbc llamafile : fix include path (#0) b4102 Georgi Gerganov 2024-11-16 17:58:56 +02:00
  • 8ee0d09ae6 make : auto-determine dependencies (#0) Georgi Gerganov 2024-11-16 17:58:32 +02:00
  • bcdb7a2386 server: (web UI) Add samplers sequence customization (#10255) b4100 MaggotHATE 2024-11-16 18:26:54 +05:00
  • f7b0233eca wip gg/logits-slowdown Georgi Gerganov 2024-11-16 10:04:49 +02:00
  • f245cc28d4 scripts : fix missing key in compare-llama-bench.py (#10332) Georgi Gerganov 2024-11-16 10:32:50 +02:00
  • 772703c8ff vulkan: Optimize some mat-vec mul quant shaders (#10296) b4098 Jeff Bolz 2024-11-16 00:26:57 -06:00
  • dd3a6ce9f8 vulkan : add cmake preset debug/release (#10306) FirstTimeEZ 2024-11-16 14:59:33 +13:00
  • 1e58ee1318 ggml : optimize Q4_0 into Q4_0_X_Y repack (#10324) b4096 Dan Johansson 2024-11-16 01:53:37 +01:00
  • 89e4caaaf0 llama : save number of parameters and the size in llama_model (#10286) b4095 FirstTimeEZ 2024-11-16 13:42:13 +13:00
  • 74d73dc85c Make updates to fix issues with clang-cl builds while using AVX512 flags (#10314) b4094 Srihari-mcw 2024-11-16 02:57:00 +05:30
  • 4047be74da scripts: update compare-llama-bench.py (#10319) b4093 Johannes Gäßler 2024-11-15 21:19:03 +01:00
  • 883d206fbd ggml : fix some build issues b4092 slaren 2024-11-15 20:20:54 +01:00
  • 09ecbcb596 cmake : fix ppc64 check (whisper/0) b4091 Georgi Gerganov 2024-11-15 15:35:22 +02:00
  • 3225008973 ggml : vulkan logs (whisper/2547) thewh1teagle 2024-11-15 15:33:53 +02:00
  • cbf5541a82 sync : ggml Georgi Gerganov 2024-11-15 15:31:16 +02:00
  • 18429220bd AVX BF16 and single scale quant optimizations (#10212) b4088 Eve 2024-11-15 11:47:58 +00:00
  • f0204a0ec7 ci: build test musa with cmake (#10298) b4087 R0CKSTAR 2024-11-15 19:47:25 +08:00
  • 57f8355b29 sycl: Update Intel docker images to use DPC++ 2025.0 (#10305) Romain Biessy 2024-11-15 12:10:45 +01:00
  • 9901068ac7 server : (web UI) add copy button for code block, fix api key (#10242) b4085 Xuan Son Nguyen 2024-11-15 05:48:49 -04:00
  • 231f9360d9 cann: dockerfile and doc adjustment (#10302) Chenguang Li 2024-11-15 15:09:35 +08:00
  • 4802ad350b scripts : fix regex in sync [no ci] Georgi Gerganov 2024-11-15 08:38:43 +02:00
  • 5a54af4d4f sycl: Use syclcompat::dp4a (#10267) b4082 Romain Biessy 2024-11-15 04:09:12 +01:00
  • 1607a5e5b0 backend cpu: add online flow for aarch64 Q4_0 GEMV/GEMM kernels (#9921) b4081 Charles Xu 2024-11-15 01:28:50 +01:00
  • ae8de6d50a ggml : build backends as libraries (#10256) b4080 Diego Devesa 2024-11-14 18:04:35 +01:00
  • 4a8ccb37ad CUDA: no -sm row for very small matrices (#10185) b4079 Johannes Gäßler 2024-11-14 13:00:15 +01:00
  • 2a82891a85 speculative : fix out-of-bounds access (#10289) b4078 Georgi Gerganov 2024-11-14 11:44:15 +02:00
  • 5e6dad9322 speculative : experimenting with Qwen2.5 gg/speculative-experiments Georgi Gerganov 2024-11-14 11:31:31 +02:00
  • 33bdee667e speculative : fix out-of-bounds access gg/speculative-fix-oob Georgi Gerganov 2024-11-14 11:23:45 +02:00
  • af148c9386 vulkan: Optimize binary ops (#10270) b4077 Jeff Bolz 2024-11-13 23:22:55 -06:00
  • 66798e42fb vulkan: Use macros to make the mat mul pipeline creation more concise (#10259) b4076 Jeff Bolz 2024-11-13 14:59:47 -06:00
  • fb4a0ec083 llama : propagate the results of graph_compute (#9525) b4075 Michael Podvitskiy 2024-11-13 20:00:35 +02:00
  • 5ea926dad7 sync : ggml Georgi Gerganov 2024-11-13 18:11:54 +02:00
  • 1ee9eea094 docs : update bindings list (#10261) b4073 Small Grass Forest 2024-11-13 19:17:10 +08:00
  • ff7fb670d0 server : add missing docs (#10269) Alexey Parfenov 2024-11-13 11:16:30 +00:00
  • 0e712a5acb server : fix incorrect res in validate_model_chat_template (#10272) b4071 Jhen-Jie Hong 2024-11-13 19:15:23 +08:00
  • a0ec17b32e metadata: Detailed Dataset Authorship Metadata (#8875) Brian 2024-11-13 21:10:38 +11:00
  • 2e82ffa4af sycl : Fixes to broken builds and test-backend-ops (#10257) b4069 Alberto Cabrera Pérez 2024-11-13 09:40:57 +00:00
  • 80dd7ff22f vulkan: Optimize contiguous copies (#10254) b4068 Jeff Bolz 2024-11-13 00:58:57 -06:00
  • 8c1b186cb5 metal : minor Q4_0 optimization gg/metal-q4_0-opt Georgi Gerganov 2024-11-12 15:30:51 +02:00
  • 86ed72d20c ggml : add ggml-metal-impl.h Georgi Gerganov 2024-11-10 18:29:09 +02:00
  • 63bab93c48 metal : add TODOs for rest of ops Georgi Gerganov 2024-11-10 17:56:12 +02:00
  • 964206a780 metal : GGML_OP_NORM Georgi Gerganov 2024-11-10 17:17:18 +02:00
  • e9ecd5d4de metal : GGML_OP_RMS_NORM Georgi Gerganov 2024-11-10 15:31:43 +02:00
  • 647a7044f5 metal : GGML_OP_CPY Georgi Gerganov 2024-11-10 13:55:26 +02:00
  • f46f710ca6 metal : GGML_OP_REPEAT Georgi Gerganov 2024-11-10 13:21:59 +02:00
  • 3250c98bf6 metal : GGML_OP_ADD, GGML_OP_SUB, GGML_OP_MUL, GGML_OP_DIV Georgi Gerganov 2024-11-10 13:16:54 +02:00
  • 9058c51d9d metal : GGML_OP_CONCAT Georgi Gerganov 2024-11-10 13:03:25 +02:00
  • bb821e4854 cont : int safety + register optimizations Georgi Gerganov 2024-11-10 11:05:10 +02:00
  • c5cf1d74f0 cont : mul mm id Georgi Gerganov 2024-11-10 10:32:15 +02:00
  • 15a7105967 cont : thread counters style Georgi Gerganov 2024-11-10 09:57:41 +02:00
  • cacc4c225f cont : shmem style Georgi Gerganov 2024-11-10 09:45:06 +02:00
  • a1a201c1a9 cont : use char ptr Georgi Gerganov 2024-11-10 09:26:53 +02:00
  • c81640a5fc cont : args is first argument Georgi Gerganov 2024-11-10 08:47:30 +02:00
  • b65e4c1e10 cont : pass by reference Georgi Gerganov 2024-11-10 08:10:22 +02:00
  • c59a13d93f cont : mul mat vec Georgi Gerganov 2024-11-09 22:56:39 +02:00
  • 7670809ad4 metal : mul mat struct (wip) Georgi Gerganov 2024-11-09 17:54:40 +02:00
  • 4fd6fc5ab8 metal : cont + avoid potential int overflow [no ci] Georgi Gerganov 2024-11-09 16:39:36 +02:00
  • 9e07bcc06e metal : fattn args Georgi Gerganov 2024-11-09 16:09:31 +02:00
  • 1198ae7749 metal : add kernel arg structs (wip) Georgi Gerganov 2024-11-09 15:28:55 +02:00