upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-30 14:40:48 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 7a8961fff5 delete redundant Eddie-Wang1120 2024-06-14 12:30:27 +08:00
  • 172c825684 rpc : fix ggml_backend_rpc_supports_buft() (#7918) b3145 Radoslav Gerganov 2024-06-13 15:18:44 +03:00
  • 18133cab40 Revert "use the correct SYCL context for host USM allocations" codeplay/revert-host-alloc Joe Todd 2024-06-13 12:08:27 +01:00
  • abd7c7b8c2 Formatting Joe Todd 2024-06-13 10:36:05 +01:00
  • 0c0f3f0000 [SYCL] Update unsupported ops Joe Todd 2024-06-13 10:33:34 +01:00
  • 9b81b57239 [SYCL] unify rope norm/neox Joe Todd 2024-06-13 10:30:43 +01:00
  • a55eb1bf0f readme : Remove outdated instructions from README.md (#7914) [no ci] Galunid 2024-06-13 09:42:41 +02:00
  • f578b86b21 move BLAS to a separate backend (#6210) b3143 slaren 2024-06-13 03:11:35 +02:00
  • 1c641e6aac build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809) Olivier Chafik 2024-06-13 00:41:52 +01:00
  • 33425a7e1e mamba : fix non-contiguous usage of ggml_silu Francis Couture-Harpin 2024-06-12 12:57:02 -04:00
  • ff794f5535 Merge branch 'master' into compilade/refactor-kv-cache Francis Couture-Harpin 2024-06-12 12:10:29 -04:00
  • 963552903f CUDA: fix broken oob check for FA vec f32 kernel (#7904) b3141 Johannes Gäßler 2024-06-12 17:41:51 +02:00
  • 46325233c9 Revert 7777 revert-7777-host-usm-context-fix Aidan 2024-06-12 16:21:41 +01:00
  • a9cae48003 tests : add non-cont unary tests (#7857) b3140 Georgi Gerganov 2024-06-12 16:00:22 +03:00
  • 8412561c4b ggml : update unary asserts and "supports_op" gg/unary-non-cont Georgi Gerganov 2024-06-10 16:17:51 +03:00
  • ebf95c2225 tests : add non-cont unary tests Georgi Gerganov 2024-06-10 15:46:54 +03:00
  • bfaa676b08 ggml : improve ggml_is_contiguous logic (#7856) b3139 Georgi Gerganov 2024-06-12 15:24:20 +03:00
  • cd026b48ef ggml : support more contiguous cases gg/ggml-cont Georgi Gerganov 2024-06-12 15:12:32 +03:00
  • 704a35b183 server : restore numeric prompts (#7883) b3138 Georgi Gerganov 2024-06-12 14:42:29 +03:00
  • dcf752707d update intel docker oneapi-basekit to 2024.1.1-devel-ubuntu22.04 (#7894) Meng, Hengyu 2024-06-12 17:05:35 +08:00
  • 5e5eee7b44 fix whitespace Eddie-Wang1120 2024-06-12 16:25:46 +08:00
  • f395dd9ca0 change table name Eddie-Wang1120 2024-06-12 14:28:24 +08:00
  • c0cd08d45e Merge branch 'ggerganov:master' into bitnet Eddie-Wang 2024-06-12 14:12:27 +08:00
  • 43d8d4bf9e examples : replace llama_kv_cache_seq_* with llama_past_seq_* Francis Couture-Harpin 2024-06-10 14:44:42 -04:00
  • f2b5764beb Fix a typo and add Fedora 40 pacakge to install for Vulkan (#7794) [no ci] Patrice Ferlet 2024-06-12 03:18:16 +02:00
  • 73bac2b11d vulkan: select only one device for single gpu with multiple drivers (#7582) b3135 k.h.lai 2024-06-12 03:26:05 +08:00
  • ef52d1d16a Update Vulkan RoPE implementation (#7818) b3134 0cc4m 2024-06-11 21:20:29 +02:00
  • 14f83526cd fix broken link in pr template (#7880) [no ci] Deven Mistry 2024-06-11 12:18:58 -04:00
  • 6fe42d073f github: move PR template to .github/ root (#7868) Brian 2024-06-12 00:43:41 +10:00
  • 148995e5e5 llama-bench: more compact markdown tables (#7879) b3131 Johannes Gäßler 2024-06-11 14:45:40 +02:00
  • 4bfe50f741 tests : check the Python version (#7872) b3130 Georgi Gerganov 2024-06-11 10:10:20 +03:00
  • bdcb8f4222 CUDA: int8 tensor cores for MMQ (q4_K, q5_K, q6_K) (#7860) Johannes Gäßler 2024-06-11 08:26:07 +02:00
  • 4356325ef5 tests : check the Python version gg/check-python-version Georgi Gerganov 2024-06-11 09:02:52 +03:00
  • c2ce6c47e4 fix CUDA CI by using a windows-2019 image (#7861) slaren 2024-06-11 07:59:20 +02:00
  • 2322e9db9a Merge branch 'ggerganov:master' into bitnet Eddie-Wang 2024-06-11 10:50:12 +08:00
  • de1d5073e4 remove unused Eddie-Wang1120 2024-06-11 10:23:20 +08:00
  • b61eb9644d json: refine constraint for whitespace to avoid runaways yet allow pretty print (#7866) Olivier Chafik 2024-06-11 02:22:57 +01:00
  • 396b18dfec json: document schema conversion in GBNF readme, align manual grammar examples & converters (#7841) Olivier Chafik 2024-06-11 01:00:30 +01:00
  • 864a99e7a0 cmake : fix CMake requirement for CUDA (#7821) Jared Van Bortel 2024-06-10 18:32:10 -04:00
  • f2a029bd9d ggml : improve ggml_is_contiguous logic Georgi Gerganov 2024-06-10 17:04:14 +03:00
  • fd5ea0f897 ci : try win-2019 on server windows test (#7854) slaren 2024-06-10 14:18:41 +02:00
  • c28a83902c examples : remove --instruct remnants (#7846) Georgi Gerganov 2024-06-10 15:00:15 +03:00
  • d9da0e4986 server : improve "prompt" handling (#7847) Georgi Gerganov 2024-06-10 14:59:55 +03:00
  • 1f0dabda8d CUDA: use tensor cores for MMQ (#7676) Johannes Gäßler 2024-06-10 11:45:13 +02:00
  • 4bb03cade0 ci : disable server-windows workflow gg/server-debug-win Georgi Gerganov 2024-06-10 12:30:18 +03:00
  • af4ae502dd use the correct SYCL context for host USM allocations (#7777) Ben Ashbaugh 2024-06-10 02:21:31 -07:00
  • 9e4d62e6ab server : improve "prompt" handling gg/server-fix-prompt Georgi Gerganov 2024-06-10 09:12:04 +03:00
  • 956bb14595 examples : remove --instruct remnants gg/remove-instruct Georgi Gerganov 2024-06-10 08:37:47 +03:00
  • c0fd4df883 fix merge Eddie-Wang 2024-06-10 03:07:38 +00:00
  • 841c903ff9 Merge branch 'ggerganov:master' into bitnet Eddie-Wang 2024-06-10 10:51:47 +08:00
  • abd798d70f fix code Eddie-Wang 2024-06-10 02:50:14 +00:00
  • 10ceba354a flake.lock: Update (#7838) Georgi Gerganov 2024-06-10 02:04:50 +03:00
  • e95beeb1fc imatrix : handle partial entries (#7833) Georgi Gerganov 2024-06-09 20:19:35 +03:00
  • 65ac3a3627 fix Eddie-Wang1120 2024-06-10 00:06:09 +08:00
  • 344467f2b8 fix code Eddie-Wang1120 2024-06-10 00:00:52 +08:00
  • 57bf62ce7c docs: Added initial PR template with directions for doc only changes and squash merges [no ci] (#7700) Nicolás Pérez 2024-06-09 11:24:29 -04:00
  • 97d22be58c fix codestyle Eddie-Wang1120 2024-06-09 21:22:50 +08:00
  • 3a0f8b0697 clean code 2 root 2024-06-09 21:15:02 +08:00
  • 1c5a8b7fec clean code root 2024-06-09 20:22:03 +08:00
  • 3e2ee44315 server: do not remove whitespace at the start of a completion chunk (#7830) mgroeber9110 2024-06-09 12:50:35 +02:00
  • dbee0a86c1 move i2 to quantize root 2024-06-09 18:20:32 +08:00
  • 42b53d192f CUDA: revise q8_1 data layout for mul_mat_q (#7824) Johannes Gäßler 2024-06-09 09:42:25 +02:00
  • 2decf57bc6 convert-hf : set the model name based on cli arg, if present (#7693) sasha0552 2024-06-09 06:39:25 +00:00
  • 5795b94182 convert-hf : match model part name prefix and suffix (#7687) compilade 2024-06-08 22:47:25 -04:00
  • ca09085593 move i2s to quantize v1 Eddie-Wang 2024-06-09 02:43:38 +00:00
  • ed9f252118 gguf-py : decouple adding metadata from writing in GGUFWriter (#7827) compilade 2024-06-08 22:34:29 -04:00
  • fe1e3917cf Revert "[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)" (#7808) slaren 2024-06-09 01:43:39 +02:00
  • 372482dffe llama : rename llama_cache to llama_past Francis Couture-Harpin 2024-06-08 17:58:40 -04:00
  • 6840ac0bca Merge branch 'master' into compilade/refactor-kv-cache Francis Couture-Harpin 2024-06-08 17:30:49 -04:00
  • d4d915d351 url: save -mu downloads to new cache location (#7826) Olivier Chafik 2024-06-08 20:21:08 +01:00
  • 4e1ab50628 finish bitnet i2 e2e Eddie-Wang 2024-06-08 12:44:13 +00:00
  • 7a16ce7db2 server : smart slot selection using Longest Common Prefix (#7728) sasha0552 2024-06-08 07:50:31 +00:00
  • da799b4189 vulkan : reuse parent extra for views (#7806) slaren 2024-06-07 19:47:49 +02:00
  • c00fad71e5 gguf-split : change binary multi-byte units to decimal (#7803) Christian Zhou-Zheng 2024-06-07 08:56:01 -04:00
  • 27615f5ab2 cmake : fix BUILD_SHARED_LIBS=ON build (#7784) intelmatt 2024-06-07 05:15:07 -07:00
  • 2a01a7ce0d remove unsed Eddie-Wang1120 2024-06-07 18:29:59 +08:00
  • 7027b27d76 server: update cache_prompt documentation [no ci] (#7745) Johannes Gäßler 2024-06-07 11:15:49 +02:00
  • a5cabd7649 server : do not get prompt in infill mode (#7286) woodx 2024-06-07 15:09:45 +08:00
  • 5e59660173 finish f16 hf bitnet e2e Eddie-Wang1120 2024-06-07 14:42:52 +08:00
  • d5c938cd77 [SYCL] fix softmax r2r result wrong issue (#7811) pengxin99 2024-06-07 14:28:26 +08:00
  • c9ee7118d5 check for nans in imatrix and quantize (#7807) slaren 2024-06-07 08:01:29 +02:00
  • d857e5192e quantize : check imatrix for nan/inf values sl/detect-imatrix-nan slaren 2024-06-06 22:43:22 +02:00
  • e2ea071cb0 imatrix : detect nan/inf values slaren 2024-06-06 22:43:01 +02:00
  • ee459f40f6 server : fix --threads-http arg (#7801) Georgi Gerganov 2024-06-06 19:19:59 +03:00
  • 731e7528be server : fix --threads-http arg gg/http-threads Georgi Gerganov 2024-06-06 16:37:12 +03:00
  • f83351f9a6 imatrix : migrate to gpt_params (#7771) Georgi Gerganov 2024-06-06 16:30:58 +03:00
  • ad675e1c67 Added support for . (any character) token in grammar engine. (#6467) Clint Herron 2024-06-06 06:08:52 -07:00
  • a143c04375 README minor fixes (#7798) [no ci] Mattheus Chediak 2024-06-06 09:17:54 -03:00
  • 55b2d0849d grammars: x{min,max} repetition operator (#6640) Olivier Chafik 2024-06-06 10:07:06 +01:00
  • f5d7b268ec llama : add jina v2 base code (#7596) Joan Fontanals 2024-06-06 09:22:41 +02:00
  • 2d08b7fbb4 docker : build only main and server in their images (#7782) slaren 2024-06-06 07:19:49 +02:00
  • d67caea0d6 docker : add openmp lib (#7780) slaren 2024-06-06 07:17:21 +02:00
  • 1f2e0ee012 finish bitnet e2e Eddie-Wang1120 2024-06-06 12:28:11 +08:00
  • f7d4b7c343 build only main and server in their docker images sl/fix-docker-main-server-build slaren 2024-06-06 00:13:01 +02:00
  • 3d2e79da7f add openmp lib to dockerfiles sl/fix-docker-omp slaren 2024-06-06 00:05:25 +02:00
  • 7672adeec7 Fix encoding in python scripts (#7733) Galunid 2024-06-05 19:07:24 +02:00
  • 57dfc3bcdf hf bitnet e2e v2 Eddie-Wang 2024-06-05 16:01:05 +00:00
  • 7d1a378b8f CUDA: refactor mmq, dmmv, mmvq (#7716) b3092 Johannes Gäßler 2024-06-05 16:53:00 +02:00
  • 2b3389677a ggml : refactor rope norm/neox (#7634) b3091 Georgi Gerganov 2024-06-05 11:29:20 +03:00
  • 076b4a197b hf bitnet v1 Eddie-Wang1120 2024-06-05 16:15:28 +08:00