upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-29 22:20:58 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • d4c19c0f5c server : accept extra_context for the infill endpoint (#9874) Georgi Gerganov 2024-10-13 21:31:35 +03:00
  • c7181bd294 server : reuse cached context chunks (#9866) b3914 Georgi Gerganov 2024-10-13 18:52:48 +03:00
  • 92be9f1216 flake.lock: Update (#9870) Georgi Gerganov 2024-10-13 06:11:26 +03:00
  • 805512a73b ggml : remove unused fast broadcast path in GGML_MUL Francis Couture-Harpin 2024-10-12 16:20:26 -04:00
  • 038d958333 Merge branch 'master' into compilade/mamba2 Francis Couture-Harpin 2024-10-12 16:12:06 -04:00
  • 124c222f76 Merge branch 'master' into compilade/refactor-kv-cache Francis Couture-Harpin 2024-10-12 13:11:06 -04:00
  • edc265661c server : add option to time limit the generation phase (#9865) b3912 Georgi Gerganov 2024-10-12 16:14:27 +03:00
  • 1bde94dd02 server : remove self-extend features (#9860) b3911 Georgi Gerganov 2024-10-12 16:06:31 +03:00
  • 95c76e8e92 server : remove legacy system_prompt feature (#9857) Georgi Gerganov 2024-10-12 14:51:54 +03:00
  • 11ac9800af llama : improve infill support and special token detection (#9798) b3909 Georgi Gerganov 2024-10-12 08:21:51 +03:00
  • 943d20b411 musa : update doc (#9856) R0CKSTAR 2024-10-12 13:09:53 +08:00
  • 96776405a1 ggml : move more prints to the ggml log system (#9839) b3907 Diego Devesa 2024-10-11 15:34:45 +02:00
  • cb1632b593 llama : adds llama-grammar memorization stacks (#4218) Clarissa Miranda 2024-10-11 12:20:48 +11:00
  • 7eee341bee common : use common_ prefix for common library functions (#9805) b3906 Diego Devesa 2024-10-10 22:57:42 +02:00
  • 0e9f760eb1 rpc : add backend registry / device interfaces (#9812) b3905 Diego Devesa 2024-10-10 20:14:55 +02:00
  • cf8e0a3bb9 musa: add docker image support (#9685) b3904 R0CKSTAR 2024-10-11 02:10:37 +08:00
  • c7499c557c examples : do not use common library in simple example (#9803) b3903 Diego Devesa 2024-10-10 19:50:49 +02:00
  • c81f3bbb05 cmake : do not build common library by default when standalone (#9804) b3902 Diego Devesa 2024-10-09 18:49:52 +02:00
  • e7022064ab perplexity : fix integer overflow (#9783) b3901 Georgi Gerganov 2024-10-09 17:00:18 +03:00
  • 3dc48fe75a examples : remove llama.vim Georgi Gerganov 2024-10-09 10:55:42 +03:00
  • dca1d4b58a ggml : fix BLAS with unsupported types (#9775) b3899 Diego Devesa 2024-10-08 14:21:43 +02:00
  • 458367a906 server : better security control for public deployments (#9776) b3898 Xuan Son Nguyen 2024-10-08 13:27:04 +02:00
  • fa42aa6d89 scripts : fix spelling typo in messages and comments (#9782) standby24x7 2024-10-08 15:19:53 +09:00
  • 6374743747 ggml : add backend registry / device interfaces to BLAS backend (#9752) b3896 Diego Devesa 2024-10-07 21:55:08 +02:00
  • f1af42fa8c Update building for Android (#9672) b3895 Andrew Minh Nguyen 2024-10-07 09:37:31 -07:00
  • 6279dac039 flake.lock: Update (#9753) Georgi Gerganov 2024-10-07 19:35:42 +03:00
  • d5ac8cf2f2 ggml : add metal backend registry / device (#9713) Georgi Gerganov 2024-10-07 18:27:51 +03:00
  • 96b6912103 metal : single allocation of encode_async block (#9747) b3892 Paul Tsochantaris 2024-10-07 13:26:31 +01:00
  • d5cb86844f contrib : simplify + minor edits [no ci] Georgi Gerganov 2024-10-06 14:15:27 +03:00
  • f4b2dcdf49 readme : fix typo [no ci] Georgi Gerganov 2024-10-06 13:49:41 +03:00
  • b6d6c5289f sync : llama.cpp b3889 Georgi Gerganov 2024-10-06 12:53:28 +03:00
  • b0915d5b51 vulkan : retry allocation with fallback flags (whisper/2451) SRHMorris 2024-10-06 08:34:20 +01:00
  • 8c475b97b8 rerank : use [SEP] token instead of [BOS] (#9737) b3887 Georgi Gerganov 2024-10-05 15:55:04 +03:00
  • 58b16695e1 sync : ggml b3886 Georgi Gerganov 2024-10-05 15:53:49 +03:00
  • 905f5485b2 metal : zero-init buffer contexts (whisper/0) Georgi Gerganov 2024-10-05 14:33:54 +03:00
  • 71967c2a6d Add Llama Assistant (#9744) Viet-Anh NGUYEN (Andrew) 2024-10-05 01:29:35 +07:00
  • 17880771ad sync : ggml b3883 Georgi Gerganov 2024-10-04 18:50:25 +03:00
  • 55951c018d ggml : fix typo in example usage ggml_gallocr_new (ggml/984) Daniel Bevenius 2024-10-04 15:46:18 +02:00
  • ff565769f2 ggml : fixes after sync (ggml/983) Diego Devesa 2024-10-04 08:41:40 +02:00
  • f3fdcfaa79 ci : fine-grant permission (#9710) b3880 Xuan Son Nguyen 2024-10-04 11:47:19 +02:00
  • 133c7b46b3 Fixed RNG seed docs (#9723) b3879 Daniel Kleine 2024-10-04 10:54:44 +02:00
  • d5ed2b929d metal : remove abort (skip) (ggml/0) b3878 Georgi Gerganov 2024-10-03 21:18:19 +03:00
  • 1bb8a64ebf sync : ggml Georgi Gerganov 2024-10-03 21:17:49 +03:00
  • fabdc3bda3 ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980) Johannes Gäßler 2024-10-03 17:29:59 +02:00
  • eee39bdc96 ggml: refactor cross entropy loss CPU impl. (ggml/976) Johannes Gäßler 2024-10-02 15:32:39 +02:00
  • 5d5ab1e5cc metal : fix compute pass descriptor autorelease crash (#9718) b3874 Jack Mousseau 2024-10-03 11:01:46 -07:00
  • a7ad553513 ggml-backend : add device description to CPU backend (#9720) b3873 Diego Devesa 2024-10-03 17:39:18 +02:00
  • d6fe7abf04 ggml: unify backend logging mechanism (#9709) b3872 bandoti 2024-10-03 12:39:03 -03:00
  • e3c355ba65 convert : handle tokenizer merges format from transformers 4.45 (#9696) compilade 2024-10-03 10:22:15 -04:00
  • 841713e1e4 rpc : enable vulkan (#9714) b3870 Radoslav Gerganov 2024-10-03 13:00:52 +03:00
  • 5639971466 Fixed dequant precision issues in Q4_1 and Q5_1 (#9711) b3869 Ouadie EL FAROUKI 2024-10-03 07:50:44 +01:00
  • 62b09b343c metal : fix wrong number of tokens per sequence in SSM_SCAN Francis Couture-Harpin 2024-10-02 21:35:50 -04:00
  • c83ad6d01e ggml-backend : add device and backend reg interfaces (#9707) b3868 Diego Devesa 2024-10-03 01:49:47 +02:00
  • 5b8ec2b978 metal : fix SSM_SCAN state head offset Francis Couture-Harpin 2024-10-02 12:11:45 -04:00
  • 8b15bc6fa0 metal : add back n_seqs to SSM_SCAN args Francis Couture-Harpin 2024-10-02 11:47:56 -04:00
  • 7a351abc28 metal : remove unused arguments for SSM_SCAN Francis Couture-Harpin 2024-10-02 11:28:16 -04:00
  • 03d0e6eabe metal : use log and exp instead of log1pf and expf in SSM_SCAN Francis Couture-Harpin 2024-10-02 10:58:41 -04:00
  • 87b97d08f4 metal : fix SSM_SCAN pipeline scope Francis Couture-Harpin 2024-10-02 10:41:10 -04:00
  • 2c77d799f9 metal : attempt to adapt SSM_SCAN for Mamba-2 Francis Couture-Harpin 2024-10-02 10:36:22 -04:00
  • a39ab216aa llama : reduce compile time and binary size (#9712) b3867 Xuan Son Nguyen 2024-10-02 15:49:55 +02:00
  • f536f4c439 [SYCL] Initial cmake support of SYCL for AMD GPUs (#9658) b3866 Alberto Cabrera Pérez 2024-10-02 13:57:18 +01:00
  • 00b7317e63 vulkan : do not use tensor->extra (#9407) b3865 Radoslav Gerganov 2024-10-02 13:49:16 +03:00
  • 76b37d1541 gguf-split : improve --split and --merge logic (#9619) b3864 Zhenwei Jin 2024-10-02 15:21:57 +08:00
  • 148844fe97 examples : remove benchmark (#9704) b3863 Georgi Gerganov 2024-10-02 10:14:44 +03:00
  • 3f1ae2e32c Update README.md (#9591) Paweł Wodnicki 2024-10-01 12:18:46 -05:00
  • 7d6cb36895 Merge branch 'master' into compilade/mamba2 Francis Couture-Harpin 2024-10-01 13:09:40 -04:00
  • 273e7a495a llama : avoid redundant state copy for Mamba 1 and 2 Francis Couture-Harpin 2024-09-30 15:52:42 -04:00
  • f1b8c42711 sync : ggml b3861 Georgi Gerganov 2024-10-01 16:09:42 +03:00
  • e98c1c188e test: fix OPT_STEP_ADAMW for test-backend-ops (ggml/974) Johannes Gäßler 2024-09-30 09:55:23 +02:00
  • cb00020504 vulkan : mul_mat: fix UB with small warps (ggml/952) Salvatore Mesoraca 2024-09-30 09:14:09 +02:00
  • 6c5322481a ggml : fix ggml_cast (ggml/973) Borislav Stanimirov 2024-09-30 10:11:41 +03:00
  • 7254cdf7e8 ggml: fix gradient allocation logic (ggml/966) Johannes Gäßler 2024-09-29 23:18:02 +02:00
  • cad341d889 metal : reduce command encoding overhead (#9698) b3856 Georgi Gerganov 2024-10-01 16:00:25 +03:00
  • a90484c6d9 llama : print correct model type for Llama 3.2 1B and 3B b3855 Georgi Gerganov 2024-10-01 11:42:01 +03:00
  • 1927378bcc convert : refactor rope_freqs generation (#9396) compilade 2024-10-01 02:31:36 -04:00
  • 6f1d9d71f4 Fix Docker ROCM builds, use AMDGPU_TARGETS instead of GPU_TARGETS (#9641) b3853 serhii-nakon 2024-09-30 21:57:12 +03:00
  • 511636df0c ci : reduce severity of unused Pyright ignore comments (#9697) compilade 2024-09-30 14:13:16 -04:00
  • a34fc0dd86 ci : reduce severity of unused Pyright ignore comments compilade/pyright-fix-ignores Francis Couture-Harpin 2024-09-30 13:29:08 -04:00
  • 08a43d05b6 py : update transfomers version (#9694) vb 2024-09-30 17:03:47 +02:00
  • ace4f4be37 flake.lock: Update (#9680) Georgi Gerganov 2024-09-30 17:48:49 +03:00
  • 8277a817f1 console : utf-8 fix for windows stdin (#9690) b3849 Ruchira Hasaranga 2024-09-30 13:53:42 +05:30
  • c919d5db39 ggml : define missing HWCAP flags (#9684) b3848 Georgi Gerganov 2024-09-29 21:18:23 +03:00
  • d0b1d663e4 sync : ggml b3847 Georgi Gerganov 2024-09-29 21:16:07 +03:00
  • aaa4099925 CUDA: remove bad assert (ggml/972) Johannes Gäßler 2024-09-29 19:56:17 +02:00
  • 641002fba8 vulkan : multithread pipeline creation (ggml/963) Jeff Bolz 2024-09-29 11:50:17 -05:00
  • 0de8b203f1 vulkan : fix build for GGML_VULKAN_RUN_TESTS, add TFLOPS to log (ggml/961) Jeff Bolz 2024-09-27 02:58:01 -05:00
  • 544f409b4b vulkan : argsort barriers must be under uniform control flow (ggml/951) Salvatore Mesoraca 2024-09-26 08:59:42 +02:00
  • 6084bfb261 ggml : fix GGML_MAX_N_THREADS + improve formatting (ggml/969) Georgi Gerganov 2024-09-24 13:23:59 +03:00
  • faac0bae26 common : ensure llama_batch size does not exceed max size (#9668) b3841 matiaslin 2024-09-29 05:25:00 -07:00
  • f99d3f8367 py : add model class for Chameleon conversion (#9683) nopperl 2024-09-29 12:02:06 +00:00
  • 589b48d41e contrib : add Resources section (#9675) Georgi Gerganov 2024-09-29 14:38:18 +03:00
  • f4d2b8846a llama : add reranking support (#9510) Georgi Gerganov 2024-09-28 17:42:03 +03:00
  • 1b2f992cd2 test-backend-ops : use flops for some performance tests (#9657) b3837 slaren 2024-09-28 14:32:46 +02:00
  • 739842703e llama : add comment about thread-safety [no ci] (#9449) Georgi Gerganov 2024-09-28 15:13:21 +03:00
  • 6102037bbb vocab : refactor tokenizer to reduce init overhead (#9449) b3835 Zhenwei Jin 2024-09-28 20:10:58 +08:00
  • 9a913110cf llama : add support for Chameleon (#8543) b3834 nopperl 2024-09-28 12:08:43 +00:00
  • 43bcdd9703 readme : add tool (#9655) Aarni Koskela 2024-09-28 15:07:14 +03:00
  • 6a0f779484 ggml : add run-time detection of neon, i8mm and sve (#9331) b3832 Dan Johansson 2024-09-28 14:06:16 +02:00
  • 89f9944981 Enable use to the rebar feature to upload buffers to the device. (#9251) b3831 Markus Tavenrath 2024-09-28 12:05:05 +02:00
  • b5de3b74a5 readme : update hot topics Georgi Gerganov 2024-09-27 20:57:51 +03:00