upstream-archive/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-01 23:50:47 -05:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 8f8c28e89c convert : auto-determine model name based on dir + scripts update Georgi Gerganov 2023-08-24 19:26:19 +03:00
  • 7694adda8d Fix for main example getting stuck when -n -2 and --interactive (#2767) b1050 Kerfuffle 2023-08-24 10:11:13 -06:00
  • fea95c682d fix convert.py for codellama, add llama 34B to the list of recognized models (#2768) b1049 slaren 2023-08-24 17:44:11 +02:00
  • ef955fbd23 Tag release with build number (#2732) b1048 DannyDaemonic 2023-08-24 06:58:02 -07:00
  • d67777c202 metal : add Q8_0 support (#2763) Georgi Gerganov 2023-08-24 16:19:57 +03:00
  • c3e53b421a llama : escape all U+2581 in a string (#2750) b1047 Georgi Gerganov 2023-08-24 12:26:01 +03:00
  • 0288361b65 gguf : fix line endings M. Yusuf Sarıgöz 2023-08-24 09:26:13 +03:00
  • 344f6e373b gguf: prepare as Pip package M. Yusuf Sarıgöz 2023-08-24 09:09:52 +03:00
  • 5dd870574e gguf: prepare as Pip package M. Yusuf Sarıgöz 2023-08-24 09:08:19 +03:00
  • 050046fa45 gitignore : add dist and rm pyproject.toml M. Yusuf Sarıgöz 2023-08-24 09:07:42 +03:00
  • 6e91a1b070 llama : fix grammar sometimes generating null char (#2756) b1046 Evan Jones 2023-08-24 00:07:13 -04:00
  • 44d5462b5c readme : fix link Georgi Gerganov 2023-08-23 23:44:19 +03:00
  • c7868b0753 minor : fix trailing whitespace Georgi Gerganov 2023-08-23 23:43:00 +03:00
  • 79da24b58c readme : update hot topics Georgi Gerganov 2023-08-23 23:41:16 +03:00
  • cf658adc83 llm : add Falcon support (#2717) master-cf658ad Georgi Gerganov 2023-08-23 23:08:04 +03:00
  • 977629a34e Merge branch 'master' into fix-eos fix-eos Georgi Gerganov 2023-08-23 22:40:19 +03:00
  • a192860cfe minor : fix trailing whitespace master-a192860 Georgi Gerganov 2023-08-23 22:37:39 +03:00
  • 95385241a9 examples : restore the functionality to import llama2.c models (#2685) master-9538524 Olivier Chafik 2023-08-23 20:33:05 +01:00
  • 335acd2ffd fix convert-lora-to-ggml.py (#2738) slaren 2023-08-23 16:46:54 +02:00
  • 5290c38e6e main : insert bos if no tokens (#2727) master-5290c38 klosax 2023-08-23 16:46:03 +02:00
  • cc34dbda96 gitignore : fix for windows (#2729) akawrykow 2023-08-23 07:31:34 -07:00
  • 7c2227a197 chmod : make scripts executable (#2675) Cebtenzzre 2023-08-23 10:29:09 -04:00
  • f19dca04ea devops : RPM Specs (#2723) JohnnyB 2023-08-23 15:28:22 +01:00
  • 8207214b6a Fix values shown in the quantize tool help (#2735) master-8207214 Kawrakow 2023-08-23 12:57:12 +03:00
  • 62959e740e Strided perplexity (#2714) master-62959e7 Kawrakow 2023-08-23 12:56:42 +03:00
  • 7f7ddd5002 Fix ggml to gguf conversion on Windows (#2733) IgnacioFDM 2023-08-23 06:31:09 -03:00
  • b8ad1b66b2 server : allow json array in prompt or content for direct token input (#2306) master-b8ad1b6 Xiao-Yong Jin 2023-08-23 02:12:12 -05:00
  • f5fe98d11b docs : add grammar docs (#2701) Evan Jones 2023-08-22 21:01:57 -04:00
  • 777f42ba18 Improve handling of special tokens in GGML to GGUF converter (#2725) master-777f42b Kerfuffle 2023-08-22 17:39:39 -06:00
  • 46ef5b5fcf llama : fix whitespace escaping in tokenizer (#2724) master-46ef5b5 goerch 2023-08-22 23:10:42 +02:00
  • c63bb1d16a CUDA: use mul_mat_q kernels by default (#2683) master-c63bb1d Johannes Gäßler 2023-08-22 22:47:05 +02:00
  • 3b6cfe7c92 convert.py : clarifying error message (#2718) Alex Petenchea 2023-08-22 21:58:16 +03:00
  • 800c9635b4 Fix CUDA softmax by subtracting max value before exp (#2665) master-800c963 Jiahao Li 2023-08-23 02:27:06 +08:00
  • deb7dfca4b gguf : add ftype meta info to the model (#2710) master-deb7dfc Georgi Gerganov 2023-08-22 20:05:59 +03:00
  • bac66994cf Quantization imrovements for k_quants (#2707) master-bac6699 Kawrakow 2023-08-22 19:14:09 +03:00
  • 519c981f8b embedding : evaluate prompt in batches (#2713) master-519c981 slaren 2023-08-22 16:03:12 +02:00
  • 1123f7fbdf ggml-cuda : use graph allocator (#2684) master-1123f7f slaren 2023-08-22 15:25:19 +02:00
  • ef3f333d37 ggml : sync latest (SAM + SD operators, CUDA alibi) (#2709) master-ef3f333 Georgi Gerganov 2023-08-22 14:22:08 +03:00
  • 8e4364f2af llama-bench : minor fixes (#2695) master-8e4364f slaren 2023-08-22 09:56:03 +02:00
  • 1e3bc523d8 ggml : support CUDA's half type for aarch64(#1455) (#2670) master-1e3bc52 Kylin 2023-08-22 15:14:23 +08:00
  • 14b1d7e6f7 metal : add missing barriers for mul-mat (#2699) Shouzheng Liu 2023-08-22 02:18:40 -04:00
  • 226255b44e server : fallback to default if client param is null (#2688) master-226255b Jhen-Jie Hong 2023-08-22 08:32:00 +08:00
  • 930523c8e1 Fix convert-llama-ggmlv3-to-gguf.py vocab conversion (#2698) Kerfuffle 2023-08-21 18:01:34 -06:00
  • c8dba409e6 py : remove obsolete script Georgi Gerganov 2023-08-21 23:40:22 +03:00
  • 6381d4e110 gguf : new file format with flexible meta data (beta) (#2398) master-6381d4e Georgi Gerganov 2023-08-21 23:07:43 +03:00
  • 66a66a05a8 readme : add notice about new file format gguf Georgi Gerganov 2023-08-21 22:11:00 +03:00
  • 811f653f95 py : cosmetics Georgi Gerganov 2023-08-21 20:40:08 +03:00
  • 49c25cce19 tests : use new tokenizer type API (#2692) goerch 2023-08-21 19:11:14 +02:00
  • d3f5fbef6c main : flush stdout Georgi Gerganov 2023-08-21 19:52:51 +03:00
  • 0b53b8b08d llama : add API for token type Georgi Gerganov 2023-08-21 19:35:31 +03:00
  • 8d177eddeb llama : improve token type support (#2668) goerch 2023-08-21 17:56:02 +02:00
  • e06cbcee73 gguf : add Python script to convert GGMLv3 LLaMA models to GGUF (#2682) Kerfuffle 2023-08-21 08:45:52 -06:00
  • 6490ff7198 py : fix whitespace Georgi Gerganov 2023-08-21 16:42:27 +03:00
  • e3da126f2a main : inject reverse prompt after EOS + update examples/chat.sh Georgi Gerganov 2023-08-21 16:41:27 +03:00
  • 1e7a0092dd Merge branch 'master' into gguf Georgi Gerganov 2023-08-21 16:27:51 +03:00
  • 8af1991e2a main : restore old EOS behavior in interactive mode Georgi Gerganov 2023-08-21 15:40:51 +03:00
  • 7a7d1ba68a convert-llama-hf-to-gguf.py : rope scale fix klosax 2023-08-21 14:12:02 +02:00
  • 9070e330ab convert-llama-7b-pth-to-gguf.py : rope scale fix klosax 2023-08-21 14:11:22 +02:00
  • c082b9fa0b llama.cpp : use rope scale kv klosax 2023-08-21 13:30:03 +02:00
  • dc1f051013 convert-llama-7b-pth-to-gguf.py : rope scale and added tokens klosax 2023-08-21 13:27:53 +02:00
  • 5f6ff387ca convert-llama-hf-to-gguf.py : rope scale and added tokens klosax 2023-08-21 13:25:14 +02:00
  • 6a69a693cb gguf.py : fix rope scale kv klosax 2023-08-21 13:23:10 +02:00
  • dadbed99e6 metal : fix synchronization in new matrix multiplication kernel (#2686) Shouzheng Liu 2023-08-21 06:59:29 -04:00
  • cb1c0727bd HellaSwag: split token evaluation into batches if needed (#2681) master-cb1c072 Kawrakow 2023-08-21 11:11:31 +03:00
  • c818c405e0 convert-llama-hf-to-gguf.py : fix attn_q permute klosax 2023-08-21 04:42:09 +02:00
  • 58bde5c5c1 Delete convert-permute-debug.py klosax 2023-08-21 04:35:06 +02:00
  • 287db51015 Delete convert-permute-debug-master.py klosax 2023-08-21 04:34:39 +02:00
  • d5c8fcfd8a convert.py : 70b model working (change attn_q permute) klosax 2023-08-21 04:33:33 +02:00
  • 7de7cb4bd8 convert-permute-debug.py : change permute type of attn_q klosax 2023-08-21 04:06:59 +02:00
  • 4f92488dd6 convert-permute-debug-master.py : permute debug for master klosax 2023-08-21 03:44:16 +02:00
  • 5a02b9625a convert-permute-debug.py : permute debug print klosax 2023-08-21 03:24:29 +02:00
  • 9e232f0234 ggml : move all type info to ggml_type_traits (#2663) master-9e232f0 slaren 2023-08-20 22:17:53 +02:00
  • f838faa874 convert-llama-7b-pth-to-gguf.py : special tokens klosax 2023-08-20 16:56:48 +02:00
  • 76b46627e2 convert-llama-hf-to-gguf.py : special tokens klosax 2023-08-20 16:54:42 +02:00
  • 5e9ff54a67 More efficient Hellaswag implementation (#2677) master-5e9ff54 Kawrakow 2023-08-20 16:44:46 +03:00
  • 28b8c265eb cmpnct_gpt2bpe.hpp : cleanup gguf-28b8c26 klosax 2023-08-19 18:26:51 +02:00
  • c0a1269b7f Update examples/server/README.md klosax 2023-08-19 15:27:37 +02:00
  • 6a2e520095 cmpnct_gpt2bpe.hpp : remove non-general stuff klosax 2023-08-19 13:19:02 +02:00
  • 8945d47f52 gptneox-main.cpp : fixes klosax 2023-08-19 12:09:24 +02:00
  • 781bf2481f falcon-main.cpp : fixes klosax 2023-08-19 12:08:17 +02:00
  • dadf098b5a cmpnct_gpt2bpe.hpp : fixes klosax 2023-08-19 12:06:22 +02:00
  • b3a7a2b486 convert-falcon-hf-to-gguf.py : add tensor data layout klosax 2023-08-19 12:05:11 +02:00
  • 2c8055b65b convert-falcon-hf-to-gguf.py : update ref klosax 2023-08-19 01:08:39 +02:00
  • 1d80eea574 falcon-main.cpp : fix for falcon 40b klosax 2023-08-19 01:03:37 +02:00
  • bd5a57901b gguf.py : fix for falcon 40b klosax 2023-08-19 01:01:52 +02:00
  • 281d6d1105 convert-llama-hf-to-gguf.py : remove extra kv klosax 2023-08-19 00:32:56 +02:00
  • 593b04fdcd convert-llama-7b-pth-to-gguf.py : remove extra kv klosax 2023-08-19 00:32:27 +02:00
  • c0e4ca630b convert-gptneox-hf-to-gguf.py : remove extra kv klosax 2023-08-19 00:31:56 +02:00
  • 16ab9ba3b3 convert-falcon-hf-to-gguf.py : remove extra kv klosax 2023-08-19 00:31:28 +02:00
  • d5e976c12b falcon-main.cpp : falcon inference example klosax 2023-08-19 00:02:18 +02:00
  • 1f0bccb279 server : better default prompt (#2646) Georgi Gerganov 2023-08-19 00:45:36 +03:00
  • f63564adfa server : update xxd usage for older versions compatibility (#2649) Jhen-Jie Hong 2023-08-19 05:41:32 +08:00
  • 2d8b76a110 Add link to clojure bindings to Readme. (#2659) Adrian 2023-08-18 12:39:22 -07:00
  • fb7c883cd3 convert-falcon-hf-to-gguf.py : falcon HF --> gguf conversion, not tested klosax 2023-08-18 20:14:01 +02:00
  • 25b8a8922d llama : introduce enum llama_vocab_type + remove hardcoded string constants Georgi Gerganov 2023-08-18 18:46:38 +03:00
  • 7af633aec3 readme : incoming BREAKING CHANGE Georgi Gerganov 2023-08-18 17:48:31 +03:00
  • a4ad2bf35c llama : fix MPI build Georgi Gerganov 2023-08-18 17:34:27 +03:00
  • 5d2656d670 llama : avoid hardcoded special tokens Georgi Gerganov 2023-08-18 17:29:20 +03:00
  • 035d511457 llama : minor API updates Georgi Gerganov 2023-08-18 17:06:34 +03:00
  • 2d6c2c757c llama : remove C++ API + reorganize common source in /common dir Georgi Gerganov 2023-08-18 16:22:48 +03:00