 oobabooga
|
b950a0c6db
|
Lint
|
2025-04-30 20:02:10 -07:00 |
|
|
oobabooga
|
307d13b540
|
UI: Minor label change
|
2025-04-30 18:58:14 -07:00 |
|
|
oobabooga
|
55283bb8f1
|
Fix CFG with ExLlamaV2_HF (closes #6937)
|
2025-04-30 18:43:45 -07:00 |
|
|
oobabooga
|
ec2e641749
|
Update settings-template.yaml
|
2025-04-30 15:25:26 -07:00 |
|
|
oobabooga
|
a6c3ec2299
|
llama.cpp: Explicitly send cache_prompt = True
|
2025-04-30 15:24:07 -07:00 |
|
|
oobabooga
|
195a45c6e1
|
UI: Make thinking blocks closed by default
|
2025-04-30 15:12:46 -07:00 |
|
|
oobabooga
|
cd5c32dc19
|
UI: Fix max_updates_second not working
|
2025-04-30 14:54:05 -07:00 |
|
|
oobabooga
|
b46ca01340
|
UI: Set max_updates_second to 12 by default
When the tokens/second at at ~50 and the model is a thinking model,
the markdown rendering for the streaming message becomes a CPU
bottleneck.
|
2025-04-30 14:53:15 -07:00 |
|
|
oobabooga
|
a4bf339724
|
Bump llama.cpp
|
2025-04-30 11:13:14 -07:00 |
|
|
oobabooga
|
e9569c3984
|
Fixes after c5fe92d152
|
2025-04-30 06:57:23 -07:00 |
|
|
oobabooga
|
771d3d8ed6
|
Fix getting the llama.cpp logprobs for Qwen3-30B-A3B
|
2025-04-30 06:48:32 -07:00 |
|
|
oobabooga
|
7f49e3c3ce
|
Bump ExLlamaV3
|
2025-04-30 05:25:09 -07:00 |
|
|
oobabooga
|
c5fe92d152
|
Bump llama.cpp
|
2025-04-30 05:24:58 -07:00 |
|
|
oobabooga
|
1dd4aedbe1
|
Fix the streaming_llm UI checkbox not being interactive
|
2025-04-29 05:28:46 -07:00 |
|
|
oobabooga
|
c5fb51e5d1
|
Update README
|
2025-04-28 22:40:26 -07:00 |
|
|
oobabooga
|
d10bded7f8
|
UI: Add an enable_thinking option to enable/disable Qwen3 thinking
|
2025-04-28 22:37:01 -07:00 |
|
|
oobabooga
|
1ee0acc852
|
llama.cpp: Make --verbose print the llama-server command
|
2025-04-28 15:56:25 -07:00 |
|
|
oobabooga
|
15a29e99f8
|
Lint
|
2025-04-27 21:41:34 -07:00 |
|
|
oobabooga
|
be13f5199b
|
UI: Add an info message about how to use Speculative Decoding
|
2025-04-27 21:40:38 -07:00 |
|
|
oobabooga
|
c6c2855c80
|
llama.cpp: Remove the timeout while loading models (closes #6907)
|
2025-04-27 21:22:21 -07:00 |
|
|
oobabooga
|
bbcaec75b4
|
API: Find a new port if the default one is taken (closes #6918)
|
2025-04-27 21:13:16 -07:00 |
|
|
oobabooga
|
ee0592473c
|
Fix ExLlamaV3_HF leaking memory (attempt)
|
2025-04-27 21:04:02 -07:00 |
|
|
oobabooga
|
965ca7948f
|
Update README
|
2025-04-27 07:33:08 -07:00 |
|
|
oobabooga
|
f5b59d2b0b
|
Fix the vulkan workflow
|
2025-04-26 20:11:24 -07:00 |
|
|
oobabooga
|
765fea5e36
|
UI: minor style change
|
2025-04-26 19:33:46 -07:00 |
|
|
oobabooga
|
70952553c7
|
Lint
|
2025-04-26 19:29:08 -07:00 |
|
|
oobabooga
|
363b632a0d
|
Lint
|
2025-04-26 19:22:36 -07:00 |
|
|
oobabooga
|
fa861de05b
|
Fix portable builds with Python 3.12
|
2025-04-26 18:52:44 -07:00 |
|
|
oobabooga
|
7b80acd524
|
Fix parsing --extra-flags
|
2025-04-26 18:40:03 -07:00 |
|
|
oobabooga
|
943451284f
|
Fix the Notebook tab not loading its default prompt
|
2025-04-26 18:25:06 -07:00 |
|
|
oobabooga
|
511eb6aa94
|
Fix saving settings to settings.yaml
|
2025-04-26 18:20:00 -07:00 |
|
|
oobabooga
|
8b83e6f843
|
Prevent Gradio from saying 'Thank you for being a Gradio user!'
|
2025-04-26 18:14:57 -07:00 |
|
|
oobabooga
|
4a32e1f80c
|
UI: show draft_max for ExLlamaV2
|
2025-04-26 18:01:44 -07:00 |
|
|
oobabooga
|
0fe3b033d0
|
Fix parsing of --n_ctx and --max_seq_len (2nd attempt)
|
2025-04-26 17:52:21 -07:00 |
|
|
oobabooga
|
c4afc0421d
|
Fix parsing of --n_ctx and --max_seq_len
|
2025-04-26 17:43:53 -07:00 |
|
|
oobabooga
|
234aba1c50
|
llama.cpp: Simplify the prompt processing progress indicator
The progress bar was unreliable
|
2025-04-26 17:33:47 -07:00 |
|
|
oobabooga
|
4ff91b6588
|
Better default settings for Speculative Decoding
|
2025-04-26 17:24:40 -07:00 |
|
|
oobabooga
|
bf2aa19b21
|
Bump llama.cpp
|
2025-04-26 16:39:22 -07:00 |
|
|
oobabooga
|
029aab6404
|
Revert "Add -noavx2 portable builds"
This reverts commit 0dd71e78c9.
|
2025-04-26 16:38:13 -07:00 |
|
|
oobabooga
|
35717a088c
|
API: Add an /v1/internal/health endpoint
|
2025-04-26 15:42:27 -07:00 |
|
|
oobabooga
|
bc55feaf3e
|
Improve host header validation in local mode
|
2025-04-26 15:42:17 -07:00 |
|
|
oobabooga
|
a317450dfa
|
Update README
|
2025-04-26 14:59:29 -07:00 |
|
|
oobabooga
|
d1e7d9c5d5
|
Update CMD_FLAGS.txt
|
2025-04-26 09:00:56 -07:00 |
|
|
oobabooga
|
3a207e7a57
|
Improve the --help formatting a bit
|
2025-04-26 07:31:04 -07:00 |
|
|
oobabooga
|
6acb0e1bee
|
Change a UI description
|
2025-04-26 05:13:08 -07:00 |
|
|
oobabooga
|
cbd4d967cc
|
Update a --help message
|
2025-04-26 05:09:52 -07:00 |
|
|
oobabooga
|
19c8dced67
|
Move settings-template.yaml into user_data
|
2025-04-26 05:03:23 -07:00 |
|
|
oobabooga
|
b976112539
|
Remove the WSL installation scripts
They were useful in 2023 but now everything runs natively on Windows.
|
2025-04-26 05:02:17 -07:00 |
|
|
oobabooga
|
763a7011c0
|
Remove an ancient/obsolete migration check
|
2025-04-26 04:59:05 -07:00 |
|
|
oobabooga
|
d4b1e31c49
|
Use --ctx-size to specify the context size for all loaders
Old flags are still recognized as alternatives.
|
2025-04-25 16:59:03 -07:00 |
|
|
oobabooga
|
faababc4ea
|
llama.cpp: Add a prompt processing progress bar
|
2025-04-25 16:42:30 -07:00 |
|
|
oobabooga
|
877cf44c08
|
llama.cpp: Add StreamingLLM (--streaming-llm)
|
2025-04-25 16:21:41 -07:00 |
|
|
oobabooga
|
0dd71e78c9
|
Add -noavx2 portable builds
|
2025-04-25 09:07:14 -07:00 |
|
|
oobabooga
|
98f4c694b9
|
llama.cpp: Add --extra-flags parameter for passing additional flags to llama-server
|
2025-04-25 07:32:51 -07:00 |
|
|
oobabooga
|
b6fffbd216
|
UI: minor style change
|
2025-04-25 05:37:44 -07:00 |
|
|
oobabooga
|
2c7ff86015
|
Bump exllamav3 to https://github.com/turboderp-org/exllamav3/commit/de83084184c34cae0aaeca5c8b024de7f148830d
|
2025-04-25 05:28:22 -07:00 |
|
|
oobabooga
|
5993ebeb1b
|
Bump exllamav2 to 0.2.9
|
2025-04-25 05:27:59 -07:00 |
|
|
oobabooga
|
23399aff3c
|
UI: minor style change
|
2025-04-24 20:39:00 -07:00 |
|
|
oobabooga
|
5861013e68
|
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
|
2025-04-24 20:36:20 -07:00 |
|
|
oobabooga
|
a90df27ff5
|
UI: Add a greeting when the chat history is empty
|
2025-04-24 20:33:40 -07:00 |
|
|
oobabooga
|
370fe7b7cf
|
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
|
2025-04-24 09:33:17 -07:00 |
|
|
oobabooga
|
8ebe868916
|
Fix typos in b313adf653
|
2025-04-24 09:32:17 -07:00 |
|
|
oobabooga
|
93fd4ad25d
|
llama.cpp: Document the --device-draft syntax
|
2025-04-24 09:20:11 -07:00 |
|
|
oobabooga
|
f1b64df8dd
|
EXL2: add another torch.cuda.synchronize() call to prevent errors
|
2025-04-24 09:03:49 -07:00 |
|
|
oobabooga
|
b313adf653
|
Bump llama.cpp, make the wheels work with any Python >= 3.7
|
2025-04-24 08:26:12 -07:00 |
|
|
oobabooga
|
c71a2af5ab
|
Handle CMD_FLAGS.txt in the main code (closes #6896)
|
2025-04-24 08:21:06 -07:00 |
|
|
oobabooga
|
bfbde73409
|
Make 'instruct' the default chat mode
|
2025-04-24 07:08:49 -07:00 |
|
|
oobabooga
|
9424ba17c8
|
UI: show only part 00001 of multipart GGUF models in the model menu
|
2025-04-22 19:56:42 -07:00 |
|
|
oobabooga
|
bce1b68ca9
|
Minor fix after previous commit
|
2025-04-22 18:37:36 -07:00 |
|
|
oobabooga
|
812d878812
|
Make the dependabot less spammy
|
2025-04-22 18:35:22 -07:00 |
|
|
oobabooga
|
8228822a6c
|
Revert "Temporary change"
This reverts commit 765de6f678.
|
2025-04-22 18:01:47 -07:00 |
|
|
oobabooga
|
765de6f678
|
Temporary change
|
2025-04-22 17:53:56 -07:00 |
|
|
oobabooga
|
89ec4c9ba6
|
Add vulkan workflow
|
2025-04-22 17:51:08 -07:00 |
|
|
oobabooga
|
06619e5f03
|
Add vulkan requirements.txt files
|
2025-04-22 17:46:54 -07:00 |
|
|
oobabooga
|
4335a24ff8
|
Fix the workflow
|
2025-04-22 08:14:13 -07:00 |
|
|
oobabooga
|
25cf3600aa
|
Lint
|
2025-04-22 08:04:02 -07:00 |
|
|
oobabooga
|
39cbb5fee0
|
Lint
|
2025-04-22 08:03:25 -07:00 |
|
|
oobabooga
|
da1919baae
|
Update the README
|
2025-04-22 08:03:22 -07:00 |
|
|
oobabooga
|
a3031795a3
|
Update the zip filename
|
2025-04-22 08:03:16 -07:00 |
|
|
oobabooga
|
008c6dd682
|
Lint
|
2025-04-22 08:02:37 -07:00 |
|
|
oobabooga
|
78aeabca89
|
Fix the transformers loader
|
2025-04-21 18:33:14 -07:00 |
|
|
oobabooga
|
8320190184
|
Fix the exllamav2_HF and exllamav3_HF loaders
|
2025-04-21 18:32:23 -07:00 |
|
|
oobabooga
|
15989c2ed8
|
Make llama.cpp the default loader
|
2025-04-21 16:36:35 -07:00 |
|
|
oobabooga
|
86c3ed3218
|
Small change to the unload_model() function
|
2025-04-20 20:00:56 -07:00 |
|
|
oobabooga
|
c178ea02fe
|
Revert "Move the requirements*.txt to a requirements folder"
This reverts commit 6117ef7d64.
|
2025-04-20 19:27:38 -07:00 |
|
|
oobabooga
|
6117ef7d64
|
Move the requirements*.txt to a requirements folder
|
2025-04-20 19:12:04 -07:00 |
|
|
oobabooga
|
fe8e80e04a
|
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
|
2025-04-20 19:09:27 -07:00 |
|
|
oobabooga
|
ff1c00bdd9
|
llama.cpp: set the random seed manually
|
2025-04-20 19:08:44 -07:00 |
|
|
oobabooga
|
99588be576
|
Organize one_click.py
|
2025-04-20 18:57:26 -07:00 |
|
|
oobabooga
|
e243424ba1
|
Fix an import
|
2025-04-20 17:51:28 -07:00 |
|
|
oobabooga
|
8cfd7f976b
|
Revert "Remove the old --model-menu flag"
This reverts commit 109de34e3b.
|
2025-04-20 13:35:42 -07:00 |
|
|
oobabooga
|
d5e1bccef9
|
Remove the SpeechRecognition requirement
|
2025-04-20 11:47:28 -07:00 |
|
|
oobabooga
|
b3bf7a885d
|
Fix ExLlamaV2_HF and ExLlamaV3_HF after ae02ffc605
|
2025-04-20 11:32:48 -07:00 |
|
|
oobabooga
|
9c59acf820
|
Remove the numba requirement (it's no longer used)
|
2025-04-20 10:02:40 -07:00 |
|
|
oobabooga
|
6ba0164c70
|
Lint
|
2025-04-19 17:45:21 -07:00 |
|
|
oobabooga
|
5ab069786b
|
llama.cpp: add back the two encode calls (they are harmless now)
|
2025-04-19 17:38:36 -07:00 |
|
|
oobabooga
|
b9da5c7e3a
|
Use 127.0.0.1 instead of localhost for faster llama.cpp on Windows
|
2025-04-19 17:36:04 -07:00 |
|
|
oobabooga
|
9c9df2063f
|
llama.cpp: fix unicode decoding (closes #6856)
|
2025-04-19 16:38:15 -07:00 |
|
|
oobabooga
|
ba976d1390
|
llama.cpp: avoid two 'encode' calls
|
2025-04-19 16:35:01 -07:00 |
|
|
oobabooga
|
ed42154c78
|
Revert "llama.cpp: close the connection immediately on 'Stop'"
This reverts commit 5fdebc554b.
|
2025-04-19 05:32:36 -07:00 |
|