256 Commits

Author SHA1 Message Date
oobabooga
c022565b12 UI: Add MTP support, reorganize the speculative decoding menu 2026-05-17 17:02:47 -07:00
oobabooga
be7f3a20f2 Electron: Add spellcheck toggle in the Session tab (closes #7550) 2026-05-16 10:48:02 -07:00
oobabooga
dbf922006c Revert "Soften slider and checkbox label colors in light theme"
This reverts commit 3c4a1402a8.
2026-05-15 12:47:50 -07:00
oobabooga
3c4a1402a8 Soften slider and checkbox label colors in light theme 2026-05-15 12:10:27 -07:00
oobabooga
47fdee9cb1 Electron: Add a folder picker for the models directory 2026-05-13 20:34:07 -07:00
oobabooga
8376284d7a Fix extension settings not saving for user_data/extensions (closes #7525) 2026-05-02 18:54:49 -07:00
oobabooga
03b964a3e5 Minor color improvement 2026-05-02 09:25:11 -07:00
oobabooga
ddec64af71 UI: refinements after c6a57a4572 & electron user_data path 2026-05-02 08:18:39 -07:00
oobabooga
c6a57a4572 Major UI overhaul 2026-05-01 22:06:18 -07:00
oobabooga
83347ed7e4 Add preserve_thinking chat template parameter (UI and CLI) 2026-04-22 13:43:56 -07:00
oobabooga
a253d38953 Add tool call confirmation with inline approve/reject buttons 2026-04-22 11:49:39 -07:00
oobabooga
40ba6109e0 UI: Improve border colors in light theme 2026-04-18 10:38:55 -07:00
oobabooga
b1d06dcf96 UI: Add MCP server support 2026-04-05 19:46:01 -07:00
oobabooga
ffea8f282e UI: Improve message text contrast 2026-04-04 18:53:13 -07:00
oobabooga
307d0c92be UI polish 2026-03-23 06:35:14 -07:00
oobabooga
e0e20ab9e7 Minor cleanup across multiple modules 2026-03-19 08:02:23 -07:00
oobabooga
dff8903b03 UI: Modernize the Gradio theme 2026-03-16 19:33:54 -07:00
oobabooga
cf9ad8eafe Initial tool-calling support in the UI 2026-03-12 01:16:19 -03:00
oobabooga
980a9d1657 UI: Minor defensive changes to autosave 2026-03-11 15:50:16 -07:00
oobabooga
39e6c997cc Refactor to not import gradio in --nowebui mode 2026-03-09 19:29:24 -07:00
oobabooga
66fb79fe15 llama.cpp: Add --fit-target param 2026-03-06 01:55:48 -03:00
oobabooga
e2548f69a9 Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data
If --user-data-dir is not set, auto-detect: use ../user_data when
./user_data doesn't exist, making it easy to share user data across
portable builds by placing it one folder up.
2026-03-05 19:31:10 -08:00
oobabooga
f52d9336e5 TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support 2026-03-05 18:09:45 -08:00
oobabooga
9824c82cb6 API: Add parallel request support for llama.cpp and ExLlamaV3 2026-03-05 16:49:58 -08:00
oobabooga
2f08dce7b0 Remove ExLlamaV2 backend
- archived upstream: 7dc12af3a8
- replaced by ExLlamaV3, which has much better quantization accuracy
2026-03-05 14:02:13 -08:00
oobabooga
65de4c30c8 Add adaptive-p sampler and n-gram speculative decoding support 2026-03-04 09:41:29 -08:00
q5sys (JT)
7493fe7841 feat: Add a dropdown to save/load user personas (#7367) 2026-01-14 20:35:08 -03:00
oobabooga
ffef3c7b1d Image: Make the LLM Variations prompt configurable 2025-12-04 10:44:35 -08:00
oobabooga
2793153717 Image: Add LLM-generated prompt variations 2025-12-04 08:10:24 -08:00
oobabooga
9d07d3a229 Make portable builds functional again after b3666e140d 2025-12-02 10:06:57 -08:00
oobabooga
b3666e140d Add image generation support (#7328) 2025-12-02 14:55:38 -03:00
GodEmperor785
400bb0694b Add slider for --ubatch-size for llama.cpp loader, change defaults for better MoE performance (#7316) 2025-11-21 16:56:02 -03:00
oobabooga
0d4eff284c Add a --cpu-moe model for llama.cpp 2025-11-19 05:23:43 -08:00
oobabooga
b5a6904c4a Make --trust-remote-code immutable from the UI/API 2025-10-14 20:47:01 -07:00
oobabooga
13876a1ee8 llama.cpp: Remove the --flash-attn flag (it's always on now) 2025-08-30 20:28:26 -07:00
oobabooga
dbabe67e77 ExLlamaV3: Enable the --enable-tp option, add a --tp-backend option 2025-08-17 13:19:11 -07:00
oobabooga
d86b0ec010 Add multimodal support (llama.cpp) (#7027) 2025-08-10 01:27:25 -03:00
oobabooga
498778b8ac Add a new 'Reasoning effort' UI element 2025-08-05 15:19:11 -07:00
oobabooga
1d1b20bd77 Remove the --torch-compile option (it doesn't do anything currently) 2025-07-11 10:51:23 -07:00
oobabooga
6c2bdda0f0 Transformers loader: replace use_flash_attention_2/use_eager_attention with a unified attn_implementation
Closes #7107
2025-07-09 18:39:37 -07:00
oobabooga
92ec8dda03 Fix chat history getting lost if the UI is inactive for a long time (closes #7109) 2025-07-04 06:04:04 -07:00
oobabooga
645463b9f0 Add fallback values for theme colors 2025-06-19 11:28:12 -07:00
oobabooga
aa44e542cb Revert "Safer usage of mkdir across the project"
This reverts commit 0d1597616f.
2025-06-17 07:11:59 -07:00
oobabooga
0d1597616f Safer usage of mkdir across the project 2025-06-17 07:09:33 -07:00
oobabooga
de24b3bb31 Merge the Default and Notebook tabs into a single Notebook tab (#7078) 2025-06-16 13:19:29 -03:00
oobabooga
bc2b0f54e9 Only save extensions settings on manual save 2025-06-15 15:53:16 -07:00
oobabooga
2dee3a66ff Add an option to include/exclude attachments from previous messages in the chat prompt 2025-06-12 21:37:18 -07:00
oobabooga
004fd8316c Minor changes 2025-06-11 07:49:51 -07:00
oobabooga
570d5b8936 Only save extensions on manual save 2025-06-11 07:39:49 -07:00
oobabooga
27140f3563 Revert "Don't save active extensions through the UI"
This reverts commit df98f4b331.
2025-06-11 07:25:27 -07:00