textgen

grammar

Handle both int and str types in grammar char processing

2025-07-23 11:52:51 -07:00

callbacks.py

fix: replace bare except clauses with except Exception (#7400 )

2026-03-04 18:06:17 -03:00

chat.py

Optimize tool call detection

2026-03-14 12:09:41 -07:00

evaluate.py

Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data

2026-03-05 19:31:10 -08:00

exllamav3_hf.py

Fix ExLlamaV3 EOS handling, load order, and perplexity evaluation

2026-03-09 23:56:38 -03:00

exllamav3.py

Add native logit_bias and logprobs support for ExLlamav3

2026-03-10 11:03:25 -03:00

extensions.py

Refactor to not import gradio in --nowebui mode

2026-03-09 19:29:24 -07:00

html_generator.py

UI: Fix multiple thinking blocks rendering as raw text in HTML generator

2026-03-13 15:47:11 -03:00

image_models.py

Image: Quantize the text encoder for lower VRAM

2025-12-05 13:08:46 -08:00

image_utils.py

Image generation: Safer image uploading

2025-12-03 16:07:51 -08:00

llama_cpp_server.py

Change the default ctx-size to 0 (auto) for llama.cpp

2026-03-14 15:30:01 -07:00

loaders.py

Add missing custom_token_bans to llama.cpp and reasoning_effort to ExLlamav3

2026-03-10 09:58:00 -03:00

logging_colors.py

Lint

2023-12-19 21:36:57 -08:00

logits.py

Remove ExLlamaV2 backend

2026-03-05 14:02:13 -08:00

LoRA.py

Remove ExLlamaV2 backend

2026-03-05 14:02:13 -08:00

metadata_gguf.py

fix: replace bare except clauses with except Exception (#7400 )

2026-03-04 18:06:17 -03:00

models_settings.py

Fix after 4ae2bd86e2

2026-03-14 18:18:33 -07:00

models.py

Change the default ctx-size to 0 (auto) for llama.cpp

2026-03-14 15:30:01 -07:00

paths.py

Portable mode: always use ../user_data if it exists

2026-03-06 18:04:48 -08:00

presets.py

API: Add command-line flags to override default generation parameters

2026-03-06 01:36:45 -03:00

prompts.py

Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data

2026-03-05 19:31:10 -08:00

reasoning.py

Fix GPT-OSS channel markup leaking into UI when model skips analysis block

2026-03-14 09:08:05 -07:00

sampler_hijack.py

Add adaptive-p sampler and n-gram speculative decoding support

2026-03-04 09:41:29 -08:00

sane_markdown_lists.py

Disable uncommonly used indented codeblocks (#7401 )

2026-03-04 17:51:00 -03:00

shared.py

Change the default ctx-size to 0 (auto) for llama.cpp

2026-03-14 15:30:01 -07:00

tensorrt_llm.py

TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support

2026-03-05 18:09:45 -08:00

text_generation.py

Address copilot feedback

2026-03-12 19:55:20 -07:00

tool_parsing.py

Optimize tool call detection

2026-03-14 12:09:41 -07:00

tool_use.py

Clean up tool calling code

2026-03-13 18:27:01 -07:00

torch_utils.py

Remove obsolete DeepSpeed inference code (2023 relic)

2026-03-04 17:20:34 -08:00

training.py

Add guard against training with llama.cpp loader

2026-03-08 10:47:59 -03:00

transformers_loader.py

API: Rewrite logprobs for OpenAI spec compliance across all backends

2026-03-12 14:17:32 -03:00

ui_chat.py

Clean up tool calling code

2026-03-13 18:27:01 -07:00

ui_default.py

Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data

2026-03-05 19:31:10 -08:00

ui_file_saving.py

Security: prevent path traversal in character/user/file save and delete

2026-03-06 02:00:10 -03:00

ui_image_generation.py

Fix GPT-OSS channel markup leaking into UI when model skips analysis block

2026-03-14 09:08:05 -07:00

ui_model_menu.py

Change the default ctx-size to 0 (auto) for llama.cpp

2026-03-14 15:30:01 -07:00

ui_notebook.py

Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data

2026-03-05 19:31:10 -08:00

ui_parameters.py

Use a new gr.DragDrop element for Sampler priority + update gradio

2026-03-11 19:35:12 -03:00

ui_session.py

Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data

2026-03-05 19:31:10 -08:00

ui.py

Initial tool-calling support in the UI

2026-03-12 01:16:19 -03:00

utils.py

Training: Optimize _peek_json_keys to avoid loading entire file into memory

2026-03-06 15:39:08 -08:00

web_search.py

Fix relative redirect handling in web page fetcher

2026-03-14 15:46:21 -07:00