textgen

api

API: Remove deprecated "settings" parameter from model load endpoint

2026-04-04 11:00:14 -07:00

grammar

Add missing __init__.py to modules/grammar

2026-03-20 16:04:57 -03:00

callbacks.py

Minor cleanup

2026-03-20 07:20:26 -07:00

chat.py

UI: Fix tool buffer check truncating visible text at end of generation

2026-04-04 09:57:07 -07:00

evaluate.py

Make user_data configurable: add --user-data-dir flag, auto-detect ../user_data

2026-03-05 19:31:10 -08:00

exllamav3_hf.py

Fix ExLlamav3 OOM on prompt logprobs and qwen3_5_moe HF compat

2026-04-01 19:44:55 -07:00

exllamav3.py

API: Optimize prompt logprobs and refactor ExLlamav3 forward pass

2026-04-02 14:31:11 -03:00

extensions.py

Several small code simplifications

2026-03-30 19:36:03 -07:00

html_generator.py

UI: Fix inline LaTeX rendering by protecting $...$ from markdown (closes #7423 )

2026-04-04 19:33:05 -07:00

image_models.py

Image: Quantize the text encoder for lower VRAM

2025-12-05 13:08:46 -08:00

image_utils.py

Security: server-side file save roots, image URL SSRF protection, extension allowlist

2026-03-17 22:29:35 -07:00

llama_cpp_server.py

Revert "API: Add warning about vanilla llama-server not supporting prompt logprobs + instructions"

2026-04-03 07:30:48 -07:00

loaders.py

Fix portable builds not starting due to missing ik element

2026-04-02 19:14:50 -07:00

logging_colors.py

Lint

2023-12-19 21:36:57 -08:00

logits.py

Fix --idle-timeout issues with encode/decode and parallel generation

2026-03-25 06:37:45 -07:00

LoRA.py

Remove ExLlamaV2 backend

2026-03-05 14:02:13 -08:00

metadata_gguf.py

fix: replace bare except clauses with except Exception (#7400 )

2026-03-04 18:06:17 -03:00

models_settings.py

Remove obsolete models/config.yaml and related code

2026-03-24 18:48:50 -07:00

models.py

Rename "truncation length" to "context length" in logs

2026-03-25 07:21:02 -07:00

paths.py

Portable mode: always use ../user_data if it exists

2026-03-06 18:04:48 -08:00

presets.py

Move top_p and top_k higher up in the UI and CLI help

2026-03-15 09:34:17 -07:00

prompts.py

fix(security): sanitize filenames in all prompt file operations (CWE-22) (#7462 )

2026-04-03 19:36:50 -03:00

reasoning.py

Add Gemma 4 tool-calling support

2026-04-02 20:26:27 -07:00

sampler_hijack.py

Add adaptive-p sampler and n-gram speculative decoding support

2026-03-04 09:41:29 -08:00

sane_markdown_lists.py

Disable uncommonly used indented codeblocks (#7401 )

2026-03-04 17:51:00 -03:00

shared.py

Add ik_llama.cpp support via ik_llama_cpp_binaries package

2026-03-28 12:09:00 -03:00

tensorrt_llm.py

TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support

2026-03-05 18:09:45 -08:00

text_generation.py

Fix --idle-timeout issues with encode/decode and parallel generation

2026-03-25 06:37:45 -07:00

tool_parsing.py

UI: Fix tool buffer check truncating visible text at end of generation

2026-04-04 09:57:07 -07:00

tool_use.py

Clean up tool calling code

2026-03-13 18:27:01 -07:00

torch_utils.py

Remove obsolete DeepSpeed inference code (2023 relic)

2026-03-04 17:20:34 -08:00

training.py

UI: Make accordion outline styling global

2026-04-04 20:13:20 -07:00

transformers_loader.py

Don't pass torch_dtype to transformers, autodetect from model config

2026-04-02 00:44:14 -03:00

ui_chat.py

UI: Improve the hover menu looks

2026-04-04 18:29:36 -07:00

ui_default.py

fix(security): sanitize filenames in all prompt file operations (CWE-22) (#7462 )

2026-04-03 19:36:50 -03:00

ui_file_saving.py

Use logger.exception() instead of traceback.print_exc() for error messages

2026-03-18 20:42:20 -07:00

ui_image_generation.py

Use logger.exception() instead of traceback.print_exc() for error messages

2026-03-18 20:42:20 -07:00

ui_model_menu.py

UI: Make accordion outline styling global

2026-04-04 20:13:20 -07:00

ui_notebook.py

fix(security): sanitize filenames in all prompt file operations (CWE-22) (#7462 )

2026-04-03 19:36:50 -03:00

ui_parameters.py

Move top_p and top_k higher up in the UI and CLI help

2026-03-15 09:34:17 -07:00

ui_session.py

API: Move OpenAI-compatible API from extensions/openai to modules/api

2026-03-20 14:46:00 -03:00

ui.py

UI: Improve message text contrast

2026-04-04 18:53:13 -07:00

utils.py

Fix crash when no model is selected (None passed to resolve_model_path)

2026-04-03 05:56:36 -07:00

web_search.py

web search: Update the user agents

2026-03-17 05:41:05 -07:00