oobabooga 4ff91b6588 Better default settings for Speculative Decoding

2025-04-26 17:24:40 -07:00

..

grammar

Let grammar escape backslashes (#5865)

2024-05-19 20:26:09 -03:00

block_requests.py

Fix the Google Colab notebook

2025-01-16 05:21:18 -08:00

callbacks.py

Refactor the transformers loader (#6859)

2025-04-20 13:33:47 -03:00

chat.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

deepspeed_parameters.py

Fix typo in deepspeed_parameters.py (#3222)

2023-07-24 11:17:28 -03:00

evaluate.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

exllamav2_hf.py

Use --ctx-size to specify the context size for all loaders

2025-04-25 16:59:03 -07:00

exllamav2.py

Use --ctx-size to specify the context size for all loaders

2025-04-25 16:59:03 -07:00

exllamav3_hf.py

ExLlamaV3: Add kv cache quantization (#6903)

2025-04-25 21:32:00 -03:00

extensions.py

Move update_wizard_windows.sh to update_wizard_windows.bat (oops)

2024-03-04 19:26:24 -08:00

github.py

Fix several typos in the codebase (#6151)

2024-06-22 21:40:25 -03:00

gradio_hijack.py

Improve host header validation in local mode

2025-04-26 15:42:17 -07:00

html_generator.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

llama_cpp_server.py

Use --ctx-size to specify the context size for all loaders

2025-04-25 16:59:03 -07:00

loaders.py

ExLlamaV3: Add kv cache quantization (#6903)

2025-04-25 21:32:00 -03:00

logging_colors.py

Lint

2023-12-19 21:36:57 -08:00

logits.py

Refactor the transformers loader (#6859)

2025-04-20 13:33:47 -03:00

LoRA.py

Refactor the transformers loader (#6859)

2025-04-20 13:33:47 -03:00

metadata_gguf.py

llama.cpp: read instruction template from GGUF metadata (#4975)

2023-12-18 01:51:58 -03:00

models_settings.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

models.py

Use --ctx-size to specify the context size for all loaders

2025-04-25 16:59:03 -07:00

presets.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

prompts.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

relative_imports.py

Add ExLlama+LoRA support (#2756)

2023-06-19 12:31:24 -03:00

sampler_hijack.py

Fix the exllamav2_HF and exllamav3_HF loaders

2025-04-21 18:32:23 -07:00

sane_markdown_lists.py

Sane handling of markdown lists (#6626)

2025-01-04 15:41:31 -03:00

shared.py

Better default settings for Speculative Decoding

2025-04-26 17:24:40 -07:00

tensorrt_llm.py

Use --ctx-size to specify the context size for all loaders

2025-04-25 16:59:03 -07:00

text_generation.py

EXL2: add another torch.cuda.synchronize() call to prevent errors

2025-04-24 09:03:49 -07:00

torch_utils.py

Refactor the transformers loader (#6859)

2025-04-20 13:33:47 -03:00

training.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

transformers_loader.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

ui_chat.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

ui_default.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

ui_file_saving.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

ui_model_menu.py

Better default settings for Speculative Decoding

2025-04-26 17:24:40 -07:00

ui_notebook.py

Lint

2024-12-17 20:13:32 -08:00

ui_parameters.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

ui_session.py

Change a UI description

2025-04-26 05:13:08 -07:00

ui.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00

utils.py

Restructure the repository (#6904)

2025-04-26 08:56:54 -03:00