oobabooga 8b66d83aa9 Set use_fast=True by default, create --no_use_fast flag ...

This increases tokens/second for HF loaders.

2023-11-16 19:55:28 -08:00

..

AutoGPTQ_loader.py

Fix is_ccl_available & is_xpu_available imports

2023-10-26 20:27:04 -07:00

block_requests.py

Bump to latest gradio (3.47) (#4258)

2023-10-10 22:20:49 -03:00

callbacks.py

Intel Gpu support initialization (#4340)

2023-10-26 23:39:51 -03:00

chat.py

Separate context and system message in instruction formats (#4499)

2023-11-07 20:02:58 -03:00

ctransformers_model.py

Fix ctransformers model unload (#3711)

2023-08-27 10:53:48 -03:00

deepspeed_parameters.py

Fix typo in deepspeed_parameters.py (#3222)

2023-07-24 11:17:28 -03:00

evaluate.py

Clear the torch cache while evaluating

2023-10-16 10:52:50 -07:00

exllama_hf.py

Fix off-by-one error in exllama_hf caching logic (#4145)

2023-10-05 12:20:56 -03:00

exllama.py

Exllamav2 lora support (#4229)

2023-10-14 16:12:41 -03:00

exllamav2_hf.py

Add cache_8bit option

2023-11-02 11:23:04 -07:00

exllamav2.py

Add missing exllamav2 samplers

2023-11-16 07:09:40 -08:00

extensions.py

Fix unexpected extensions load after gradio restart (#3965)

2023-09-17 17:35:43 -03:00

github.py

Lint

2023-09-25 20:31:11 -07:00

GPTQ_loader.py

make torch.load a bit safer (#4448)

2023-11-02 14:07:08 -03:00

grammar.py

Add grammar to transformers and _HF loaders (#4091)

2023-10-05 10:01:36 -03:00

html_generator.py

Fix default/notebook tabs css

2023-10-10 18:45:12 -07:00

llama_attn_hijack.py

Lint

2023-10-23 13:09:03 -07:00

llamacpp_hf.py

Bump llama-cpp-python to 0.2.18 (#4611)

2023-11-16 22:55:14 -03:00

llamacpp_model.py

Bump llama-cpp-python to 0.2.18 (#4611)

2023-11-16 22:55:14 -03:00

loaders.py

Set use_fast=True by default, create --no_use_fast flag

2023-11-16 19:55:28 -08:00

logging_colors.py

Add menus for saving presets/characters/instruction templates/prompts (#2621)

2023-06-11 12:19:18 -03:00

logits.py

Intel Gpu support initialization (#4340)

2023-10-26 23:39:51 -03:00

LoRA.py

Intel Gpu support initialization (#4340)

2023-10-26 23:39:51 -03:00

metadata_gguf.py

Lint

2023-09-19 13:51:57 -07:00

models_settings.py

Style changes

2023-11-15 15:51:37 -08:00

models.py

Set use_fast=True by default, create --no_use_fast flag

2023-11-16 19:55:28 -08:00

monkey_patch_gptq_lora.py

fix lora training with alpaca_lora_4bit (#3853)

2023-09-11 01:22:20 -03:00

one_click_installer_check.py

Lint

2023-11-16 18:03:06 -08:00

presets.py

Make OpenAI API the default API (#4430)

2023-11-06 02:38:29 -03:00

prompts.py

Fix "send instruction template to..." buttons (closes #4625)

2023-11-16 18:16:42 -08:00

relative_imports.py

Add ExLlama+LoRA support (#2756)

2023-06-19 12:31:24 -03:00

RoPE.py

Add missing file

2023-08-25 07:10:26 -07:00

RWKV.py

Intel Gpu support initialization (#4340)

2023-10-26 23:39:51 -03:00

sampler_hijack.py

Add temperature_last parameter (#4472)

2023-11-04 13:09:07 -03:00

shared.py

Set use_fast=True by default, create --no_use_fast flag

2023-11-16 19:55:28 -08:00

text_generation.py

Add types to the encode/decode/token-count endpoints

2023-11-07 19:32:14 -08:00

training.py

make torch.load a bit safer (#4448)

2023-11-02 14:07:08 -03:00

ui_chat.py

Fix "send instruction template to..." buttons (closes #4625)

2023-11-16 18:16:42 -08:00

ui_default.py

Improve --multi-user mode

2023-09-26 06:42:33 -07:00

ui_file_saving.py

Bump to latest gradio (3.47) (#4258)

2023-10-10 22:20:49 -03:00

ui_model_menu.py

Set use_fast=True by default, create --no_use_fast flag

2023-11-16 19:55:28 -08:00

ui_notebook.py

Improve --multi-user mode

2023-09-26 06:42:33 -07:00

ui_parameters.py

Add temperature_last parameter (#4472)

2023-11-04 13:09:07 -03:00

ui_session.py

Start API when "api" checkbox is checked

2023-11-15 16:35:47 -08:00

ui.py

Set use_fast=True by default, create --no_use_fast flag

2023-11-16 19:55:28 -08:00

utils.py

Refactor the /v1/models endpoint

2023-11-07 19:59:27 -08:00