upstream-archive/textgen
1
0
Fork 0
mirror of https://github.com/oobabooga/textgen.git synced 2026-07-23 11:20:54 -05:00
Code Issues Packages Projects Releases Wiki Activity

Fix API model load silently dropping hyphenated arg keys (closes #7577)

Browse Source
This commit is contained in:
oobabooga
2026-05-20 07:12:07 -07:00
parent 350eb1780d
commit 2fb21dcd4e
1 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
modules/api/models.py
View File

@@ -64,9 +64,10 @@ def _load_model(data):
update_model_parameters(model_settings)
if args:
for k in args:
for k, v in args.items():
k = k.replace('-', '_')
if k in allowed_keys and hasattr(shared.args, k):
setattr(shared.args, k, args[k])
setattr(shared.args, k, v)
shared.model, shared.tokenizer = load_model(model_name)