upstream-archive/textgen
1
0
Fork 0
mirror of https://github.com/oobabooga/textgen.git synced 2026-08-02 16:20:42 -05:00
Code Issues Packages Projects Releases Wiki Activity

Make token bans work again on HF loaders (#6488)

Browse Source
This commit is contained in:
PIRI
2024-10-24 18:24:02 +00:00
committed by GitHub
parent b50dc3bf57
commit e1061ba7e3
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
modules/sampler_hijack.py
View File

@@ -454,7 +454,7 @@ def get_logits_processor_patch(self, **kwargs):
)
# Stuff we don't need
elif warpers[i].__class__.__name__ in ['SuppressTokensLogitsProcessor', 'RepetitionPenaltyLogitsProcessor']:
elif warpers[i].__class__.__name__ in ['RepetitionPenaltyLogitsProcessor']:
del warpers[i]
# Add custom warpers