upstream-archive/textgen
1
0
Fork 0
mirror of https://github.com/oobabooga/textgen.git synced 2026-07-29 22:30:47 -05:00
Code Issues Packages Projects Releases Wiki Activity
3,619 Commits 14 Branches 113 Tags
cbd65ba767b3ac8c87fa95c5e633b8aec24c2777
Commit Graph

4 Commits

Author SHA1 Message Date
oobabooga
d890c99b53 Fix StreamingLLM when content is removed from the beginning of the prompt 2024-03-14 09:18:54 -07:00
oobabooga
9eca197409 Minor logging change 2024-03-11 16:31:13 -07:00
oobabooga
cf0697936a Optimize StreamingLLM by over 10x 2024-03-08 21:48:28 -08:00
oobabooga
afb51bd5d6 Add StreamingLLM for llamacpp & llamacpp_HF (2nd attempt) (#5669) 2024-03-09 00:25:33 -03:00