textgen

mirror of https://github.com/oobabooga/textgen.git synced 2026-08-02 00:00:42 -05:00

Files

Andy Salerno 654933c634 New universal API with streaming/blocking endpoints (#990 )

Previous title: Add api_streaming extension and update api-example-stream to use it

* Merge with latest main

* Add parameter capturing encoder_repetition_penalty

* Change some defaults, minor fixes

* Add --api, --public-api flags

* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.

* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'

* Update the API examples

* Change a comment

* Update README

* Remove the gradio API

* Remove unused import

* Minor change

* Remove unused import

---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>

2023-04-23 15:52:43 -03:00

callbacks.py

Make the code more like PEP8 for readability (#862 )

2023-04-07 00:15:45 -03:00

chat.py

Reset your name when choosing a character

2023-04-17 13:56:40 -03:00

deepspeed_parameters.py

Fix deepspeed (oops)

2023-02-02 10:39:37 -03:00

evaluate.py

Fix evaluate comment saving