6 Commits

Author	SHA1	Message	Date
oobabooga	8e34c7b1b0	Show live context size while generating	2026-05-15 12:45:05 -07:00
oobabooga	f52d9336e5	TensorRT-LLM: Migrate from ModelRunner to LLM API, add concurrent API request support	2026-03-05 18:09:45 -08:00
oobabooga	268cc3f100	Update TensorRT-LLM to v1.1.0	2026-03-05 09:32:28 -03:00
oobabooga	fd61297933	Lint	2025-05-15 21:19:19 -07:00
oobabooga	d4b1e31c49	Use --ctx-size to specify the context size for all loaders ... Old flags are still recognized as alternatives.	2025-04-25 16:59:03 -07:00
oobabooga	577a8cd3ee	Add TensorRT-LLM support (#5715)	2024-06-24 02:30:03 -03:00