feat: auto-detect max VRAM budget with --max-vram -1 (#1498)

This commit is contained in:
leejet
2026-05-16 16:14:25 +08:00
committed by GitHub
parent fd1a2794f3
commit 38b14adb67
7 changed files with 65 additions and 10 deletions

View File

@@ -157,7 +157,7 @@ Context Options:
then threads will be set to the number of CPU physical cores
--chroma-t5-mask-pad <int> t5 mask pad size of chroma
--max-vram <float> maximum VRAM budget in GiB for graph-cut segmented execution. 0 disables
graph splitting
graph splitting; -1 auto-detects free VRAM minus 1 GiB
--force-sdxl-vae-conv-scale force use of conv scale on sdxl vae
--offload-to-cpu place the weights in RAM to save VRAM, and automatically load them into VRAM
when needed