mirror of
https://github.com/oobabooga/textgen.git
synced 2026-08-01 07:40:42 -05:00
415 B
415 B
If you are having trouble following the installation instructions in the README, Reddit user Technical_Leather949 has created a more detailed, step-by-step guide covering:
- Windows installation
- 8-bit mode on Windows
- LLaMA
- LLaMA 4-bit
The guide can be found here: https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_install_llama_8bit_and_4bit/