llama.cpp/examples/main/main.cpp at 758ff1bbb59de40dfe8e1aae2cf5dfd3af51ae76

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-02 16:10:48 -05:00

Files

goerch afc4ca2889 convert : update convert-new.py with tokenizer fixes (#2614 )

* Merge tokenizer fixes into the gguf branch.

* Add test vocabularies

* Adapt convert-new.py (and fix a clang-cl compiler error on windows)

2023-08-14 20:20:04 +03:00

View Raw