Files
llama.cpp/ggml
Ethan Guo 926862e574 metal : add tensor API flash attention kernel for F16 KV (#29570)
* metal : add tensor API flash attention kernel for F16 KV

* cont : add tensor FA kernels for DK=DV=512 and DK=576, DV=512

* cont : support attention sinks, ALiBi and logit softcap in the tensor FA kernel

* cont : add tensor FA kernel for DK=192, DV=128
2026-10-02 13:19:21 +03:00
..
2024-07-13 18:12:39 +02:00