koboldcpp/include
Aman Gupta d6cf9acb25
llama : add a GPU cache for MoE experts kept in host memory (#29887)
* llama : add a GPU cache for MoE experts kept in host memory

Assisted-by: Claude

* use llama_moe_cache_ptr
2026-10-07 21:07:45 +03:00
..
llama-cpp.h llama: add llama_batch_ext (#24669) 2026-09-24 16:25:07 +02:00
llama.h llama : add a GPU cache for MoE experts kept in host memory (#29887) 2026-10-07 21:07:45 +03:00