Aman Gupta d6cf9acb25 llama : add a GPU cache for MoE experts kept in host memory (#29887) ...

* llama : add a GPU cache for MoE experts kept in host memory

Assisted-by: Claude

* use llama_moe_cache_ptr

2026-10-07 21:07:45 +03:00

..

llama-cpp.h

llama: add llama_batch_ext (#24669)

2026-09-24 16:25:07 +02:00

llama.h

llama : add a GPU cache for MoE experts kept in host memory (#29887)

2026-10-07 21:07:45 +03:00