koboldcpp/tools
Mikolaj Kucharski aa94f20861
args: add LLAMA_ARG_SLOT_SAVE_PATH env for --slot-save-path (#30272)
Allow configuring --slot-save-path via LLAMA_ARG_SLOT_SAVE_PATH so
it can be set from an EnvironmentFile in a systemd unit file.
2026-10-10 15:34:40 +02:00
..
batched-bench batch: migrate the rest of examples to llama_batch_ext (#29601) 2026-09-30 18:08:43 +02:00
cli server: use port 9931 by default (#30159) 2026-10-09 10:40:03 +02:00
completion llama: support MoE cache over multiple GPUs (#30112) 2026-10-08 15:50:49 +05:30
cvector-generator batch: migrate the rest of examples to llama_batch_ext (#29601) 2026-09-30 18:08:43 +02:00
export-lora docs: fix export-lora --lora-scaled syntax [no release] (#24703) 2026-06-18 16:46:17 +02:00
fit-params server: use port 9931 by default (#30159) 2026-10-09 10:40:03 +02:00
gguf-split cmake : introduce semantic versioning (#26839) 2026-08-12 14:15:03 +02:00
imatrix imatrix : include clocale for std::setlocale (#30079) 2026-10-07 10:58:22 +02:00
llama-bench llama-bench: respect -fitc if bigger than required benchmark size (#28331) 2026-10-09 19:14:30 +02:00
mtmd mtmd: add build_inp_attn_mask (#30259) 2026-10-10 11:22:12 +02:00
perplexity batch: migrate the rest of examples to llama_batch_ext (#29601) 2026-09-30 18:08:43 +02:00
quantize quantize: cap working memory size to avoid loading big tensors onto RAM (#27795) 2026-08-27 18:31:13 +02:00
results batch: migrate the rest of examples to llama_batch_ext (#29601) 2026-09-30 18:08:43 +02:00
rpc common,rpc : fix cache dir creation through symlinks on buggy libstdc++ (#29816) 2026-10-01 20:15:02 +02:00
server args: add LLAMA_ARG_SLOT_SAVE_PATH env for --slot-save-path (#30272) 2026-10-10 15:34:40 +02:00
tokenize tokenize : drop --stdin mutual-exclusion check (#25672) 2026-07-15 18:41:51 +02:00
tts args: add --video-* CLI arguments (#24318) 2026-08-27 12:11:12 +02:00
tuning metal : key the fa-vec tuned table by family instead of SKU (#29075) 2026-09-23 19:23:15 +08:00
ui ui: Models Manager Follow-up Improvements (#30228) 2026-10-09 19:28:54 +02:00
CMakeLists.txt metal : per-device tuned (Q, NE) for flash-attn vec (#26570) 2026-08-24 19:22:27 +03:00