Georgi Gerganov 3fb47677ea common : add --spec-draft-n-ubatch (#30459) ... * common : add --spec-draft-n-ubatch Allow configuring the physical batch size of the draft context. The drafters feed it at most the drafted tokens per sequence and chunk larger batches by its own n_ubatch, so it does not need the ubatch of the target. A smaller value shrinks the draft compute buffer and leaves more VRAM for the target KV cache (the draft is fitted together with the target). The default 0 keeps the current behavior of following --n-ubatch. Assisted-by: pi:llama.cpp/Qwen3.8-Flash-Next * cont : remove comment [no ci]		2026-10-14 13:58:05 +03:00
..
android	android: fix missing screenshots for Android.md (#18156)	2025-12-19 09:32:04 +02:00
backend	docs : clarify installation recommendation for Intel oneAPI Toolkit (#30407)	2026-10-14 12:19:10 +02:00
development	chat : name tool and argument parser rules by index (#30088)	2026-10-07 22:37:51 +02:00
multimodal	model : support MiniCPM-V 4.7 (#29416)	2026-10-10 20:41:59 +02:00
ops	docs : update zDNN supported ops (#30472)	2026-10-13 20:20:41 +02:00
android.md	kleidiai : Update KleidiAI Documentation (#26078)	2026-09-01 10:45:13 +02:00
autoparser.md	common : add LLM-jp-4.1 Harmony dialect handler (#29681)	2026-10-01 08:33:55 +03:00
build-profiling.md	cmake : add PCH and unity build to improve build times (#28091)	2026-09-11 13:01:29 +02:00
build-riscv64-spacemit.md	ggml-cpu : add Q8_0 IME1 matrix kernel for SpacemiT X60 (#28479)	2026-10-05 10:34:15 +03:00
build-s390x.md	ggml-cpu(s390x): add Q1_0 vector intrinsic support (#28606)	2026-09-10 09:50:28 +03:00
build.md	musa: drop mp_21 from the default architectures (#30203)	2026-10-09 12:51:24 +02:00
completions.md	readme : refresh (#26280)	2026-07-30 16:14:37 +03:00
docker.md	musa: build the docker images from the PH1 MUSA SDK image (#29481)	2026-09-26 21:50:27 +02:00
function-calling.md	server: use port 9931 by default (#30159)	2026-10-09 10:40:03 +02:00
install.md	docs: Adapt conda-forge package name (#26229)	2026-07-28 16:51:20 +02:00
llguidance.md	llguidance build fixes for Windows (#11664)	2025-02-14 12:46:08 -08:00
models.md	readme : refresh (#26280)	2026-07-30 16:14:37 +03:00
multi-gpu.md	Write a readme on Multi-GPU usage in llama.cpp (#22729)	2026-05-07 17:48:40 +02:00
multimodal.md	mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)	2026-06-18 12:04:39 +02:00
ops.md	docs : update zDNN supported ops (#30472)	2026-10-13 20:20:41 +02:00
preset.md	common: add system-level config file (#26118)	2026-08-13 00:02:27 +02:00
release.md	ci : allow make-release to target a specific commit (#27234)	2026-08-17 11:52:46 +03:00
speculative.md	common : add --spec-draft-n-ubatch (#30459)	2026-10-14 13:58:05 +03:00
xcframework.md	readme : refresh (#26280)	2026-07-30 16:14:37 +03:00